Uni-Modal Pipeline for Data-Agnostic Sign Language Recognition: Framework & Evaluation
Student: David Ajibola Bakare (Project, 2025)
Department of Information Technology
University of Ilorin, Kwara State
Abstract
The automatic recognition of continuous sign language presents a significant challenge in artificial intelligence due to its complex linguistic structures and the scarcity of standardized research tools. This paper introduces and evaluates a new uni-modal architectural pipeline for data-agnostic sign language recognition, prioritizing the analysis of manual gestures to balance linguistic completeness, computational efficiency, and user privacy. The system's core is a Bidirectional Long Short-Term Memory (Bi-LSTM) network, integrated into a scalable, low-latency inference system that uses client-side feature extraction and gRPC for efficient data transfer. Validated on a custom dataset with a constrained vocabulary, the hands-only pipeline achieved an impressive F1-Score of 0.978, confirming its effectiveness as a highly efficient baseline for future sign language recognition research. This performance suggests that for many real-world applications, a uni-modal approach can provide an optimal balance between accuracy and practical applicability, especially when user privacy and computational resource optimization are crucial. The framework's modularity also allows researchers to isolate and investigate specific aspects of sign language recognition, facilitating more targeted and efficient model development and dataset curation. This work highlights the potential of a hands-only approach to create accessible and privacy-preserving sign language recognition technologies.
Keywords
For the full publication, please contact the author directly at: bakaredavid007@gmail.com
Filters
Institutions
- Adeseun Ogundoyin Polytechnic, Eruwa, Oyo State 1
- Adeyemi College of Education, Ondo State. (affl To Oau, Ile-Ife) 68
- Ahmadu Bello University, Zaria, Kaduna State 101
- Air Force Institute of Technology (Degree), Kaduna, Kaduna State 11
- Air Force Institute of Technology, Kaduna, Kaduna State 2
- Akanu Ibiam Federal Polytechnic, Unwana, Afikpo, Ebonyi State 6
- Akwa Ibom State University, Ikot-Akpaden, Akwa Ibom State 53
- Akwa Ibom State College of Edu, Afaha-Nsit (Affl To Uni Uyo), Akwa Ibom State 2
- AKWA-IBOM STATE POLYTECHNIC (IEI), IKOT-OSURUA, AKWA IBOM STATE 41
- Akwa-Ibom State Polytechnic, Ikot-Osurua, Akwa Ibom State 32