Teuku M Arief Afwan, Rahmat Gernowo, Helmie Arif Wibawa

Deep Learning-Based Recognition of Indonesian Sign Language (BISINDO) Alphabetic Gestures Using Skeletal Feature Extraction and LSTM

Introduction

Deep learning-based recognition of indonesian sign language (bisindo) alphabetic gestures using skeletal feature extraction and lstm. Recognize Indonesian Sign Language (BISINDO) alphabetic gestures using deep learning, skeletal features & LSTM. Achieves 93% accuracy, advancing accessibility for the deaf community.

Abstract

Communication is a fundamental aspect of human life, and for the deaf community, sign language serves as the primary medium of interaction. In Indonesia, the Indonesian Sign Language (BISINDO) is widely used, however, research on automatic BISINDO recognition remains limited due to the scarcity of representative datasets. This study presents the development of a BISINDO recognition system based on deep learning by integrating the Long Short-Term Memory (LSTM) architecture with the MediaPipe Holistic framework. To address data limitations, a custom dataset comprising 866 BISINDO alphabetic gesture videos was collected, involving recordings from both expert and non-expert signers to capture stylistic variations. Extracted skeletal landmark features were processed through a three-layer LSTM network followed by dense layers for sequential modeling and classification. Experimental results show that the proposed model achieved a validation accuracy of approximately 93%, outperforming static image–based methods and demonstrating the effectiveness of skeletal features in representing dynamic gestures. The model also exhibited real-time applicability with promising performance, although challenges such as misclassification of visually similar gestures and dataset imbalance remain. This study contributes to the underexplored field of BISINDO recognition by providing a baseline system and dataset, and further advances the domains of computer vision and human–computer interaction within informatics through an inclusive, data-driven framework for Indonesian Sign Language recognition and future AI-assisted accessibility technologies.

Full Text

Comments

You need to be logged in to post a comment.