Indonesian Sign Language (BISINDO) Alphabet Detection System Using YOLO (You Only Look Once) Algorithm
DOI:
https://doi.org/10.29103/micoms.v4i.952Keywords:
Sign Language, YOLO, Object Detection , BISINDOAbstract
This research aims to develop an Indonesian Sign Language (BISINDO) alphabet detection system
using the YOLOv5 algorithm, an efficient and fast deep learning-based object detection model. The dataset
used consists of BISINDO alphabet images enriched through data augmentation techniques such as rotation,
flipping, and brightness adjustment. The evaluation results show that the YOLOv5s model achieved very
good performance, with an average precision of 85.2%, recall of 89.3%, F1-score of 87.2%, and mean average
precision (mAP) of 87.1%. The confusion matrix also indicates the model's ability to differentiate each
BISINDO alphabet with high accuracy. The training data testing showed the model successfully achieved
consistent decreases in all loss components, such as a decrease in train box loss from 0.06 to 0.015, and
validation loss converging towards 0.002 for object loss and class loss. The real time testing also shows that
the YOLOv5-based BISINDO alphabet detection system can perform well and consistently, indicating the
practical application potential of this system to facilitate communication between people with
hearing/speech disabilities and the general public. Overall, this research has resulted in an accurate and real
time implementable BISINDO alphabet recognition system.
References
[1] F. A. Setiawan, Z. A. Rohmah, and G. F. Laxmi, “Indonesian Sign Language (BISINDO)
Alphabet Detection Using the You Only Look Once (YOLO) Algorithm Version 8,” in 2024
International Conference on Computer, Control, Informatics and its Applications (IC3INA),
2024, pp. 388–393.
[2] J. Emerson and P. Enderby, “Concerns of speech‐impaired people and those communicating
with them,” Health Soc. Care Community, vol. 8, no. 3, pp. 172–179, 2000.
[3] M. Zakariah, Y. A. Alotaibi, D. Koundal, Y. Guo, and M. Mamun Elahi, “Sign language
recognition for Arabic alphabets using transfer learning technique,” Comput. Intell.
Neurosci., vol. 2022, no. 1, p. 4567989, 2022.
[4] S. Isnaniah, T. Agustina, and F. Annisa, “The Use of Sign Language in Deaf Indonesian
Classrooms in Surakarta,” KEMBARA J. Keilmuan Bahasa, Sastra, dan Pengajarannya, vol.
9, no. 2, pp. 468–481, 2023.
[5] M. De Meulder and H. Haualand, “Sign language interpreting services: A quick fix for
inclusion?,” Transl. Interpret. Stud., vol. 16, no. 1, pp. 19–40, 2021.
[6] R. S. Rathod, Silent Voices, Stronger Bonds: Strategies for Communication with Hearing and
Speech Impaired. Laxmi Book Publication, 2024
[7] A. Hussain, N. Saikia, and C. Dev, “Advancements in Indian Sign Language Recognition
Systems: Enhancing Communication and Accessibility for the Deaf and Hearing Impaired,”
Asian J. Electr. Sci., vol. 12, no. 2, pp. 37–49, 2023.
[8] M. Alaftekin, I. Pacal, and K. Cicek, “Real-time sign language recognition based on YOLO
algorithm,” Neural Comput. Appl., vol. 36, no. 14, pp. 7609–7624, 2024.
[9] T. N. Fitria, “THE USE OF SIGN LANGUAGE AS A MEDIA FOR DELIVERING
INFORMATION ON NATIONAL TELEVISION NEWS BROADCASTS,” ELP (Journal
English Lang. Pedagog., vol. 9, no. 1, pp. 118–131, 2024.
[10] I. G. A. O. Aryananda and F. Samopa, “Comparison of the Accuracy of The Bahasa Isyarat
Indonesia (BISINDO) Detection System Using CNN and RNN Algorithm for
Implementation on Android,” MALCOM Indones. J. Mach. Learn. Comput. Sci., vol. 4, no.
3, pp. 1111–1119, 2024.
[11] T. Diwan, G. Anirudh, and J. V Tembhurne, “Object detection using YOLO: Challenges,
architectural successors, datasets and applications,” Multimed. Tools Appl., vol. 82, no. 6,
pp. 9243–9275, 2023.
[12] J. E. Gallagher and E. J. Oughton, “Surveying You Only Look Once (YOLO) Multispectral
Object Detection Advancements, Applications And Challenges,” arXiv Prepr.
arXiv2409.12977, 2024.
[13] S. Daniels, N. Suciati, and C. Fathichah, “Indonesian sign language recognition using yolo
method,” in IOP Conference Series: Materials Science and Engineering, 2021, vol. 1077, no.
1, p. 12029.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Andra Munandar, Zara Yunizar, Sujacka Retno
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
COPYRIGHT NOTICE
Authors retain copyright and grant the journal right of first publication and this work is licensed under a Creative Commons Attribution-ShareAlike 4.0 that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
All articles in this journal may be disseminated by listing valid sources and the title of the article should not be omitted. The content of the article is liable to the author.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
In the dissemination of articles, the author must declare https://proceedings.unimal.ac.id/micoms/index as the first party to publish the article.
