Implementation of Eye-To-Text Morse Code Device to Help Speech Impairments People
Abstract
This research aims to develop an Eye-to-Text Morse Code (ETT-MC) device as an assistive communication tool for individuals with speech disabilities, based on artificial intelligence image processing. The method used to detect speech codes is based on eye blink input, which is converted into Morse code and then translated into letters by utilizing a thresholding image processing technique that compares the pixel values when the eyes are open and closed. In Morse code, there are two main symbols combined to form a letter: the dash and the dot. The object of this research is the eye, where if the system detects the eye in an open state, it is converted into a dot code or value 1, while when the system detects the eye as closed, it is converted into a dash code or value 0. The results and hypotheses of this research show that the developed ETT-MC device can assist individuals with speech disabilities in communicating by utilizing eye blinks as an input medium to convey messages to others with an accuracy rate of up to 80%. This occurs because the accuracy of eye image detection processed by the system is significantly influenced by light intensity, the quality of the image detected by the camera, and the length of the translated text.
Keywords
Full Text:
PDFReferences
B. Ben Mosbah, "Speech Recognition for Disabilities People," 2006 2nd International Conference on Information & Communication Technologies, Damascus, Syria, 2006, pp. 864-869, doi: 10.1109/ICTTA.2006.1684487.
S. Ahmed, R. Islam, M. S. R. Zishan, M. R. Hasan and M. N. Islam, "Electronic speaking system for speech impaired people: Speak up," 2015 International Conference on Electrical Engineering and Information Communication Technology (ICEEICT), Savar, Bangladesh, 2015, pp. 1-4, doi: 10.1109/ICEEICT.2015.7307401.
Daryati., A.P.Fatmawati., A.N.Setyopambudi., dan N.Siyam, “Pengembangan Sakura (Sistem Konsultasi Tuna Wicara) Upaya Memperbaiki Pelayanan Kesehatan Disabilitas,” HIGEIA, Vol. 3, No. 3, pp. 337-344, 2019. DOI: https://doi.org/10.15294/higeia/v3i3/30441.
R.A.Setyawan., dan R.M.Fadilla, “Media Komunikasi Kesehatan Untuk Tuna Rungu dan Tuna Wicara Berbasis Android,” Jurnal Informasi Interaktif, Vol. 7, No. 1, pp. 50-59, 2022.
D.Kasoni., Liesnaningsih., Fandhilah., dan M.Pardi, “Rancang Bangun Smart Gloves Untuk Penyandang Disabilitas Sensorik Rungu Wicara,” Jurnal MULTINETICS, Vol. 9, No. 1, pp. 61-70, 2023. DOI: https://doi.org/10.32722/multinetics.v9i1.5779.
G.R.Mauludi., dan A.Setiyadi, “Pembangunan Alat Penerjemah Huruf dan Angka Bahasa Indonesia Bagi Tunarungu dan Tunawicara Menggunakan Arduino,” Thesis, Universitas Komputer Indonesia, 2019.
A.Kurniawan, “Aplikasi Speech Recognition Sebagai Pengenalan Ucapan Tunawicara Menggunakan Google Cloud Speech API Berbasis Android,” Skripsi, Universitas Islam Negeri Syarif Hidayatullah Jakarta, 2017.
A.Hamid, “Perancangan User Interface Aplikasi Pengenalan Bahasa Isyarat Bagi Penyandang Disabilitas Tunarungu/Tunawicara Serta Non Difable Menggunakan Metode Design Thinking,” Skripsi, Universitas Muhammadiyah Malang, 2022.
N.D.Wulandari, “Pembuatan Aplikasi Kamus Bahasa Isyarat Untuk Tuna Rungu dan Tuna Wicara Berbasis Android,” Skripsi, Universitas Muhammadiyah Surakarta, 2014.
A.Widayanto., Suleman., dan I.Anita S, “Rancang Bangun Aplikasi Kategori Bahasa Untuk Tuna Wicara Berbasis Android,” Jurnal Evolusi, Vol. 5, No. 2, pp. 18-26, 2017.
F.S.Hilyana., H.Mirza., dan B.Gunawan, “Aplikasi Sistem Kendali Pergerakan Kamera Berbasis Android,” Jurnal SIMETRIS, Vol. 11, No. 1, pp. 197-204, 2020. DOI: https://orcid.org/0000-0001-6778-1516.
A.Jalil., dan Matalangi, “Object Motion Detection in Home Security System Using the Binary-Image Comparison Method Based on Robot Operating System 2 and Raspberry Pi,” ILKOM Jurnal Ilmiah, Vol. 13, No. 1, pp. 1-8, 2021. DOI: https://doi.org/10.33096/ilkom.v13i1.686.1-8.
A.Hidayat., I.P.Saputra., dan D.Anggoro, “Chroot Sistem Operasi Linux Ubuntu Pada Harddisk Betype Linux LVM (Studi Kasus: Warnet Sajid.Net Sambikarto, Lampung Timur, Indonesia),” Jurnal Ilmu Komputer dan Informatika, Vol. 3, No. 1, pp. 199-205, 2022. DOI: https://doi.org/10.24127/jiki.v3i1.2374.
A.Mutasil., M.Irsan., dan D.Sujana, “Pengenalan Wajah Menggunakan OpenCV Untuk Validasi Peserta Ujian Penerimaan Mahasiswa Baru,” Jurnal Sistem Komputer dan Kecerdasan Buatan, Vol. 5, No. 1, pp. 21-28, 2021. DOI: https://doi.org/10.47970/siskom-kb.v5i1.221.
P.Wahyuningsih., M.Matalangi., M.N.F.Sukiman., dan Y.Mahenra, “Anomaly Detection for Security in Children’s Play Areas Based on Image Using Multiple Lines Detection Method,” Jurnal Rekayasa Elektrika, Vol. 20, No. 1, pp. 6-11, 2024. DOI: 10.17529/jre.v20i1.34836.
N. Watkinson, P. Tai, A. Nicolau and A. Veidenbaum, "NumbaSummarizer: A Python Library for Simplified Vectorization Reports," 2020 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), New Orleans, LA, USA, 2020, pp. 1-7, doi: 10.1109/IPDPSW50202.2020.00058.
P. Anghelescu, V. G. Iliescu, C. Mara and M. -B. Gavriloaia, "Automatic thresholding method for edge detection algorithms," 2016 8th International Conference on Electronics, Computers and Artificial Intelligence (ECAI), Ploiesti, Romania, 2016, pp. 1-4, doi: 10.1109/ECAI.2016.7861099.
L. Shuhua and G. Gaizhi, "The application of improved HSV color space model in image processing," 2010 2nd International Conference on Future Computer and Communication, Wuhan, China, 2010, pp. V2-10-V2-13, doi: 10.1109/ICFCC.2010.5497299.
DOI: https://doi.org/10.17529/jre.v21i1.41268
Article Metrics
Abstract view : 43 timesPDF - 13 times
Refbacks
- There are currently no refbacks.
View My Stats
Jurnal Rekayasa Elektrika (JRE) is published under license of Creative Commons Attribution-ShareAlike 4.0 International License.