Integration of Multi-Modal Sensors and Robot Arm Vision for Monitoring and Assisting Elderly Activities

Suwatri Jura, Abdul Jalil

Abstract


This research aims to develop an integration device combining Multi-Modal Sensors and Robot Arm Vision (MMS-RAV) for monitoring activities and assisting in healthcare services for the elderly at home. The method used to develop this device involves integrating MMS, which consists of PIR sensors for detecting the presence of the elderly, LDR sensors for detecting home light conditions, fire sensors for detecting flames, and DHT11 sensors for measuring temperature and humidity. Additionally, the RAV component assists and supports the activities of the elderly and includes a camera for vision-based object detection, ultrasonic sensors for robot navigation, Raspberry Pi as the data processing center, an arm for object retrieval and camera movement, LCD for displaying messages, omni-wheels for robot navigation, and buzzer for early warnings in case of anomalous conditions with the elderly. In this research, MMS functions to monitor elderly activities, while RAV supports healthcare services for the elderly, particularly in medication intake using image processing techniques. The software used to control the entire MMSRAV system is the robot operating system. The results of this study indicate that the developed MMS-RAV device is effective for monitoring elderly activities and assisting in providing healthcare services for medication intake.


Keywords


Multi-Modal Sensor; Robot Arm Vision; Elderly; Image Processing

Full Text:

PDF

References


H. C. -Y. Liu, X. -L. Ho and L. -Y. Hsu, “Research on the Improvement of Satisfaction of Elderly Relatives for an Elderly Care Facility Based on Internet Application, ” 2021 2nd International Conference on Education, Knowledge and Information Management (ICEKIM), Xiamen, China, 2021, pp. 836-840, doi: 10.1109/ICEKIM52309.2021.00189.

Z. Liu, “Research on intelligent home care system based on Internet of Things, ” 2022 IEEE International Conference on Electrical Engineering, Big Data and Algorithms (EEBDA), Changchun, China, 2022, pp. 326-328, doi: 10.1109/EEBDA53927.2022.9744876.

P.Wahyuningsih, “Sistem Kontrol Informasi Aktivitas Lansia Berbasis Internet of Things (IoT),” ILKOM Jurnal Ilmiah, Vol. 10, No. 2, pp. 120-127, 2018. DOI: 10.33096/ilkom.v10i2.271.120-127.

M.A.A Haadi., C.Setianingsih., dan T.W.Purboyo, “Sistem Pemantau Aktivitas Keseharian Lansia Berbasis Deteksi Objek Menggunakan Algoritma YOLO,” e-Proceeding of Engineering, Vol. 10, No. 1, pp. 836-843, 2023.

H.Asnal., K.Mirnawati., Tashid., dan M.K.Anam, “Sistem Monitoring Posisi Lanjut Usia Menggunakan Teknologi Geofencing Berbasis Android,” SATIN – Sains dan Teknologi Informasi, Vol. 8, No. 1, pp. 61-68, 2022. DOI: 10.33372/stn.v8i1.830.

S.P.Laksono., I.Syarif., dan MS. Qomariyah, “Peningkatan Kesehatan Lansia Melalui Sistem Informasi Ageing Monitoring Medical Record,” Seminar Nasional Kolaborasi Pengabdian Pada Masyarakat, Vol. 1, pp. 333-339, 2018.

Istiqomah., H.Mukhtar., H.Susanti., W.A.Cahyadi., B.S.Nugroho., S.Setiyadi., N.A.Afrinaldi., N.Husnul., dan F.Ardian, “Implementasi Alat Pemantau Aktivitas dan Pelacakan Lokasi Jatuh (E-Care) Untuk Lansia di Daerah Cikutra Kota Bandung,” Jurnal Panrita Abdi, Vol. 7, No. 1, pp. 99-109, 2023.

P.Y.Tama., S.A.Wibowo., dan F.X.Ariwibisono, “Perancangan Sistem Monitoring Lokasi Untuk Pengawasan Lansia Penderita Demensia Menggunakan Alat Berbasis Internet of Things,” JATI, Vol. 6, No. 2, pp. 1167-1175, 2022.

A.Gunawan., Y.Y.Gamaliel., dan T.A.Nugroho, “Pengembangan Sistem Pengawasan Lansia Berbasis Microcontroller dan Aplikasi Mobile,” Jurnal Telematika Institute Teknologi Harapan Bangsa, Vol. 16, No. 2, pp. 63-68, 2021. DOI: https://doi.org/10.61769/telematika.v16i2.401.

D.A.Pratama., dan R.T.Shita, “IoT Emergency Untuk Lansia Dengan Memanfaatkan Sensor Sentuh Pada Mikrokontroler Nodemcu ESP8266 Berbasis Android,” Prosiding Seminar Nasional Mahasiswa Fakultas Teknologi Informasi (SENAFTI), Vol. 1, No. 1, pp. 962-971, 2022.

J. Andrews, M. Kowsika, A. Vakil and J. Li, "A Motion Induced Passive Infrared (PIR) Sensor for Stationary Human Occupancy Detection," 2020 IEEE/ION Position, Location and Navigation Symposium (PLANS), Portland, OR, USA, 2020, pp. 1295-1304, doi: 10.1109/PLANS46316.2020.9109909.

K. Hamza, M. Hamid, L. Imane and S. Karima, "Study and realization of a control system prototype for a two-axis LDR-based solar tracker*," 2022 7th International Conference on Mathematics and Computers in Sciences and Industry (MCSI), Athens, Greece, 2022, pp. 131-138, doi: 10.1109/MCSI55933.2022.00027.

R. K. Ikbar, E. Mulyana, R. Mardiati and R. R. Nurmalasari, "Fire Fighting Robot Using Flame Detector and Ultrasonic Based on Fuzzy Logic Control," 2022 16th International Conference on Telecommunication Systems, Services, and Applications (TSSA), Lombok, Indonesia, 2022, pp. 1-6, doi: 10.1109/TSSA56819.2022.10063922.

Sunardi, A. Yudhana and Furizal, "Tsukamoto Fuzzy Inference System on Internet of Things-Based for Room Temperature and Humidity Control," in IEEE Access, vol. 11, pp. 6209-6227, 2023, doi: 10.1109/ACCESS.2023.3236183.

A. Tomy, A. Paigwar, K. S. Mann, A. Renzaglia and C. Laugier, "Fusing Event-based and RGB camera for Robust Object Detection in Adverse Conditions," 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA, 2022, pp. 933-939, doi: 10.1109/ICRA46639.2022.9812059.

A. Tripathi, M. A. Khan, A. Pandey, P. Yadav and A. K. Sharma, "Human Following Robot using Ultrasonic Sensor," 2021 3rd International Conference on Advances in Computing, Communication Control and Networking (ICAC3N), Greater Noida, India, 2021, pp. 764-770, doi: 10.1109/ICAC3N53548.2021.9725768.

Z. Zhanying and D. Yingying, "IoT Data Acquisition Terminal Based on Raspberry Pi," 2021 International Conference on Intelligent Computing, Automation and Systems (ICICAS), Chongqing, China, 2021, pp. 358-361, doi: 10.1109/ICICAS53977.2021.00081.

J. Lin, Z. Gu, A. M. Amir, X. Chen, K. Ashim and K. Shi, "A fast humanoid robot arm for boxing based on servo motors," 2021 International Conference on High Performance Big Data and Intelligent Systems (HPBD&IS), Macau, China, 2021, pp. 252-255, doi: 10.1109/HPBDIS53214.2021.9658471.

M. M. Mustafa and I. Hamarash, "Microcontroller-Based Motion Control for DC Motor Driven Robot Link," 2019 International Aegean Conference on Electrical Machines and Power Electronics (ACEMP) & 2019 International Conference on Optimization of Electrical and Electronic Equipment (OPTIM), Istanbul, Turkey, 2019, pp. 547-552, doi: 10.1109/ACEMP-OPTIM44294.2019.9007122.

Manurung, M. J., Poningsih, P., Andani, S. R. ., Safii, M. ., & Irawan, I. (2021). Door Security Design Using Fingerprint and Buzzer Alarm Based on Arduino. Journal of Computer Networks, Architecture and High Performance Computing, 3(1), 42-51. https://doi.org/10.47709/cnahpc.v3i1.929.

D M. Steve, F. Tully, G. Brian, L. Chris, and W. William, “V Robot Operating System 2: Design, Architecture, and Uses In The Wild,” arXiv, 2022, doi: https://doi.org/10.48550/arXiv.2211.07752.




DOI: https://doi.org/10.17529/jre.v21i1.41273

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


View My Stats

 

Creative Commons License

Jurnal Rekayasa Elektrika (JRE) is published under license of Creative Commons Attribution-ShareAlike 4.0 International License.