Multi-task Cascaded Convolutional Neural Network Face Recognition in Robot SAR (Socially Assistive Robot)
Abstract
This study intends to create a Face Recognition system for a Socially Assistive Robot (SAR) created especially for autistic youngsters. Autism is a developmental disease that has varied degrees of impact on social interaction, speech, and behavior. In order to address the developmental deficits in autistic children, early intervention is essential. Children with autism require the right kind of therapy to help them manage their anxiety, develop their social skills, and sharpen their concentration. In this study, Multi-task Cascaded Multi-task Cascaded Convolutional Neural Network(MTCNN) facial recognition technology is used to classify and identify the emotions of autistic children. The technology has the ability to record and recognize children's faces, gauge a child's level of autism, categorize their emotions, and offer the proper support. Previous studies have indicated that it is possible to identify children with autism through their facial expressions. It is anticipated that by using Face Recognition technology on a SAR, autistic youngsters will make progress in their treatment and will feel better emotionally and be more motivated. This research serves as a foundational step in the creation of technologies that can improve the quality of life for kids with autism.
References
S. M. Rahayu, “Deteksi dan Intervensi Dini Pada Anak Autism,” Jurnal Pendidikan Anak, vol. 3, no. 1. 2015. doi: 10.21831/jpa.v3i1.2900.
B. A. B. Ii and T. Pustaka, “BAB II Tinjauan Pustaka BAB II Tinjauan Pustaka 2.1,” no. 2020, pp. 1–64, 2002.
J. Fisika, F. Sains, and U. I. N. A. Makassar, “A . Klasifikasi Umum Robot Berdasarkan fungsinya Gambar 1 Robot berdasarkan fungsinya Berdasarkan sifatnya,” vol. 1, pp. 82–93, 2014.
M. B. S. Bakti and Y. M. Pranoto, “Pengenalan Angka Sistem Isyarat Bahasa Indonesia Dengan Menggunakan Metode Convolutional Neural Networkk,” Semin. Nas. Inov. Teknol., pp. 11–16, 2019.
D. R. Salsabila, R. Aisuwarya, N. P. Novani, L. Arief, and N. Afriyeni, “JITCE (Journal of Information Technology and Computer Engineering) Sistem Pendeteksi Gejala Awal Tantrum pada Anak Autisme Melalui Ekspresi Wajah dengan Convolutional Neural Network,” Jitce, vol. 02, pp. 93–106, 2021, [Online]. Available: http://jitce.fti.unand.ac.id.
M. A. I. Hakim and Y. H. Putra, “Pemanfaatan Mini Pc Raspberry Pi Sebagai Pengontrol Jarak Jauh Berbasis Web Pada Rumah. Unikom,” Jur. Tek. Komput. Unikom, no. September 2015, pp. 1–6, 2013, [Online]. Available: https://www.researchgate.net/profile/Yeffry_Handoko_Putra/publication/312040113.
B. A. Pramono, A. Hendrawan, and A. F. Daru, “Raspberry Pi Dengan Modul Kamera Dan Motion Sensor Sebagai Solusi Cctv Lab Ftik Univ. Semarang,” J. Pengemb. Rekayasa dan Teknol., vol. 14, no. 1, p. 5, 2019, doi: 10.26623/jprt.v14i1.1213. [8] S. K. Galkwad, B. W. Gawali, and P. Yannawar, “A review On Speech Recognition Technique,” Int. J. Comput. Appl., vol. 10, no. November, p. 3, 2010.
M. Ulfah, “Menggunakan Sensor Gy-906 Dan Esp32 Cam,” Jurnal Pendidikan Teknologi Informasi (JUKANTI), no. 5, pp. 2621–1467, 2022.
Alldatasheet.com, No Title. [Online]. Available: https://www.alldatasheet.com/view.jsp?Searchword=Mg995datasheet&gclid=Cj0KCQjwlPWgBhDHARIsAH2xdNcQNstXcDVpFr38yNYqcin0jhtzBWQHSpZIw1orw7dyNWMGI39TWmgaAhJ-EALw_wcB.
Derisma, “Faktor-Faktor yang Mempengaruhi Sistem Pengenalan Wajah Menggunakan Metode Eigenface pada Perangkat Mobile Berbasis Android,” J. Komput. Terap., vol. 2, no. 2, pp. 127–136, 2016, [Online]. Available: http://jurnal.pcr.ac.id.
Y. Primatama, A. E. Rhamadani, F. D. Ramtomo, D. Cahya, and P. Buani, “Menggunakan Pemindai Wajah Berbasis Android,” pp. 59–65, 2018.
M. Egmont-Petersen, D. de Ridder, and H. Handels, “Image processing with neural networks - a review,” Pattern Recognit., vol. 35, pp. 2279–2301, 2002.
G. J. Awcock and R. Thomas, Applied image processing. Springer, 1995.
J. D. Kothari, “A Case Study of Image Classification Based on Deep Learning Using Tensorflow,” Papers.Ssrn.Com, no. April 2018, 2018.
F. Ertam, “Data classification with deep learning using tensorflow,” in 2nd International Conference on Computer Science and Engineering, UBMK 2017, 2017. doi: 10.1109/UBMK.2017.8093521.
Basjaruddin, Noor Cholis, et al. "Attendance System with Face Recognition, Body Temperature, and Use of Mask using Multi-Task Cascaded Convolutional Neural Network (MTCNN) Method." Green Intelligent Systems and Applications 2.2 (2022): 71-83.
Zhang, K.; Zhang, Z.; Li, Z.; Qiao, Y. (2016). Joint Face Detection and Alignment using Multitask Cascaded Convolutional Networks. IEEE Signal Processing Letters, 23 (10), 1499-1503, https://doi.org/10.1109/LSP.2016.2603342.
Ilfan Sugianda and Thamrin, “Perancangan Sistem Deteksi Objek Pada Robot Kr Sbi Berbasis Mini Pc Raspberry Pi 3,” Jurnal Teknologi Informasi dan Pendidikan , 2019.
Thamrin, Delsina Faiza, and Ilmiyati Rahmy Jasril, “Rancang Bangun Alat Pengaduk Bubur Otomatis Menggunakan Sensor Suhu Berbasis Arduino Uno” Jurnal Teknologi Informasi & Pendidikan, vol. 10, 2017.
R. Devita, R. Hartika Zain, and T. Syafriani, “Pengontrolan Pola Dancing Fountain Berirama Music Menggunakan Android Berbasis Mikrokontroler Arduino” Jurnal Teknologi Informasi dan Pendidikan, vol. 13, no. 1, 2020, doi: 10.24036/tip.v13i1.
Copyright (c) 2023 Jurnal Teknologi Informasi dan Pendidikan
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
.png)
