Analysis of Heart Rate Changes in Response to Sensory Stimulus Intensity Variations Using a Convolutional Neural Network-Based Remote Photoplethysmography Method
DOI:
https://doi.org/10.24036/jtip.v20i1.1155Keywords:
Autism Spectrum Disorder, Heart rate, Sensory stimulus, Remote Photoplethysmography, Convolutional Neural NetworkAbstract
The neurodevelopmental disease known as autism spectrum disorder (ASD) is frequently linked to deficiencies in sensory processing, which cause different physiological reactions to different environmental stimuli. Heart rate is one physiological sign that can be used to assess these reactions. This study uses a non-contact, camera-based approach to examine changes in heart rate in response to changes in sensory stimulus intensity in people with autism. The suggested system combines the Remote Photoplethysmography (rPPG) technique, which extracts physiological information from variations in facial skin color intensity, with a Convolutional Neural Network (CNN) to identify the facial region and establish the Region of Interest (ROI). Without physical contact with the individual, the system can use an RGB webcam to estimate heart rate in real time, in beats per minute (BPM). According to experimental findings, people with ASD showed discernible changes in heart rate in response to changes in sensory stimulus intensity. These results suggest that the proposed approach could support sensory evaluation for people with autism by offering a more pleasant and objective alternative to non-contact physiological-response monitoring.
References
I. Supriyanto, “Autism Spectrum Disorder.” Accessed: Jun. 11, 2026. [Online]. Available: https://general.alomedika.com/penyakit/kesehatan-anak/autism-spectrum-disorder
L. J. Steardo, R. De Filippis, E. A. Carbone, C. Segura-Garcia, A. Verkhratsky, and P. De Fazio, “Sleep disturbance in bipolar disorder: Neuroglia and circadian rhythms,” Jan. 01, 2019, Frontiers Media S.A. doi: 10.3389/fpsyt.2019.00501.
Who.int, “Pernyataan WHO tentang Isu-isu terkait Autisme.” Accessed: Jun. 11, 2026. [Online]. Available: https://www.who.int/indonesia/id/news/detail/30-09-2025-who-statement-on-autism-related-issues
who.int, “Autism.” Accessed: Jun. 26, 2026. [Online]. Available: https://www.who.int/news-room/fact-sheets/detail/autism-spectrum-disorders
K. Ko, A. Jones, D. Francis, S. Robidoux, and G. McArthur, “Physiological correlates of anxiety in childhood and adolescence: A systematic review and meta-analysis,” Aug. 01, 2024, John Wiley and Sons Ltd. doi: 10.1002/smi.3388.
F. Shaffer and J. P. Ginsberg, “An Overview of Heart Rate Variability Metrics and Norms,” Sep. 28, 2017, Frontiers Media S.A. doi: 10.3389/fpubh.2017.00258.
J. Hofman, M. Hutny, K. Sztuba, and J. Paprocka, “Corpus callosum agenesis: An insight into the etiology and spectrum of symptoms,” Sep. 01, 2020, MDPI AG. doi: 10.3390/brainsci10090625.
E. Prihatini, S. Muslimin, and N. Al Thoriq, “Multi-task Cascaded Convolutional Neural Network Face Recognition in Robot SAR (Socially Assistive Robot),” Jurnal Teknologi Informasi dan Pendidikan, vol. 17, no. 1, pp. 17–28, Dec. 2023, doi: 10.24036/jtip.v17i1.734.
R. J. Lee, S. Sivakumar, and K. H. Lim, “Review on remote heart rate measurements using photoplethysmography,” Multimed. Tools Appl., vol. 83, no. 15, pp. 44699–44728, May 2024, doi: 10.1007/s11042-023-16794-9.
Hanguang. L. Tianqi. et al Xiao, “Remote photoplethysmography for heart rate measurement: A review,” vol. 88, Feb. 2024, Accessed: Jun. 26, 2026. [Online]. Available: https://www.sciencedirect.com/science/article/abs/pii/S1746809423010418
A. Chaturvedi et al., “Integrating parent report, observed behavior, and physiological measures to identify biomarkers of sensory over-responsivity in autism,” J. Neurodev. Disord., vol. 17, no. 1, Dec. 2025, doi: 10.1186/s11689-025-09597-6.
A. Brown, J. Tulkens, M. Mattelin, T. Sanglet, and B. Dhuyvetters, “Remote photoplethysmography for health assessment: a review informed by IntelliProve technology,” Front. Digit. Health, vol. 7, Jan. 2026, doi: 10.3389/fdgth.2025.1667423.
Zongheng. C. Huahua. et al Guo, “Remote heart rate estimation via convolutional neural networks with transformers,” vol. 360, no. 17, Nov. 2023, Accessed: Jun. 26, 2026. [Online]. Available: https://www.sciencedirect.com/science/article/abs/pii/S0016003223006592
Bin. Z. Panpan. et al Li, “Non-contact PPG signal and heart rate estimation with multi-hierarchical convolutional network,” vol. 139, Jul. 2023, Accessed: Jun. 26, 2026. [Online]. Available: https://www.sciencedirect.com/science/article/abs/pii/S003132032300122X
D. Di Lernia, G. Finotti, M. Tsakiris, G. Riva, and M. Naber, “Remote photoplethysmography (rPPG) in the wild: Remote heart rate imaging via online webcams,” Behav. Res. Methods, vol. 56, no. 7, pp. 6904–6914, Oct. 2024, doi: 10.3758/s13428-024-02398-0.
R. J. Lee, S. Sivakumar, and K. H. Lim, “Review on remote heart rate measurements using photoplethysmography,” Multimed. Tools Appl., vol. 83, no. 15, pp. 44699–44728, May 2024, doi: 10.1007/s11042-023-16794-9.
L. Saikevičius, V. Raudonis, A. Kozlovskaja-Gumbrienė, and G. Šakalytė, “Advancements in Remote Photoplethysmography,” Electronics (Switzerland), vol. 14, no. 5, Mar. 2025, doi: 10.3390/electronics14051015.
J. Comas, A. Ruiz, and F. Sukno, “Deep adaptative spectral zoom for improved remote heart rate estimation,” Mar. 2024, [Online]. Available: http://arxiv.org/abs/2403.06902
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Jurnal Teknologi Informasi dan Pendidikan

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.













.png)













