Analysis of Heart Rate Changes in Response to Sensory Stimulus Intensity Variations Using a Convolutional Neural Network-Based Remote Photoplethysmography Method

Authors

  • Ekawati Prihatini Politeknik Negeri Surabaya
  • Selamat Muslimin Politeknik Negeri Surabaya
  • Handy Prian Politeknik Negeri Surabaya

DOI:

https://doi.org/10.24036/jtip.v20i1.1155

Keywords:

Autism Spectrum Disorder, Heart rate, Sensory stimulus, Remote Photoplethysmography, Convolutional Neural Network

Abstract

The neurodevelopmental disease known as autism spectrum disorder (ASD) is frequently linked to deficiencies in sensory processing, which cause different physiological reactions to different environmental stimuli. Heart rate is one physiological sign that can be used to assess these reactions. This study uses a non-contact, camera-based approach to examine changes in heart rate in response to changes in sensory stimulus intensity in people with autism. The suggested system combines the Remote Photoplethysmography (rPPG) technique, which extracts physiological information from variations in facial skin color intensity, with a Convolutional Neural Network (CNN) to identify the facial region and establish the Region of Interest (ROI). Without physical contact with the individual, the system can use an RGB webcam to estimate heart rate in real time, in beats per minute (BPM). According to experimental findings, people with ASD showed discernible changes in heart rate in response to changes in sensory stimulus intensity. These results suggest that the proposed approach could support sensory evaluation for people with autism by offering a more pleasant and objective alternative to non-contact physiological-response monitoring.

References

I. Supriyanto, “Autism Spectrum Disorder.” Accessed: Jun. 11, 2026. [Online]. Available: https://general.alomedika.com/penyakit/kesehatan-anak/autism-spectrum-disorder

L. J. Steardo, R. De Filippis, E. A. Carbone, C. Segura-Garcia, A. Verkhratsky, and P. De Fazio, “Sleep disturbance in bipolar disorder: Neuroglia and circadian rhythms,” Jan. 01, 2019, Frontiers Media S.A. doi: 10.3389/fpsyt.2019.00501.

Who.int, “Pernyataan WHO tentang Isu-isu terkait Autisme.” Accessed: Jun. 11, 2026. [Online]. Available: https://www.who.int/indonesia/id/news/detail/30-09-2025-who-statement-on-autism-related-issues

who.int, “Autism.” Accessed: Jun. 26, 2026. [Online]. Available: https://www.who.int/news-room/fact-sheets/detail/autism-spectrum-disorders

K. Ko, A. Jones, D. Francis, S. Robidoux, and G. McArthur, “Physiological correlates of anxiety in childhood and adolescence: A systematic review and meta-analysis,” Aug. 01, 2024, John Wiley and Sons Ltd. doi: 10.1002/smi.3388.

F. Shaffer and J. P. Ginsberg, “An Overview of Heart Rate Variability Metrics and Norms,” Sep. 28, 2017, Frontiers Media S.A. doi: 10.3389/fpubh.2017.00258.

J. Hofman, M. Hutny, K. Sztuba, and J. Paprocka, “Corpus callosum agenesis: An insight into the etiology and spectrum of symptoms,” Sep. 01, 2020, MDPI AG. doi: 10.3390/brainsci10090625.

E. Prihatini, S. Muslimin, and N. Al Thoriq, “Multi-task Cascaded Convolutional Neural Network Face Recognition in Robot SAR (Socially Assistive Robot),” Jurnal Teknologi Informasi dan Pendidikan, vol. 17, no. 1, pp. 17–28, Dec. 2023, doi: 10.24036/jtip.v17i1.734.

R. J. Lee, S. Sivakumar, and K. H. Lim, “Review on remote heart rate measurements using photoplethysmography,” Multimed. Tools Appl., vol. 83, no. 15, pp. 44699–44728, May 2024, doi: 10.1007/s11042-023-16794-9.

Hanguang. L. Tianqi. et al Xiao, “Remote photoplethysmography for heart rate measurement: A review,” vol. 88, Feb. 2024, Accessed: Jun. 26, 2026. [Online]. Available: https://www.sciencedirect.com/science/article/abs/pii/S1746809423010418

A. Chaturvedi et al., “Integrating parent report, observed behavior, and physiological measures to identify biomarkers of sensory over-responsivity in autism,” J. Neurodev. Disord., vol. 17, no. 1, Dec. 2025, doi: 10.1186/s11689-025-09597-6.

A. Brown, J. Tulkens, M. Mattelin, T. Sanglet, and B. Dhuyvetters, “Remote photoplethysmography for health assessment: a review informed by IntelliProve technology,” Front. Digit. Health, vol. 7, Jan. 2026, doi: 10.3389/fdgth.2025.1667423.

Zongheng. C. Huahua. et al Guo, “Remote heart rate estimation via convolutional neural networks with transformers,” vol. 360, no. 17, Nov. 2023, Accessed: Jun. 26, 2026. [Online]. Available: https://www.sciencedirect.com/science/article/abs/pii/S0016003223006592

Bin. Z. Panpan. et al Li, “Non-contact PPG signal and heart rate estimation with multi-hierarchical convolutional network,” vol. 139, Jul. 2023, Accessed: Jun. 26, 2026. [Online]. Available: https://www.sciencedirect.com/science/article/abs/pii/S003132032300122X

D. Di Lernia, G. Finotti, M. Tsakiris, G. Riva, and M. Naber, “Remote photoplethysmography (rPPG) in the wild: Remote heart rate imaging via online webcams,” Behav. Res. Methods, vol. 56, no. 7, pp. 6904–6914, Oct. 2024, doi: 10.3758/s13428-024-02398-0.

R. J. Lee, S. Sivakumar, and K. H. Lim, “Review on remote heart rate measurements using photoplethysmography,” Multimed. Tools Appl., vol. 83, no. 15, pp. 44699–44728, May 2024, doi: 10.1007/s11042-023-16794-9.

L. Saikevičius, V. Raudonis, A. Kozlovskaja-Gumbrienė, and G. Šakalytė, “Advancements in Remote Photoplethysmography,” Electronics (Switzerland), vol. 14, no. 5, Mar. 2025, doi: 10.3390/electronics14051015.

J. Comas, A. Ruiz, and F. Sukno, “Deep adaptative spectral zoom for improved remote heart rate estimation,” Mar. 2024, [Online]. Available: http://arxiv.org/abs/2403.06902

Downloads

Published

2026-09-25

How to Cite

[1]
E. Prihatini, S. Muslimin, and H. Prian, “Analysis of Heart Rate Changes in Response to Sensory Stimulus Intensity Variations Using a Convolutional Neural Network-Based Remote Photoplethysmography Method”, J. teknol. inf. pendidik., vol. 20, no. 1, pp. 1793–1808, Sep. 2026.