RUS  ENG
Full version
JOURNALS // Computing, Telecommunication and Control // Archive

Computing, Telecommunication and Control, 2024 Volume 17, Issue 3, Pages 84–92 (Mi ntitu371)

Applied problem solving with machine learning

Non-invasive heart rate measurement system based on video stream analysis

M. S. Antonenkoa, D. O. Budanova, A. Yu. Zaitcevab

a Peter the Great St. Petersburg Polytechnic University
b Institute for Analytical Instrumentation, Russian Academy of Sciences, St. Petersburg

Abstract: The paper is devoted to the development and testing of a remote biomonitoring system based on the phenomenon of plethysmography. This phenomenon allows not only to measure a person's pulse rate non-invasively, but also to assess physiological state of the person. At the first stage of the system operation, it is necessary to detect regions of interest. This operation can be effectively implemented using neural networks. The task of face recognition was performed by the YOLOv7-tiny architecture, due to its speed and the ability to run on embedded systems. For the detected face, a rectangle was created, whose coordinates indicated the boundaries of the face. Next, the average brightness of the selected areas is calculated and stored in the dataset. By performing fast Fourier transform (FFT) for a given set, it is possible to obtain a signal spectrum. Using methods of digital signal processing, it is possible to filter the signal and select the part of the spectrum of interest in the region of 0.7–3 Hz. The maximum amplitude of the harmonic will correspond to the current pulse.

Keywords: remote biomonitoring, telehealth, heart rate, photoplethysmography, Fourier transform, neural network.

UDC: 004.89

Received: 16.06.2024

Language: English

DOI: 10.18721/JCSTCS.17308



© Steklov Math. Inst. of RAS, 2024