Skip to main content

Coronavirus (COVID-19): Visitor Restrictions, Resources, and Updates

Explore URMC



Heart Rhythm 2020 Press Release: New Study Shows AI-Based Facial Recognition Can Enable Patient Mobile Devices To Detect AFIB

Thursday, May 7, 2020

A new study leverages AI-based technology to offer a contactless monitoring method for atrial fibrillation (AF) without the use of a dedicated device. The method reveals an accurate way to effortlessly identify irregular pulse rates (PR) using automatic selfie video novel videoplethysmography (VPG) software that can reside on most smartphones. Findings of the single, observational study were presented today as part of the Heart Rhythm Society 2020 Scientific Sessions.

These findings come at a critical time when patients and physicians are becoming more reliant on telemedicine, and the COVID-19 pandemic highlights a need for contactless monitoring innovations. AF is a growing public health concern as the heart rhythm disorder impacts more than 33.5 million individuals globally1 and is associated with high rates of reoccurrence. Further, approximately one-third of AF patients do not show symptoms.2 New technologies can enable the detection of irregular PR and arrhythmias in asymptomatic patients or patients who would benefit from long-term monitoring.

The primary advantage of VPG technology is to enable long-term intermittent monitoring of PR without the burden of using wearable devices that need to be in contact with the skin or that require other compliance from the patient. VPG technology is embedded into a simple app running on smart devices to acquire the PR of the user. VPG signal is captured by the video camera by detecting subtle changes in the facial skin color during each heartbeat. The smart device does not record the face of the user, thereby preserving the user’s privacy. The study evaluated the accuracy and quality of VPG signal captured in an uncontrolled environment.

“With the growing incidence of AF and no definite cure in sight, we sought to provide a reliable solution that would work with a simple download to a patient’s device,” said Dr. Jean-Philippe Couderc, Principal investigator of the NIH-funded study conducted at the Clinical Cardiovascular Research Center of the University of Rochester Medical Center (NY). “With ‘always-on’ technology that can work in the background as patients go about their daily lives, we hope this will help the way patients track their pulse rates and heart rhythm remotely. We see our findings as an exciting way to use AI and mobile devices to push the monitoring experience forward.”

In the study, 60 subjects (47 men, 13 women), aged 65±8 years, were enrolled after successful electrical cardioversion or successful AF ablation. Subjects were provided a smart tablet loaded with the VPG technology and an electrocardiogram (ECG) patch for 14 days, and were asked to use a tablet twice a day using an application extracting VPG signals. The average PR and heart rate (HR) vales were extracted from the synchronized VPG and ECG signals, respectively. Machine learning was trained to reject VPG recordings associated with an error ≥10 percent in reference to HR using a 30/70 percent split of the data (validation based on 30 percent). Findings recorded 880 video-based PR in sinus rhythm from June 2018 to May 2019. Subjects wore the ECG patch for 11 days on average (ranging from 1 to 15 days). The recorded HR varied between 40 and 122 bpm. Random Forest model was trained to reject measurements with an error <10% between VPG and ECG rates. Bland Altman applied to the validation set revealed a mean difference between PR and HR of 0.3±9.8 bpm while rejecting 33% of the VPG signals for low signal quality.

The authors place importance on complete findings as the current study is still taking place. As a next step, they plan to extend the use of this technology to determine its value in monitoring heart failure patients.

BIO-LIBRA study reaches 300 enrollments in 10 months

Thursday, March 12, 2020

The CCRC is excited to share that they have just reached 300 enrollments in the BIO-LIBRA study (30% of total enrollments) in 10 months. There are 45% women enrollments -exceeding the initial goal.


Congratulations to the BIO-LIBRA team at CCRC on their outstanding work and dedication to the study!


Please find below a recent article published on the background and goals of the BIO-LIBRA study.