Skip to main content
Move the World.
health app heart disease

Lead Image by Andrew Brumagen

Sending a selfie to your doctor might sound weird — but someday it could save your life.

That's what researchers at the National Center for Cardiovascular Diseases (NCCD) in Beijing hope will happen thanks to a new deep learning algorithm they've created, which claims to detect signs of heart disease in the human face. Someday, it could be utilized in a health app to help people screen themselves for heart disease.

"To our knowledge, this is the first work demonstrating that artificial intelligence can be used to analyze faces to detect heart disease," Zhe Zheng, vice director of the Chinese NCCD, said in a statement. Zheng said their ultimate goal is to create a health app that would allow people to self-report signs of heart disease.

The study, published in the European Heart Journal, demonstrates how a deep learning computer algorithm can analyze four selfies of a patient, taken at different angles, to predict heart disease. The method needs more research to determine if it can become accurate enough across a group of people with diverse ethnic backgrounds to become a bona fide health app.

"To our knowledge, this is the first work demonstrating that artificial intelligence can be used to analyze faces to detect heart disease."

Zhe Zheng

Using an individual's digital footprint, including photos, videos, text messages, and app usage, to assess health conditions is a growing interest in healthcare — especially with ubiquitous smartphone ownership.

The emerging field of digital phenotyping uses smartphone data to detect mental health disorders through a health app. Researchers have also used photographs of moles — transformed by a computer program into a sonification — to diagnose skin cancer with 90% accuracy.

And last year, scientists used artificial intelligence for a behavioral study on autism. With the goal of reducing the need for lab equipment to evaluate autism cases, they trained the AI to analyze the body movements of autistic children in YouTube videos. A cell phone, after all, is more accessible than expensive lab equipment.

The new algorithm for detecting heart disease scans the face for telltale characteristics, like thinning hair, wrinkles, earlobes creases, yellow deposits near the eyes, and arcus senilis — white rings on the edges of the cornea.

But many of those signs are benign and common in older adults. So, last summer, the researchers tested their algorithm on 1,013 patients from nine Chinese hospitals. The algorithm found 80% of heart disease cases. This outperforms existing models that screen for heart disease, like the Diamond-Forrester model and the CAD consortium clinical score. The algorithm also correctly identified the absence of heart disease in 61% of cases.

"Our ultimate goal is to develop a self-reported application for high-risk communities to assess heart disease risk in advance of visiting a clinic. This could be a cheap, simple and effective (way) of identifying patients who need further investigation," Zheng said.

This makes me wonder — if a health app like this gets out there, could anyone use this algorithm to trespass on my private health information by simply scanning my Instagram account? Such privacy questions will become more urgent as the algorithms become better, faster, and more accessible.

We'd love to hear from you! If you have a comment about this article or if you have a tip for a future Freethink story, please email us at [email protected].

Up Next

Future of Medicine
Reading Your Digital Signature to Detect Depression, Parkinson’s
Digital phenotyping mental health disorders
Future of Medicine
Reading Your Digital Signature to Detect Depression, Parkinson’s
Digital phenotyping uses our smartphones to detect anything from Parkinson's disease to mental health disorders.

Digital phenotyping uses our smartphones to detect anything from Parkinson's disease to mental health disorders.

Public Health
New App Uses Location Data to Track the Coronavirus
track the coronavirus
Public Health
New App Uses Location Data to Track the Coronavirus
Researchers from MIT and Harvard have created a smartphone app to track the coronavirus, and it puts a premium on user privacy.

Researchers from MIT and Harvard have created a smartphone app to track the coronavirus, and it puts a premium on user privacy.

Healthcare
Green Space at Daycare Gives City Kids an Immune Boost
green space
Healthcare
Green Space at Daycare Gives City Kids an Immune Boost
Adding a green space to an urban daycare’s playground can boost a child immune system after just 28 days.

Adding a green space to an urban daycare’s playground can boost a child immune system after just 28 days.

Artificial Intelligence
Smart Farm Equipment Can Spot Weeds Among Crops
smart farm equipment
Artificial Intelligence
Smart Farm Equipment Can Spot Weeds Among Crops
Facebook’s facial recognition AI will turn ordinary farm equipment into precision agriculture machines by training it to spot the weeds among the crops.

Facebook’s facial recognition AI will turn ordinary farm equipment into precision agriculture machines by training it to spot the weeds among the crops.

CRISPR
Gene-Edited Squid: A Breakthrough in Brain Health Research
gene edited squid
CRISPR
Gene-Edited Squid: A Breakthrough in Brain Health Research
Researchers use CRISPR to create a gene-edited squid. This work could help advance research on neurodegenerative diseases like Huntington's or Alzheimer's.

Researchers use CRISPR to create a gene-edited squid. This work could help advance research on neurodegenerative diseases like Huntington's or Alzheimer's.

Dope Science
Medical Cannabis Explained
medical cannabis
Dope Science
Medical Cannabis Explained
Medical cannabis is everywhere. We're answering your basic questions and unpacking the promises and pitfalls, based on the latest research.

Medical cannabis is everywhere. We're answering your basic questions and unpacking the promises and pitfalls, based on the latest research.

Reverse Innovation
MacGyver Medicine Can Save Lives
MacGyver Medicine Can Save Lives
Reverse Innovation
MacGyver Medicine Can Save Lives
The package is simple and dirt-cheap—a plastic bag with a condom, a syringe, a rubber tube, and a card with...

The package is simple and dirt-cheap—a plastic bag with a condom, a syringe, a rubber tube, and a card with instructions—but it can mean the difference between a mother living and dying.

Dispatches
A New Kind of Headset “Hears” Words You Don’t Say
A New Kind of Headset “Hears” Words You Don’t Say
Dispatches
A New Kind of Headset “Hears” Words You Don’t Say
The project, named AlterEgo, intentionally crosses the line between what's "out there" and what's in your head.

The project, named AlterEgo, intentionally crosses the line between what's "out there" and what's in your head.

This is Our Superhuman Future
This is Our Superhuman Future
This is Our Superhuman Future
With Thanksgiving winding down, take some time to join us on a journey to the frontier of medical technology.
By Mike Riggs

With Thanksgiving winding down, take some time to join us on a journey to the frontier of medical technology.