In face-off, human doctors more accurate than symptom checker apps

A pediatrician and his patient

Human doctors made a correct diagnosis more than twice as often as 23 commonly used symptom-checker apps in a head-to-head comparison.

The research, published in JAMA Internal Medicine, builds on a previous evaluation of symptom-checker apps and websites that found many had deficits in both diagnosis and triage accuracy.

The researchers asked 234 physicians to make diagnoses for 45 “clinical vignettes” that included patient medical history, but no results from a physical exam, blood test or other kind of lab work. They were asked to name the most likely diagnosis, along with two other possibilities.

Free Daily Newsletter

Like this story? Subscribe to FierceHealthcare!

The healthcare sector remains in flux as policy, regulation, technology and trends shape the market. FierceHealthcare subscribers rely on our suite of newsletters as their must-read source for the latest news, analysis and data impacting their world. Sign up today to get healthcare news and updates delivered to your inbox and read on the go.

The physicians were in internal medicine, family practice or pediatrics. About half were in residency or fellowship, which meant they had not completed their training, a Los Angeles Times article points out.

Still, they named the correct diagnosis first 72 percent of the time, while the online tools listed the correct diagnosis first just 34 percent of the time. Doctors made the correct call among their top three picks 84 percent of the time, while the symptom checkers did so just 51 percent of the time.

For common conditions, doctors’ accuracy was 70 percent, compared to 38 percent for apps. The difference grew to 76 percent vs. 28 percent for uncommon conditions. Accuracy registered at 65 percent to 41 percent for cases with low acuity and 79 percent to 24 percent for cases with high acuity.

However, physicians still made errors in about 15 percent of cases.

"Clinical diagnosis is currently as much art as it is science, but there is great promise for technology to help augment clinical diagnoses," co-author Ateev Mehrotra, an associate professor of healthcare policy at Harvard Medical School, said in an announcement of the findings.

Suggested Articles

The Trump administration has announced it would reject Utah's plan to cap expanded Medicaid enrollment while still earning full federal funds.

Canadian officials got an earful from the healthcare industry over the U.S. proposal to import drugs from the country.

A new study takes a look at how the U.S. stacks up to other developed countries on healthcare and social spending.