While much has been made about the potential for diagnostic software to make accurate clinical diagnoses, in a head-to-head comparison with human doctors, researchers found that physicians made a correct diagnosis more than twice as often.
According to a research letter published in JAMA Internal Medicine, a research team, from Harvard Medical School, Brigham and Women’s Hospital and The Human Diagnosis Project, conducted a head-to-head comparison of physicians with symptom-checker apps and websites that help patients with self-diagnosis. The research builds on a previous evaluation of the diagnostic accuracy of 23 symptom checkers. For this study, the research team compared the diagnostic performance of physicians with symptom checkers for those same 45 vignettes using the digital platform Human Dx.
The research letter cites The Institute of Medicine recently highlighting that physician diagnostic error is common and information technology may be part of the solution. “Given the advancements in computer science, computers may be able to independently make accurate clinical diagnoses. While studies have compared computer versus physician performance for reading electrocardiograms, the diagnostic accuracy of computers versus physicians remains unknown. To fill this gap in knowledge, we compared the diagnostic accuracy of physicians with computer algorithms called symptom checkers,” the research authors wrote.
In the study, 234 internal medicine physicians were asked to evaluate 45 clinical cases, involving both common and uncommon conditions with varying degrees of severity. For each scenario, physicians had to identify the most likely diagnosis along with two additional possible diagnoses. Each clinical vignette was solved by at least 20 physicians. Of the 234 physicians who solved at least one vignette, 90 percent were trained in internal medicine and 52 percent were fellows or residents.
Given that physicians provided free text responses, two physicians hand-reviewed the submitted diagnoses and independently decided whether the participant listed the correct diagnosis first or in the top three diagnoses.
The researchers reported that physicians listed the correct diagnosis first 72 percent of the time, while the online tools listed the correct diagnosis just 34 percent of the time. Physicians outperformed the symptom-checker apps and websites by a margin of more than 2 to 1.
Read more here: www.healthcare-informatics.com/news-item/mobile/research-physicians-more-accurately-diagnose-patients-compared-computer-algorithms