Insufficient evidence that AI breast cancer screening is accurate enough to replace human scrutiny

Better evidence needed before considering the future integration of AI into breast cancer screening programmes, say experts

Humans still seem to be better than technology when it comes to the accuracy of spotting possible cases of breast cancer during screening, suggests a review published online in The BMJ today.

The researchers say there is currently a lack of good quality evidence to support a policy of replacing human radiologists with artificial intelligence (AI) technology when screening for breast cancer.

Breast cancer is a leading cause of death among women worldwide and many countries have introduced mammography screening programmes to detect and treat it early. But examining mammograms for early signs of cancer is a high volume repetitive work for radiologists, and some cancers are missed.

Previous research has suggested that AI systems outperform humans and might soon be used instead of experienced radiologists. Yet a recent review of 23 studies highlighted evidence gaps and concerns about the methods used.

To address this uncertainty, the UK National Screening Committee commissioned a team of researchers from the University of Warwick to examine the accuracy of AI for the detection of breast cancer in mammography screening practice.

The researchers reviewed 12 studies carried out since 2010 involving data for 131,822 screened women in Sweden, the United States, Germany, the Netherlands and Spain.

Overall, the quality of the methods used in the 12 studies was poor and their applicability to European or UK breast cancer screening programmes was low.

Three large studies involving 79,910 women compared AI systems with the clinical decisions of the original radiologist. Of these, 1,878 had screen-detected cancer or interval cancer (cancer diagnosed in-between routine screening appointments) within 12 months of screening.

The majority (34 out of 36 or 94%) of AI systems evaluated in these three studies were less accurate than a single radiologist, and all were less accurate than the consensus of two or more radiologists, which is the standard practice in Europe.

In contrast, five smaller studies involving 1,086 women reported that all of the AI systems evaluated were more accurate than a single radiologist. But the researchers note that these studies were at high risk of bias and their promising results are not replicated in larger studies.

In three studies, AI used as a pre-screen to triage which mammograms need to be examined by a radiologist and which do not screened out 53%, 45%, and 50% of women at low risk but also 10%, 4%, and 0% of cancers detected by radiologists.

The authors point to some study limitations such as excluding non-English studies that might have contained relevant evidence, and they acknowledge that AI algorithms are short lived and constantly improving, so reported assessments of AI systems might be out of date by the time of study publication.

Nevertheless, use of stringent study inclusion criteria together with rigorous and systematic evaluation of study quality suggests their conclusions are robust.

As such, they say: “Current evidence on the use of AI systems in breast cancer screening is a long way from having the quality and quantity required for its implementation into clinical practice.”

They add: “Well designed comparative test accuracy studies, randomised controlled trials, and cohort studies in large screening populations are needed which evaluate commercially available AI systems in combination with radiologists in clinical practice.”

Tags : #BreastCancer #BreastCancerScreening #AI #TheBmj #Mammography

About the Author


Team Medicircle

Related Stories

Loading Please wait...
-Advertisements-


Trending Now

PM addresses the Nation today, announces free vaccinesJune 07, 2021
Why inhalers are best for treating asthma, well illustrated by Dr. Anil SingalMay 12, 2021
Dr. Rohan Palshetkar shares his invaluable insights about the Maternal Mortality Rate causes and improvements in India April 29, 2021
It is important to adopt a non-judgmental attitude towards any teenage girl seeking contraceptive advise suggests Dr. Teena Trivedi, Obstetrician and GynecologistApril 16, 2021
80% of the diseases are psychosomatic which means they have roots in the mind and this is where homeopathy steps in - It resolves physical ailments by finding the cause in the mind – Dr. Sanket Dhuri, Consultant Homeopath April 14, 2021
A futuristic Vision of a Healthcare Entrepreneur: Shyatto Raha, CEO, and Founder of MyHealthcareApril 12, 2021
Saher Mehdi, Founder and Chief Scientist at wellOwise talks about aspects making healthcare more equitable and reachableApril 10, 2021
Wide variety of therapies to address autism in children explained by Dr. Shilpa Jasubhai, Clinical PsychologistApril 09, 2021
Allopathic and Homeopathic medicines should not be taken together says Dr. Sunil Mehra, Homeopath ConsultantApril 08, 2021
The charm of homeopathic medicine is that it can be taken with conventional medicines – Dr. Shruthi Shridhar, Consulting Homeopath April 08, 2021
Dissociative Identity Disorder and associated concepts explained by Dr. Vinod Kumar, Psychiatrist and Head of Mpower - The Centre (Bangalore) April 07, 2021
Dissociative Identity Disorder explained by Dr. Shilpa Jasubhai, Clinical PsychologistApril 05, 2021
Sehat Ki Baat, Karishma Ke Saath- Episode 6 Healthy Diet For Boosting Metabolism Which Can Help Thyroid Patients April 03, 2021
Significant Pointers on Kidney Health by Dr. Santosh Waigankar, Consultant Urooncologist and Robotic Surgeon at Kokilaben Dhirubhai Ambani HospitalApril 01, 2021
Dr. Vaishal Kenia, Ophthalmologist Talks About the Different Possibilities Available for the Treatment of Glaucoma Depending Upon Their Type and SeverityMarch 30, 2021
No Definitive Role of Diet in Treatment of Lymphedema but Intake of Calories, Salt and Long Chain Fatty Acids should be controlled says Dr. Ramani CVMarch 30, 2021
Dr. Kiran Chandra Patro, Senior Nephrologist Talks About Dialysis as the Temporary Process and Not a Permanent Cure for the Patients of Renal DysfunctionMarch 30, 2021
Two out of three new chronic kidney disease patients are found to have diabetes or hypertension informs Dr. Sreeharsha HarinathaMarch 30, 2021
Glaucoma Treatment: Medications or Surgery? A valuable piece of advice from Dr. Pranay Kapdia, Chairman and Medical Director of Kapadia Eye CareMarch 25, 2021
Dr. Shraddha Satav, Consultant Ophthalmologist Recommends that Everybody After 40, Should Go for the Complete Eye Checkup at Regular IntervalMarch 25, 2021