Some smartphone apps not accurate enough to spot all skin cancers

▴ Some smartphone apps not accurate enough to spot all skin cancers
a research team led by Professor Jon Deeks at the University of Birmingham and Professor Hywel Williams at the University of Nottingham, set out to examine the validity and findings of studies looking at the accuracy of algorithm based smartphone ‘skin’ apps.

The researchers warn that the current regulatory process for these apps “does not provide adequate protection to the public.”

The World Health Organization estimates between 2 and 3 million non-melanoma skin cancers and 132,000 melanoma skin cancers occur globally each year, but survival is high if melanoma is spotted early, which makes prompt detection and treatment crucial.

Artificially intelligent (AI) smartphone apps offer the potential for earlier detection and treatment of suspicious moles. But they could be harmful, particularly if false reassurance leads to delays in people seeking medical advice.In Europe, two apps (SkinVision and TeleSkin skinScan) are currently available and are regulated as class 1 medical devices (deemed to have a low to moderate risk to the user). No apps currently have US Food and Drug Administration (FDA) approval.

A previous expert review of such apps suggested there is a high chance of skin cancers being missed.

So a research team led by Professor Jon Deeks at the University of Birmingham and Professor Hywel Williams at the University of Nottingham, set out to examine the validity and findings of studies looking at the accuracy of algorithm based smartphone ‘skin’ apps.

Nine relevant studies that evaluated six different apps were identified. Studies were small and overall of poor quality.

Problems in the studies included the suspicious moles were chosen by clinicians not the app users, the photographs were taken by trained researchers on study phones, not by users on their own phones, and photographs that could not be evaluated by the apps were excluded. Also study participants were not followed up to identify cancers which were missed by the apps.

No published studies were found that evaluated the TeleSkin skinScan app.

SkinVision was evaluated in three studies. One study of 108 moles (35 cancerous or precancerous moles) achieved a sensitivity of 88% and a specificity of 79%. This means that 12% of patients with cancerous or precancerous moles would be missed, while 21% of those non-problematic moles would be wrongly identified as potentially being cancerous.

To put this into context, the authors explain that in a population of 1000 users in which 3% have a melanoma, SkinVision could still miss four of 30 melanomas and 200 people would wrongly be told their mole was of high concern. But they point out that the limitations of the studies suggest that more errors are likely to be made.

They point out that both SkinVision and SkinScan are currently being marketed with claims that they can “detect skin cancer at an early stage” or “track moles over time with the aim of catching melanoma at an earlier stage of the disease.”

“Our review found poor and variable performance of algorithm based smartphone apps, which indicates that these apps have not yet shown sufficient promise to recommend their use,” write the authors.

They warn that the current regulatory processes “are inadequate for protecting the public against the risks created by using smartphone diagnostic or risk stratification apps.”

And they say healthcare professionals “need to be aware of the limitations of algorithm based apps to reliably identify melanomas, and should inform potential smartphone app users about these limitations.”

It is positive to see healthcare systems embracing data analytics and machine learning. However, little evidence indicates that current AI apps can beat the clinician when assessing skin lesion risk - at least not in a verifiable or reproducible form, argue researchers at the University of Oxford, in a linked editorial.

They say the implications for patients, regulators, and clinicians are substantial, and call for several measures to improve transparency (driving up overall quality), and enable better reproducibility and audit by the wider research community.

Without such measures, patients, clinicians, and other stakeholders cannot be assured of apps’ safety and efficacy, they conclude.


Tags : #Bmj #Skincancerapp #Not #Accurate

About the Author

Snehangshu Dasgupta,

Managing Editor
[email protected]

Related Stories

Loading Please wait...


Trending Now

Freedom Healthy Cooking Oils distributes Seed Ganesha Idols for an eco-friendly festival September 28, 2023
Sadar Hospital,Ranchi Extends Free Cancer Care through Ayushman Bharat Scheme: A ray of hopeSeptember 28, 2023
Dopamine and Its Impact on Your Brain, Feelings, and EmotionsSeptember 28, 2023
Ayushman Bharat-PMJAY: Transforming Healthcare for Millions in IndiaSeptember 28, 2023
Premature Greying of Hair: preventing in the Indian styleSeptember 28, 2023
Run organised to create awareness for Cerebral PalsySeptember 27, 2023
16 Visually challenged explored Skill Development and Employment opportunities in interactive session at FTCCI September 26, 2023
FUJIFILM India celebrates 125 Digital Mammography Machine Installation milestone at the 3rd edition of 'Together Against Breast Cancer' ConferenceSeptember 26, 2023
AI4Rx, the AI powered medical care platform, announces the launch of MedBeat HealthConnectSeptember 26, 2023
Foetal medicine taking rapid strides to optimise Foetal outcomes!September 26, 2023
NGOs bring access to primary health services between 0-3kms for residents of Slums under Jalpally Municipality in line with the UN SDP and Universal Health Coverage modelSeptember 26, 2023
Oliva Skin & Hair Clinic, launches its 25th Clinic in India and 7th in the city, at Dilsukhnagar!September 26, 2023
Badminton sensation Shashidhar brings honor to Telangana and India by clinching the Silver medal at the BWF World Senior Championship in Korea!September 26, 2023
5 Best Homemade Juices to Drink Every Day for a Healthier YouSeptember 26, 2023
Traditionally, men were seen as more profit-oriented in business, but now women are proving they are equally capable - Rahul Jain, a top Indian business coach.September 25, 2023
4-Year-Old Girl Gets New lease of life at American Oncology Institute (AOI) Hyderabad with Haploidentical Stem Cell Transplantation September 25, 2023
Silver Oaks International Schools to provide succor to the underprivileged through its ‘Silver Oaks Street Store’ initiative!September 25, 2023
Sri Pullela Gopichand addressing freshers at OMC, emphasised on focussing on goals to achieve success! September 25, 2023
Fall Prevention Experience Centre for the Elderly Inaugurated at LVPEISeptember 25, 2023
Your Retina, Your Responsibility: 5 Tips For Maintaining Eye HealthSeptember 25, 2023