Get the app
Paediatrics2018Impact: 1 out of 3, proof of concept

Children's X-rays and retina scans: an AI that shows what it sees

A study published in the journal Cell in 2018 showed that one artificial intelligence method can help spot retinal diseases on eye scans, with performance comparable to human experts, and then pneumonia in children on chest X-rays. The AI also highlights the parts of the image that led to its answer.

Cell, 2018Lire en français

Why do medical AI tools struggle to win trust?

To help doctors, a program must first be reliable. It must also be understandable: if no one knows why it gives an answer, it is hard to trust it. These two challenges slow the arrival of decision aids in medical imaging.

Another brake is the need for very large numbers of labelled images to train these programs. Gathering images properly labelled by doctors takes time and money.

Doctors also prefer to know what an AI relies on, much as one asks a colleague to explain their opinion.

What did the researchers do?

The team built a screening tool for retinal diseases that can cause blindness but can be treated. They used a technique called transfer learning: instead of starting from zero, the neural network reuses what it has already learned from other images. It therefore needs only a fraction of the data usually required.

They trained it on OCT images (optical coherence tomography), a scan that shows the layers of the retina in cross-section. They also made the program highlight the regions of the image it recognised, to make its diagnosis more transparent.

The starting idea is simple: a network already trained to recognise shapes in other images keeps what it has learned, and only has to pick up the particularities of medical tests. That is what saves data.

What did they find?

On eye scans, the program classified age-related macular degeneration and diabetic macular oedema with performance comparable to human experts. These are two common causes of sight loss that are easier to treat when found early.

The authors then showed that the same approach works on a very different problem: diagnosing pneumonia in children from chest X-rays. This suggests the method can adapt to several types of medical image.

The authors note that the tool could speed up diagnosis and referral, which would allow earlier treatment. But these words describe a hope, not a result measured in patients in the study.

Key figures

  • 2retinal diseases classified at a level comparable to experts (macular degeneration and diabetic macular oedema)
  • 1other use tested with the same method: pneumonia in children on chest X-rays

What could this change for patients?

In time, a tool like this could help speed up diagnosis and referral to a specialist for these treatable conditions. The earlier treatment starts, the better the outcome can be for the patient, according to the authors.

It is not a promise: the study describes a possible tool, not one already used with patients in hospitals.

What are the limits of this study?

This is a demonstration of the method on image collections. It does not prove that patients were better cared for thanks to the tool. The pneumonia result is presented as evidence that the method generalises, not as a device ready for practice.

The study does not replace trials in real departments with real patients, which would be needed before any routine use.

Making sense of a scan, with Mima

For now this is research: a tool that explains what it picks out on an eye scan or an X-ray is not yet in your hospital. The hope is to make referral to a specialist quicker.

When a scan is booked, Mima explains in plain words what to expect and gathers your questions. You could ask, for example: "Can you show me on the image what you are looking at?" She also notes the date of your appointments.

Frequently asked questions

Can AI spot pneumonia on a child's X-ray?

In this 2018 study, the method was applied to diagnosing pneumonia in children on chest X-rays, to show it can be used beyond the eye. It is not yet a tool validated for routine use.

What is an OCT eye scan?

It is a painless test that makes a cross-section image of the retina at the back of the eye, a bit like an ultrasound uses sound waves. It helps spot diseases that threaten eyesight.

What is transfer learning?

It is a technique where a program already trained on other images is adapted to a new task. It needs a fraction of the data that starting from zero would take.

Why does the AI highlight areas of the image?

So the doctor can see what it relied on. A more transparent diagnosis is easier to check and to discuss.

The original study

Kermany DS, Goldbaum M, Cai W, et al. “Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning.” Cell, February 2018. DOI : 10.1016/j.cell.2018.02.010

Read the full study in Cell

This article summarises a scientific study and is not medical advice.