£199.99 £139.99 for one year of Unlimited learning. Offer ends on 14 November 2022 at 23:59 (UTC). T&Cs apply

Find out more
Prevention of over-reliance
Skip main navigation

Prevention of over-reliance

Healthcare professionals and industry representatives talking about the way in which over-reliance can be prevented.
Do you think AI could lead to over-reliance of healthcare professionals? How would you prevent this?
KIM BEUSCHAU MOURIDSEN: I think, for some, I would be concerned with that, especially for younger physicians or physicians in training. They could essentially overly rely on artificial intelligence. So I think companies should provide clear guidance on how their AI solutions should be used and how they should be used in comparison with human expertise.
HANNEKE VAN DER WAL-HUISMAN: I think it can. But I think it’s very important that, as a healthcare professional, you stay critical and use it as an instrument to help, to be helpful, but not as a leading instrument.
ANGEL ALBERRICH-BAYYARI: Yes, we are seeing these already, as well we see that younger generations especially or residents in hospitals that already interact or are starting to interact with AI models like automated chest X-ray screening. We have to train them a lot to avoid over-reliance on AI. And we have to explain that AI can fail. It has certain accuracy metrics, which are not 100%. And that makes these, let’s say, newbies to the specialty of radiology have to get used to review cases, review images, and to have their own judgement about them.
ANNAMARIA ANNICCHIARICO: This could be, but not more than for other things that they normally use. So what I think is that they must be taught exactly which kind of use they can do of these technologies and how they have to manage these aspects with all its limits and understanding exactly what this methodology can give them. That’s all. That’s enough.
STÉPHANIE LOPEZ: AI is created by humans learning from data collected and annotated by humans. AI is not magic. It may be able to learn some specific rules that humans cannot infer because of limited capacity, like, for example, high resolution. These factors must be taken into account to avoid over-reliance on AI. If medical doctors are aware that AI is not perfect, then they will not over-rely on those products.

In the previous article, you learned about deskilling and over-reliance. We asked healthcare professionals and industry representatives whether they think these two phenomena might occur and how they could be prevented. This second video shows the responses to the issue of over-reliance.

Most experts seem to agree that over-reliance might be a serious consequence of implementing AI in healthcare (or is even already happening). They provide some possible prevention techniques as well.

Do you agree with the experts on the consequences of over-reliance? Can you think of other techniques to prevent this phenomenon? Share your thoughts in the discussion section.

This article is from the free online

How Artificial Intelligence Can Support Healthcare

Created by
FutureLearn - Learning For Life

Our purpose is to transform access to education.

We offer a diverse selection of courses from leading universities and cultural institutions from around the world. These are delivered one step at a time, and are accessible on mobile, tablet and desktop, so you can fit learning around your life.

We believe learning should be an enjoyable, social experience, so our courses offer the opportunity to discuss what you’re learning with others as you go, helping you make fresh discoveries and form new ideas.
You can unlock new opportunities with unlimited access to hundreds of online short courses for a year by subscribing to our Unlimited package. Build your knowledge with top universities and organisations.

Learn more about how FutureLearn is transforming access to education