Report: WHO’s Move for Regulation of AI in Healthcare Highlights Risks Posed by Usage of AI Tools

WHO has released six areas for regulation of AI for health, citing a need to manage the risks of AI amplifying biases in training data. (Credit: Toowongsa/AdobeStock)

The World Health Organization (WHO) has outlined several considerations for the regulation of artificial intelligence (AI) in healthcare. WHO recently released a new publication, in which it listed key regulatory considerations that touch on the importance of establishing safety and effectiveness in AI tools, making systems available to those who need them, and fostering dialogue among those who develop and use AI tools. The move highlights the potential challenges associated with using AI tools in healthcare, says GlobalData , a data and analytics company.

WHO recognizes the potential of AI in healthcare, as it could improve existing devices or systems through strengthening clinical trials, improving diagnoses and treatment, and aiding the knowledge and skills of healthcare professionals.

“AI has already improved several devices and systems, and there are so many benefits of AI,” says Alexandra Murdoch, senior analyst at GlobalData. “However, there are risks too with these tools and the rapid adoption of them.”

AI technologies are and have been deployed quite quickly, and not always with a full understanding of how they will work in the long run, which could be harmful to healthcare professionals or patients. AI systems in medical or healthcare often have access to personal and medical information, so there should be regulatory frameworks in place to ensure privacy and security. There are several other potential challenges with AI in healthcare, such as unethical data collection, cybersecurity risks, and amplifying biases and misinformation.

A recent example of biases in AI tools comes from a study conducted by Stanford University. The study results revealed that some AI chatbots provided responses that perpetuated false medical information about Black people. The study ran nine questions through four AI chatbots, including OpenAI’s ChatGPT and Google’s Bard. All four of the chatbots used debunked race-based information when asked about kidney and lung function.

“The use of false medical information is deeply concerning and could lead to a number of issues, including misdiagnoses or improper treatment for Black patients,” says Murdoch.

WHO has released six areas for regulation of AI for health, citing a need to manage the risks of AI amplifying biases in training data. The six areas for regulation are transparency and documentation; risk management; validating data and being clear about the intended use of AI; a commitment to data quality; privacy and data protection; and fostering collaboration.

“With these areas for regulation outlined,” says Murdoch, “governments and regulatory bodies can follow them and hopefully develop some regulations to protect healthcare professionals and patients, and also use AI to its full potential in healthcare.”

A copy of the WHO report can be downloaded here .