The study, conducted by researchers at Google, tested the performance of a large language model similar to the one used in ChatGPT on its responses to multiple-choice polls and commonly asked medical questions.
The results showed that the model incorporated biases about patients that could exacerbate health disparities and produce inaccurate answers to medical questions.
However, a version of the model developed by Google to specialize in medicine was found to strip out some of these negative effects and recorded a level of accuracy and bias that was closer to a group of doctors.
The researchers believe that artificial intelligence (AI) could be used to expand capacity within medicine by supporting clinicians to make decisions and access information more quickly.
However, more development is needed before AI can be used effectively in the field of medicine.
The study found that the unspecialized model was much more likely to produce answers that were rated as potentially leading to harmful outcomes at 29.7% compared with 5.8% for the specialized model and 6.5% for answers generated by clinicians.
James Davenport, a professor of information technology at the University of Bath, highlighted the difference between answering medical questions and practicing medicine.
"Practicing medicine does not consist of answering medical questions - if it were purely about medical questions, we wouldn't need teaching hospitals and doctors wouldn't need years of training after their academic courses," he said.
Anthony Cohn, a professor of automated reasoning at the University of Leeds, pointed out that there is always a risk that AI models will produce false information because of their statistical nature.
He added that AI models should always be regarded as assistants rather than the final decision-makers, especially in critical fields such as medicine where legal liability is also a concern.
The study's findings suggest that AI has the potential to assist doctors in the field of medicine, but more development is needed before it can be used effectively.
Google's medicine-focused AI model has the potential to provide accurate and unbiased information to clinicians, but it is crucial to ensure that the model is continuously updated to reflect the latest medical knowledge and practices.
In
LONDON DAILY ARCHIVE
Google Develops AI Model for Accurate and Unbiased Medical Answers
Google has developed an AI model that is as accurate and unbiased as doctors when it comes to answering medical questions, a new study has revealed.
13 July 2023 · 14:47 UTC
