Chatbot accuracy: Study evaluates medical advice from AI chatbots and other sources

Chatbot accuracy: Study evaluates medical advice from AI chatbots and other sources

A team of AI and medical researchers, affiliated with several institutions in the U.K. and the U.S. has tested the accuracy of medical information and advice given by LLMs to users. In their paper posted on the arXiv preprint server, the group describes how they asked 1,298 volunteers to query chatbots for medical advice. They then compared the results to advice from other online sources or the user's common sense.