Source: DeltaWorks/Pixabay The predictive capabilities of artificial intelligence (AI) large language models (LLMs) to find patterns in enormous amounts of complex brain imaging data are actively being evaluated by researchers and neuroscientists. A new study published recently in European Radiology explores the performance of the AI large language model GPT-4 versus human radiologists with surprising results.
“This study is the first attempt to evaluate GPT-4’s ability to interpret actual clinical radiology reports, rather than from settings like image diagnosis quizzes,” wrote corresponding author Daiju Ueda, an associate professor at Osaka Metropolitan University’s Graduate School of Medicine, along with his research team consisting of Yasuhito Mitsuyama, Hiroyuki Tatekawa, and colleagues.
In the field of artificial intelligence , large language models are machine learning models, specifically deep learning models, which can perform a wide range of natural language processing (NLP) tasks such as generating text, answering questions, analyzing text, translation, classifying text, categorizing text, and acting as a conversational chatbot.
Examples of large language models include Generative Pretrained Transformer (GPT) by OpenAI, Bidirectional Encoder Representations from Transformers (BERT) by Google, and Robustly Optimized BERT Approach (RoBERTa) by Meta AI, among many others.
“Large language models like GPT-4 have demonstrated potential for diagnosis in radiology,” wrote the researchers.
According to the researchers, what’s lacking in the evaluation of GPT-4 as a potential tool for radiologists is a study that evaluates the AI using actual radiology reports where the data tends to be more varied and unstructured in comparison to studies based on more structured data from diagnostic quizzes. This team aimed to investigate this unknown by comparing the diagnostic abilities of GPT-4 performance ability using data from real-world clinical radiology reports.
“We zeroed in on MRI reports pertaining to brain tumors, given the pivotal role radiological reports play in determining treatment routes such as surgery, medication , or monitoring; and that pathological outcomes offer a definitive ground truth for brain tumors,” the scientists wrote.
The researchers assembled a team of human radiologists consisting of four general radiologists and three neuroradiologists who have been certified specialists in diagnostic imaging for the central nervous system by the Japanese Society of Radiology. […]
Get Creative with Cannabis: The Ultimate Guide to Painting and Pottery Workshops
Creative with Cannabis Cannabis and creativity go hand in hand—especially
