We use cookies to understand how you use our site and to improve your experience. This includes personalizing content and advertising. To learn more, click here. By continuing to use our site, you accept our use of cookies. Cookie Policy.

MedImaging

Download Mobile App
Recent News Radiography MRI Ultrasound Nuclear Medicine General/Advanced Imaging Imaging IT Industry News

AI Model Combines Chest X-rays with Patient Data to Improve Diagnosis

By MedImaging International staff writers
Posted on 04 Oct 2023

Healthcare professionals use a mix of imaging and non-imaging data to diagnose illnesses. While existing artificial intelligence (AI)--based solutions are usually designed to work with just one form of data, transformer-based neural networks offer the capability to merge both kinds for more precise diagnoses. Originally intended for processing human language, these transformer models have inspired sizable language models like ChatGPT and Google's Bard. Unlike their convolutional neural network counterparts, which focus mainly on imaging data, transformer networks have a more general application. They employ what's known as an attention mechanism, allowing the network to understand relationships within its input data. This feature is particularly well-suited for medical fields where diagnosis often involves combining varied data types like patient information and imaging results. Now, a newly developed transformer AI model combines clinical patient data with imaging information to enhance diagnostic accuracy on chest X-rays.

Researchers at University Hospital Aachen (Aachen, Germany) have developed a transformer model specifically for medical use. They trained the system using both imaging and non-imaging data from two databases, which together include records of over 82,000 patients. This model has been taught to identify up to 25 different conditions using either type of data or a mix of the two, known as multimodal data. When compared to other existing models, this new multimodal approach demonstrated a better diagnostic performance across the board. According to the research team, this model not only has the potential to assist healthcare providers who are facing increasing workloads but could also serve as a blueprint for seamlessly integrating large sets of data.


Image: The AI model has potential as an aid to radiologists in a time of growing workloads (Photo courtesy of 123RF)
Image: The AI model has potential as an aid to radiologists in a time of growing workloads (Photo courtesy of 123RF)

"With patient data volumes increasing steadily over the years and time that the doctors can spend per patient being limited, it might become increasingly challenging for clinicians to interpret all available information effectively," said study lead author Firas Khader, M.Sc., a Ph.D. student at University Hospital Aachen. "Multimodal models hold the promise to assist clinicians in their diagnosis by facilitating the aggregation of the available data into an accurate diagnosis."

Related Links:
University Hospital Aachen


Gold Member
Solid State Kv/Dose Multi-Sensor
AGMS-DM+
Ultrasound Doppler System
Doppler BT-200
Thyroid Shield
Standard Thyroid Shield
New
Compact C-Arm
Arcovis DRF-C S21

Latest Radiography News

Novel Breast Imaging System Proves As Effective As Mammography

AI Assistance Improves Breast-Cancer Screening by Reducing False Positives

AI Could Boost Clinical Adoption of Chest DDR