AI Images Challenge Radiology Detection Skills - EMJ

This site is intended for healthcare professionals

Radiologists Only Correctly Identified 75% of AI-Generated Images

AI Images Challenge Radiology Detection Skills - EMJ

Key Summary:

  • AI-generated images were correctly identified by radiologists in about three quarters of cases.
  • CT and MRI AI-generated images proved harder to spot than x-rays or ultrasound images.
  • Relevant subspecialty expertise, not years of experience, improved image classification.

RADIOLOGISTS correctly identified AI-generated images only about three quarters of the time in a study examining whether clinicians could distinguish synthetic radiology scans from genuine ones. The findings suggested that cross-sectional imaging, particularly CT and MRI, were more difficult to classify accurately than x-rays or ultrasound.

Text-to-image AI models can now generate synthetic radiological images that closely resemble genuine scans. These images may support education and AI model training, although their realism also raises concerns about potential misuse.

Cross-Sectional Imaging Proved Most Difficult to Classify

The study included 182 radiologists, who completed an online survey featuring 30 images comprising 20 AI-generated and 10 real radiological images. Participants classified each image as either real or AI generated and rated their confidence on a five-point scale.

Researchers created the synthetic images using the Dreambooth fine-tuning approach applied to Stable Diffusion v2.1. The model was fine-tuned using 20 to 30 reference images for each imaging modality or anatomical region, including chest and hand radiographs, several CT applications, and brain and knee MRI. Nearly all training images depicted normal anatomy.

Radiologists correctly classified a median of 77.8% of images. Detection rates were similar for AI-generated images (75.0%) and genuine images (83.4%), with no statistically significant difference between the two.

Performance varied by imaging modality. Ultrasound and x-ray images were identified more accurately than CT and MRI, with correct classification rates of 88%, 91%, 70% and 77%, respectively. Confidence scores were comparable when assessing AI-generated and real images.

Specialist Expertise Influenced Accuracy

Years of radiology experience and self-reported familiarity with AI did not affect performance. However, radiologists with specialist expertise relevant to the image being assessed achieved higher classification accuracy (80.7%) than those without a matching subspecialty (76.9%) interest (p=0.012).

The findings suggested AI-generated radiological images could support applications such as AI model training. However, the difficulty many radiologists had distinguishing synthetic from genuine CT and MRI images also highlighted the potential for misuse.

Reference

Cronshaw RA, Williams MC. Real or not real? Can radiologists distinguish artificial intelligence generated radiological images from real ones? Clin Radiol. 2026;DOI:10.1016/j.crad.2026.107438.

Featured image: Gorodenkoff on Adobe Stock

Author:

Each article is made available under the terms of the Creative Commons Attribution-Non Commercial 4.0 License.

Rate this content's potential impact on patient outcomes

Average rating 5 / 5. Vote count: 1

No votes so far! Be the first to rate this content.