GE HealthCare and NVIDIA Collaboration to Reimagine Diagnostic Imaging

By MedImaging International staff writers
Posted on 19 Mar 2025

Image: The new NVIDIA Isaac will fast-track development of autonomous imaging systems and robotics (Photo courtesy of NVIDIA)

GE HealthCare (Chicago, IL, USA) has entered into a collaboration with NVIDIA (Santa Clara, CA, USA), expanding the existing relationship between the two companies to focus on pioneering innovation in autonomous imaging, beginning with autonomous X-ray technologies and autonomous applications within ultrasound.

GE HealthCare has been at the forefront of medical technology innovation with a series of “firsts” that date back more than a century, starting with the invention of its X-ray tube, followed by several others including the first handheld ultrasound, first 3D obstetric ultrasound, and on-device AI algorithms for pneumothorax triage. X-ray and ultrasound continue to be the most widely used diagnostic imaging systems with 4.2 billion medical imaging examinations performed annually at a global scale. However, rising demand, driven by an aging population, has led to significant radiology staff shortages, challenging healthcare systems, increasing the burden on healthcare providers, and delaying critical diagnoses.

Autonomous X-ray and ultrasound are promising new areas of development, using AI-enabled software to capture and analyze medical images, which could minimize the burden on technicians and radiologists. With NVIDIA as a world leader in accelerated computing and AI and GE HealthCare’s position as a leading global healthcare solutions provider — topping the FDA list of AI-enabled device authorizations for three years in a row with 85 authorizations — this collaboration plan has the potential to help solve some of healthcare’s biggest challenges. GE HealthCare aims to develop AI-enabled X-ray and ultrasound systems by leveraging the new NVIDIA Isaac for Healthcare platform, built on NVIDIA’s three computers utilized to build physical AI, including NVIDIA Omniverse for robotic simulation workflows.

Using the NVIDIA Cosmos platform for synthetic data generation, physics-based sensor simulation, imitation, and reinforcement learning, GE HealthCare plans to train, test, and tune autonomous ultrasound and X-ray devices in a virtual environment before deployment in the physical world. NVIDIA and GE HealthCare will initially focus on autonomous development within X-ray systems, specifically the potential utilization of the NVIDIA Isaac for Healthcare and Jetson platforms. GE HealthCare plans to explore Isaac for Healthcare platform and synthetic data generation to simulate various scenarios. This will help to automate repetitive tasks performed by a technologist in the patient exam room. The goal is to enable care teams to focus more of their time on direct patient care and complex cases. The companies will also explore the development of machine-to-patient interactions to autonomously lead the patient through the scan journey.

As ultrasound grows in popularity—and complexity—sonographers and radiology technologists face high patient volumes, long hours, and mental and physical stress. Approximately 90% of sonographers report work-related musculoskeletal disorders, and among U.S. health systems, 81% report radiology technologist shortages. To help address these challenges, GE HealthCare and NVIDIA plan to explore the development of autonomous ultrasound systems to reduce the burden on sonographers and radiologists. For sonographers, autonomous ultrasound systems could streamline workflow and reduce demanding physical strain resulting from repetitive motions. In addition, AI has the potential to take on more of the daily workload though advancements in image understanding and robotic navigation.

This work will build on a long-standing relationship between the two companies, spanning various areas of GE HealthCare’s business. As an example of previous synergies, GE HealthCare used NVIDIA technology for the development of GE HealthCare’s pioneering research foundation model SonoSAMTrackviii. SonoSAMTrack is a healthcare-specific research foundation model that GE HealthCare trained on approximately 200,000 image-mask pairs, which delineate diverse sets of regions of interest including organs and lesions, and exhibited an average similarity score of over 90%, indicating a high degree of segmentation accuracy.

“GE HealthCare has a deep history of firsts in medical imaging, and we continue to build upon our legacy of innovation as a healthcare solutions provider,” said Roland Rott, president and CEO, Imaging at GE HealthCare. “We are excited about our expanded relationship with NVIDIA and the potential of autonomous X-ray and ultrasound as we are focused on unlocking smarter, more automated solutions that enhance efficiency, standardize imaging, and help ease the burden of increased volumes and double-digit staff shortages on healthcare professionals.”

“Artificial intelligence and physical AI offer an incredible opportunity to expand global access to GE HealthCare’s advanced imaging systems,” said Kimberly Powell, vice president of healthcare at NVIDIA. “Working together to train and test autonomous solutions, we will accelerate the future of medical imaging capabilities, starting with the two most widely used modalities: X-ray and ultrasound.”