AR System Enables Free-Hand, Real-Time Needle Guidance for Prostate Cancer Diagnosis
By MedImaging International staff writers Posted on 06 Mar 2023 |

Prostate cancer is the second most common cause of cancer-related deaths among men, according to the US Centers for Disease Control and Prevention. Transperineal (TP) biopsy is one of the conventional methods used for diagnosing and treating prostate cancer by collecting tissue samples through a needle inserted through the perineum wall. TP biopsy typically involves a pre-operation MRI scan and a transrectal ultrasound, with the images combined and displayed on a monitor for the urologist to visualize. The urologist can perform the needle insertion process free-hand or through a grid-based method. However, 2D visualization of a 3D region can make the needle's guidance and visualization a challenging task.
To address this issue, researchers from the US National Institutes of Health (NIH, Bethesda, MD, USA) have proposed an approach based on an augmented reality (AR) system called HoloLens. In their recent paper published in the Journal of Medical Imaging, the researchers have detailed their successful HoloLens AR system that accurately and effectively projects MRI and ultrasound images onto patients, helping to guide a needle to the target. The HoloLens AR system employs a volumetric 3D scan, like an MRI scan, to create an accurate view of the patient. Leveraging reference data from the patient, the MRI scan can be superimposed precisely onto the patient. The superimposed image is fed into the HoloLens goggles worn by the urologist and enables viewing the patient as well as the MRI of the patient in proper alignment. The HoloLens goggles also enable the urologist to view the image at different angles by moving the head. HoloLens can also display the pre-planned needle path on the patient, the target tissue of the prostate, and the real-time needle position during the procedure.
To evaluate their AR system's image overlay accuracy and needle targeting precision, the researchers utilized a 3D-printed phantom. They used the free-hand as well as planned-path guidance methods to guide needles into a gel phantom, and subsequently recorded the needle placement errors. The system was also used to deliver soft tissue markers onto tumors of a human pelvis phantom. The researchers found similar placement errors associated with both free-hand and planned-path guidance methods. Moreover, all implanted soft tissue markers were inside or in close proximity to the tumors.
“The current methods have certain limitations to them,” said Dr. Ming Li from the NIH who led the research. “Robot-assisted guidance is costly and adds procedural time, while other methods require a certain path for the needle that leaves out the outer reaches of the prostate. These problems are solved using the HoloLens AR system, which provides the doctor with the ability to use a free-hand approach.”
“The HoloLens has the potential to provide more flexibility than the current grid-based TP methods and can do so accurately,” highlighted Li. “By providing a 3D immersive experience, the HoloLens AR system makes free-hand lesion targeting feasible. As needle procedures move from rectum to the perineum, AR systems could provide great clinical value to doctors and patients by solving the problems associated with prostate intervention procedures.”
Related Links:
NIH
Latest Ultrasound News
- Artificial Intelligence Detects Undiagnosed Liver Disease from Echocardiograms
- Ultrasound Imaging Non-Invasively Tracks Tumor Response to Radiation and Immunotherapy
- AI Improves Detection of Congenital Heart Defects on Routine Prenatal Ultrasounds
- AI Diagnoses Lung Diseases from Ultrasound Videos with 96.57% Accuracy
- New Contrast Agent for Ultrasound Imaging Ensures Affordable and Safer Medical Diagnostics
- Ultrasound-Directed Microbubbles Boost Immune Response Against Tumors
- POC Ultrasound Enhances Early Pregnancy Care and Cuts Emergency Visits
- AI-Based Models Outperform Human Experts at Identifying Ovarian Cancer in Ultrasound Images
- Automated Breast Ultrasound Provides Alternative to Mammography in Low-Resource Settings
- Transparent Ultrasound Transducer for Photoacoustic and Ultrasound Endoscopy to Improve Diagnostic Accuracy
- Wearable Ultrasound Patch Enables Continuous Blood Pressure Monitoring
- AI Image-Recognition Program Reads Echocardiograms Faster, Cuts Results Wait Time
- Ultrasound Device Non-Invasively Improves Blood Circulation in Lower Limbs
- Wearable Ultrasound Device Provides Long-Term, Wireless Muscle Monitoring
- Ultrasound Can Identify Sources of Brain-Related Issues and Disorders Before Treatment
- New Guideline on Handling Endobronchial Ultrasound Transbronchial Needle Samples
Channels
Radiography
view channel
AI-Powered Mammography Screening Boosts Cancer Detection in Single-Reader Settings
A new study has revealed that an artificial intelligence (AI)-powered solution significantly improves cancer detection in single-reader mammography settings without increasing recall rates, offering a... Read more
Photon Counting Detectors Promise Fast Color X-Ray Images
For many years, healthcare professionals have depended on traditional 2D X-rays to diagnose common bone fractures, though small fractures or soft tissue damage, such as cancers, can often be missed.... Read moreMRI
view channel
Biparametric MRI Combined with AI Enhances Detection of Clinically Significant Prostate Cancer
Artificial intelligence (AI) technologies are transforming the way medical images are analyzed, offering unprecedented capabilities in quantitatively extracting features that go beyond traditional visual... Read more
First-Of-Its-Kind AI-Driven Brain Imaging Platform to Better Guide Stroke Treatment Options
Each year, approximately 800,000 people in the U.S. experience strokes, with marginalized and minoritized groups being disproportionately affected. Strokes vary in terms of size and location within the... Read moreUltrasound
view channel
Artificial Intelligence Detects Undiagnosed Liver Disease from Echocardiograms
Echocardiography is a diagnostic procedure that uses ultrasound to visualize the heart and its associated structures. This imaging test is commonly used as an early screening method when doctors suspect... Read more
Ultrasound Imaging Non-Invasively Tracks Tumor Response to Radiation and Immunotherapy
While immunotherapy holds promise in the fight against triple-negative breast cancer, many patients fail to respond to current treatments. A major challenge has been predicting and monitoring how individual... Read moreNuclear Medicine
view channel
Novel Radiotracer Identifies Biomarker for Triple-Negative Breast Cancer
Triple-negative breast cancer (TNBC), which represents 15-20% of all breast cancer cases, is one of the most aggressive subtypes, with a five-year survival rate of about 40%. Due to its significant heterogeneity... Read more
Innovative PET Imaging Technique to Help Diagnose Neurodegeneration
Neurodegenerative diseases, such as amyotrophic lateral sclerosis (ALS) and Alzheimer’s disease, are often diagnosed only after physical symptoms appear, by which time treatment may no longer be effective.... Read moreGeneral/Advanced Imaging
view channel
AI Reduces CT Lung Cancer Screening Workload by Almost 80%
Lung cancer impacts over 48,000 individuals in the UK annually, and early detection is key to improving survival rates. The UK Lung Cancer Screening (UKLS) trial has already shown that low-dose CT (LDCT)... Read more
Cutting-Edge Technology Combines Light and Sound for Real-Time Stroke Monitoring
Stroke is the second leading cause of death globally, claiming millions of lives each year. Ischemic stroke, in particular, occurs when a blood vessel that supplies blood to the brain becomes blocked.... Read more
AI System Detects Subtle Changes in Series of Medical Images Over Time
Traditional approaches for analyzing longitudinal image datasets typically require significant customization and extensive pre-processing. For instance, in studies of the brain, researchers often begin... Read more
New CT Scan Technique to Improve Prognosis and Treatments for Head and Neck Cancers
Cancers of the mouth, nose, and throat are becoming increasingly common in the U.S., particularly among younger individuals. Approximately 60,000 new cases are diagnosed annually, with 20% of these cases... Read moreImaging IT
view channel
New Google Cloud Medical Imaging Suite Makes Imaging Healthcare Data More Accessible
Medical imaging is a critical tool used to diagnose patients, and there are billions of medical images scanned globally each year. Imaging data accounts for about 90% of all healthcare data1 and, until... Read more
Global AI in Medical Diagnostics Market to Be Driven by Demand for Image Recognition in Radiology
The global artificial intelligence (AI) in medical diagnostics market is expanding with early disease detection being one of its key applications and image recognition becoming a compelling consumer proposition... Read moreIndustry News
view channel
Siemens and Sectra Collaborate on Enhancing Radiology Workflows
Siemens Healthineers (Forchheim, Germany) and Sectra (Linköping, Sweden) have entered into a collaboration aimed at enhancing radiologists' diagnostic capabilities and, in turn, improving patient care... Read more