AR System Enables Free-Hand, Real-Time Needle Guidance for Prostate Cancer Diagnosis
By MedImaging International staff writers Posted on 06 Mar 2023 |

Prostate cancer is the second most common cause of cancer-related deaths among men, according to the US Centers for Disease Control and Prevention. Transperineal (TP) biopsy is one of the conventional methods used for diagnosing and treating prostate cancer by collecting tissue samples through a needle inserted through the perineum wall. TP biopsy typically involves a pre-operation MRI scan and a transrectal ultrasound, with the images combined and displayed on a monitor for the urologist to visualize. The urologist can perform the needle insertion process free-hand or through a grid-based method. However, 2D visualization of a 3D region can make the needle's guidance and visualization a challenging task.
To address this issue, researchers from the US National Institutes of Health (NIH, Bethesda, MD, USA) have proposed an approach based on an augmented reality (AR) system called HoloLens. In their recent paper published in the Journal of Medical Imaging, the researchers have detailed their successful HoloLens AR system that accurately and effectively projects MRI and ultrasound images onto patients, helping to guide a needle to the target. The HoloLens AR system employs a volumetric 3D scan, like an MRI scan, to create an accurate view of the patient. Leveraging reference data from the patient, the MRI scan can be superimposed precisely onto the patient. The superimposed image is fed into the HoloLens goggles worn by the urologist and enables viewing the patient as well as the MRI of the patient in proper alignment. The HoloLens goggles also enable the urologist to view the image at different angles by moving the head. HoloLens can also display the pre-planned needle path on the patient, the target tissue of the prostate, and the real-time needle position during the procedure.
To evaluate their AR system's image overlay accuracy and needle targeting precision, the researchers utilized a 3D-printed phantom. They used the free-hand as well as planned-path guidance methods to guide needles into a gel phantom, and subsequently recorded the needle placement errors. The system was also used to deliver soft tissue markers onto tumors of a human pelvis phantom. The researchers found similar placement errors associated with both free-hand and planned-path guidance methods. Moreover, all implanted soft tissue markers were inside or in close proximity to the tumors.
“The current methods have certain limitations to them,” said Dr. Ming Li from the NIH who led the research. “Robot-assisted guidance is costly and adds procedural time, while other methods require a certain path for the needle that leaves out the outer reaches of the prostate. These problems are solved using the HoloLens AR system, which provides the doctor with the ability to use a free-hand approach.”
“The HoloLens has the potential to provide more flexibility than the current grid-based TP methods and can do so accurately,” highlighted Li. “By providing a 3D immersive experience, the HoloLens AR system makes free-hand lesion targeting feasible. As needle procedures move from rectum to the perineum, AR systems could provide great clinical value to doctors and patients by solving the problems associated with prostate intervention procedures.”
Related Links:
NIH
Latest MRI News
- AI Tool Tracks Effectiveness of Multiple Sclerosis Treatments Using Brain MRI Scans
- Ultra-Powerful MRI Scans Enable Life-Changing Surgery in Treatment-Resistant Epileptic Patients
- AI-Powered MRI Technology Improves Parkinson’s Diagnoses
- Biparametric MRI Combined with AI Enhances Detection of Clinically Significant Prostate Cancer
- First-Of-Its-Kind AI-Driven Brain Imaging Platform to Better Guide Stroke Treatment Options
- New Model Improves Comparison of MRIs Taken at Different Institutions
- Groundbreaking New Scanner Sees 'Previously Undetectable' Cancer Spread
- First-Of-Its-Kind Tool Analyzes MRI Scans to Measure Brain Aging
- AI-Enhanced MRI Images Make Cancerous Breast Tissue Glow
- AI Model Automatically Segments MRI Images
- New Research Supports Routine Brain MRI Screening in Asymptomatic Late-Stage Breast Cancer Patients
- Revolutionary Portable Device Performs Rapid MRI-Based Stroke Imaging at Patient's Bedside
- AI Predicts After-Effects of Brain Tumor Surgery from MRI Scans
- MRI-First Strategy for Prostate Cancer Detection Proven Safe
- First-Of-Its-Kind 10' x 48' Mobile MRI Scanner Transforms User and Patient Experience
- New Model Makes MRI More Accurate and Reliable
Channels
Radiography
view channel
World's Largest Class Single Crystal Diamond Radiation Detector Opens New Possibilities for Diagnostic Imaging
Diamonds possess ideal physical properties for radiation detection, such as exceptional thermal and chemical stability along with a quick response time. Made of carbon with an atomic number of six, diamonds... Read more
AI-Powered Imaging Technique Shows Promise in Evaluating Patients for PCI
Percutaneous coronary intervention (PCI), also known as coronary angioplasty, is a minimally invasive procedure where small metal tubes called stents are inserted into partially blocked coronary arteries... Read moreMRI
view channel
AI Tool Tracks Effectiveness of Multiple Sclerosis Treatments Using Brain MRI Scans
Multiple sclerosis (MS) is a condition in which the immune system attacks the brain and spinal cord, leading to impairments in movement, sensation, and cognition. Magnetic Resonance Imaging (MRI) markers... Read more
Ultra-Powerful MRI Scans Enable Life-Changing Surgery in Treatment-Resistant Epileptic Patients
Approximately 360,000 individuals in the UK suffer from focal epilepsy, a condition in which seizures spread from one part of the brain. Around a third of these patients experience persistent seizures... Read more
AI-Powered MRI Technology Improves Parkinson’s Diagnoses
Current research shows that the accuracy of diagnosing Parkinson’s disease typically ranges from 55% to 78% within the first five years of assessment. This is partly due to the similarities shared by Parkinson’s... Read more
Biparametric MRI Combined with AI Enhances Detection of Clinically Significant Prostate Cancer
Artificial intelligence (AI) technologies are transforming the way medical images are analyzed, offering unprecedented capabilities in quantitatively extracting features that go beyond traditional visual... Read moreUltrasound
view channel
AI Identifies Heart Valve Disease from Common Imaging Test
Tricuspid regurgitation is a condition where the heart's tricuspid valve does not close completely during contraction, leading to backward blood flow, which can result in heart failure. A new artificial... Read more
Novel Imaging Method Enables Early Diagnosis and Treatment Monitoring of Type 2 Diabetes
Type 2 diabetes is recognized as an autoimmune inflammatory disease, where chronic inflammation leads to alterations in pancreatic islet microvasculature, a key factor in β-cell dysfunction.... Read moreNuclear Medicine
view channel
Novel PET Imaging Approach Offers Never-Before-Seen View of Neuroinflammation
COX-2, an enzyme that plays a key role in brain inflammation, can be significantly upregulated by inflammatory stimuli and neuroexcitation. Researchers suggest that COX-2 density in the brain could serve... Read more
Novel Radiotracer Identifies Biomarker for Triple-Negative Breast Cancer
Triple-negative breast cancer (TNBC), which represents 15-20% of all breast cancer cases, is one of the most aggressive subtypes, with a five-year survival rate of about 40%. Due to its significant heterogeneity... Read moreGeneral/Advanced Imaging
view channel
AI-Powered Imaging System Improves Lung Cancer Diagnosis
Given the need to detect lung cancer at earlier stages, there is an increasing need for a definitive diagnostic pathway for patients with suspicious pulmonary nodules. However, obtaining tissue samples... Read more
AI Model Significantly Enhances Low-Dose CT Capabilities
Lung cancer remains one of the most challenging diseases, making early diagnosis vital for effective treatment. Fortunately, advancements in artificial intelligence (AI) are revolutionizing lung cancer... Read moreImaging IT
view channel
New Google Cloud Medical Imaging Suite Makes Imaging Healthcare Data More Accessible
Medical imaging is a critical tool used to diagnose patients, and there are billions of medical images scanned globally each year. Imaging data accounts for about 90% of all healthcare data1 and, until... Read more
Global AI in Medical Diagnostics Market to Be Driven by Demand for Image Recognition in Radiology
The global artificial intelligence (AI) in medical diagnostics market is expanding with early disease detection being one of its key applications and image recognition becoming a compelling consumer proposition... Read moreIndustry News
view channel
GE HealthCare and NVIDIA Collaboration to Reimagine Diagnostic Imaging
GE HealthCare (Chicago, IL, USA) has entered into a collaboration with NVIDIA (Santa Clara, CA, USA), expanding the existing relationship between the two companies to focus on pioneering innovation in... Read more
Patient-Specific 3D-Printed Phantoms Transform CT Imaging
New research has highlighted how anatomically precise, patient-specific 3D-printed phantoms are proving to be scalable, cost-effective, and efficient tools in the development of new CT scan algorithms... Read more
Siemens and Sectra Collaborate on Enhancing Radiology Workflows
Siemens Healthineers (Forchheim, Germany) and Sectra (Linköping, Sweden) have entered into a collaboration aimed at enhancing radiologists' diagnostic capabilities and, in turn, improving patient care... Read more