Tongue Ultrasound System Improves Speech Therapy
By MedImaging International staff writers Posted on 26 Oct 2017 |

Image: Articulatory talking head animations from ultrasound images for “ata” (top) and “uku” (bottom) (Photo courtesy of Thomas Hueber / GIPSA-Lab).
A new study describes how an innovative visual biofeedback system based on an ultrasound probe placed under the jaw can help treat speech impediments.
Developed by researchers at GIPSA-Lab (Saint-Martin-d'Hères, France) and INRIA Grenoble Rhône-Alpes (INRIA; Montbonnot-Saint-Martin, France), the system uses ultrasound images to display tongues movements in real time via an animated articulatory talking head, which serves as a virtual clone of the speaker. Besides the face and lips, the avatar shows the tongue, palate and teeth, which are usually hidden inside the vocal tract. Another version of the system (under development) automatically animates the articulatory talking head not by ultrasounds, but directly by the user’s voice.
The strength of this new system lies in an integrated cascaded gaussian mixture regression algorithm that can process articulatory movements required for targeted therapeutic applications. The algorithm exploits a probabilistic model based on a large articulatory database acquired from an “expert” speaker capable of pronouncing all of the sounds in one or more languages. The model is automatically adapted to the morphology of each new user, over the course of a short system calibration phase, during which the patient must pronounce a few phrases. The study was published in the October 2017 issue of Speech Communication.
“Automatic animation of an articulatory tongue model from ultrasound images of the vocal tract using visual biofeedback is the process of gaining awareness of physiological functions through the display of visual information,” concluded lead author Diandra Fabre, MSc, of GIPSA-Lab, and colleagues. “As speech is concerned, visual biofeedback usually consists in showing a speaker his/her own articulatory movements, which has proven useful in applications such as speech therapy or second language learning.”
Speech therapists specialize in the evaluation, diagnosis, and treatment of communication disorders, cognitive-communication disorders, voice disorders, and swallowing disorders, and play an important role in the diagnosis and treatment of autism spectrum disorder.
Related Links:
GIPSA-Lab
INRIA Grenoble Rhône-Alpes
Developed by researchers at GIPSA-Lab (Saint-Martin-d'Hères, France) and INRIA Grenoble Rhône-Alpes (INRIA; Montbonnot-Saint-Martin, France), the system uses ultrasound images to display tongues movements in real time via an animated articulatory talking head, which serves as a virtual clone of the speaker. Besides the face and lips, the avatar shows the tongue, palate and teeth, which are usually hidden inside the vocal tract. Another version of the system (under development) automatically animates the articulatory talking head not by ultrasounds, but directly by the user’s voice.
The strength of this new system lies in an integrated cascaded gaussian mixture regression algorithm that can process articulatory movements required for targeted therapeutic applications. The algorithm exploits a probabilistic model based on a large articulatory database acquired from an “expert” speaker capable of pronouncing all of the sounds in one or more languages. The model is automatically adapted to the morphology of each new user, over the course of a short system calibration phase, during which the patient must pronounce a few phrases. The study was published in the October 2017 issue of Speech Communication.
“Automatic animation of an articulatory tongue model from ultrasound images of the vocal tract using visual biofeedback is the process of gaining awareness of physiological functions through the display of visual information,” concluded lead author Diandra Fabre, MSc, of GIPSA-Lab, and colleagues. “As speech is concerned, visual biofeedback usually consists in showing a speaker his/her own articulatory movements, which has proven useful in applications such as speech therapy or second language learning.”
Speech therapists specialize in the evaluation, diagnosis, and treatment of communication disorders, cognitive-communication disorders, voice disorders, and swallowing disorders, and play an important role in the diagnosis and treatment of autism spectrum disorder.
Related Links:
GIPSA-Lab
INRIA Grenoble Rhône-Alpes
Latest Ultrasound News
- AI-Powered Lung Ultrasound Outperforms Human Experts in Tuberculosis Diagnosis
- AI Identifies Heart Valve Disease from Common Imaging Test
- Novel Imaging Method Enables Early Diagnosis and Treatment Monitoring of Type 2 Diabetes
- Ultrasound-Based Microscopy Technique to Help Diagnose Small Vessel Diseases
- Smart Ultrasound-Activated Immune Cells Destroy Cancer Cells for Extended Periods
- Tiny Magnetic Robot Takes 3D Scans from Deep Within Body
- High Resolution Ultrasound Speeds Up Prostate Cancer Diagnosis
- World's First Wireless, Handheld, Whole-Body Ultrasound with Single PZT Transducer Makes Imaging More Accessible
- Artificial Intelligence Detects Undiagnosed Liver Disease from Echocardiograms
- Ultrasound Imaging Non-Invasively Tracks Tumor Response to Radiation and Immunotherapy
- AI Improves Detection of Congenital Heart Defects on Routine Prenatal Ultrasounds
- AI Diagnoses Lung Diseases from Ultrasound Videos with 96.57% Accuracy
- New Contrast Agent for Ultrasound Imaging Ensures Affordable and Safer Medical Diagnostics
- Ultrasound-Directed Microbubbles Boost Immune Response Against Tumors
- POC Ultrasound Enhances Early Pregnancy Care and Cuts Emergency Visits
- AI-Based Models Outperform Human Experts at Identifying Ovarian Cancer in Ultrasound Images
Channels
Radiography
view channel
World's Largest Class Single Crystal Diamond Radiation Detector Opens New Possibilities for Diagnostic Imaging
Diamonds possess ideal physical properties for radiation detection, such as exceptional thermal and chemical stability along with a quick response time. Made of carbon with an atomic number of six, diamonds... Read more
AI-Powered Imaging Technique Shows Promise in Evaluating Patients for PCI
Percutaneous coronary intervention (PCI), also known as coronary angioplasty, is a minimally invasive procedure where small metal tubes called stents are inserted into partially blocked coronary arteries... Read moreMRI
view channel
AI Tool Predicts Relapse of Pediatric Brain Cancer from Brain MRI Scans
Many pediatric gliomas are treatable with surgery alone, but relapses can be catastrophic. Predicting which patients are at risk for recurrence remains challenging, leading to frequent follow-ups with... Read more
AI Tool Tracks Effectiveness of Multiple Sclerosis Treatments Using Brain MRI Scans
Multiple sclerosis (MS) is a condition in which the immune system attacks the brain and spinal cord, leading to impairments in movement, sensation, and cognition. Magnetic Resonance Imaging (MRI) markers... Read more
Ultra-Powerful MRI Scans Enable Life-Changing Surgery in Treatment-Resistant Epileptic Patients
Approximately 360,000 individuals in the UK suffer from focal epilepsy, a condition in which seizures spread from one part of the brain. Around a third of these patients experience persistent seizures... Read moreNuclear Medicine
view channel
Novel Radiolabeled Antibody Improves Diagnosis and Treatment of Solid Tumors
Interleukin-13 receptor α-2 (IL13Rα2) is a cell surface receptor commonly found in solid tumors such as glioblastoma, melanoma, and breast cancer. It is minimally expressed in normal tissues, making it... Read more
Novel PET Imaging Approach Offers Never-Before-Seen View of Neuroinflammation
COX-2, an enzyme that plays a key role in brain inflammation, can be significantly upregulated by inflammatory stimuli and neuroexcitation. Researchers suggest that COX-2 density in the brain could serve... Read moreGeneral/Advanced Imaging
view channel
AI-Powered Imaging System Improves Lung Cancer Diagnosis
Given the need to detect lung cancer at earlier stages, there is an increasing need for a definitive diagnostic pathway for patients with suspicious pulmonary nodules. However, obtaining tissue samples... Read more
AI Model Significantly Enhances Low-Dose CT Capabilities
Lung cancer remains one of the most challenging diseases, making early diagnosis vital for effective treatment. Fortunately, advancements in artificial intelligence (AI) are revolutionizing lung cancer... Read moreImaging IT
view channel
New Google Cloud Medical Imaging Suite Makes Imaging Healthcare Data More Accessible
Medical imaging is a critical tool used to diagnose patients, and there are billions of medical images scanned globally each year. Imaging data accounts for about 90% of all healthcare data1 and, until... Read more
Global AI in Medical Diagnostics Market to Be Driven by Demand for Image Recognition in Radiology
The global artificial intelligence (AI) in medical diagnostics market is expanding with early disease detection being one of its key applications and image recognition becoming a compelling consumer proposition... Read moreIndustry News
view channel
GE HealthCare and NVIDIA Collaboration to Reimagine Diagnostic Imaging
GE HealthCare (Chicago, IL, USA) has entered into a collaboration with NVIDIA (Santa Clara, CA, USA), expanding the existing relationship between the two companies to focus on pioneering innovation in... Read more
Patient-Specific 3D-Printed Phantoms Transform CT Imaging
New research has highlighted how anatomically precise, patient-specific 3D-printed phantoms are proving to be scalable, cost-effective, and efficient tools in the development of new CT scan algorithms... Read more
Siemens and Sectra Collaborate on Enhancing Radiology Workflows
Siemens Healthineers (Forchheim, Germany) and Sectra (Linköping, Sweden) have entered into a collaboration aimed at enhancing radiologists' diagnostic capabilities and, in turn, improving patient care... Read more