New AI institute to focus on the speech language pathology needs of children



The University of Illinois is part of a nine-university consortium led by the University of Buffalo that has been awarded a $20 million grant by the National Science Foundation to establish a national institute that develops artificial intelligence systems that identify and assist young children with speech and/or language processing challenges. The award will establish the AI Institute for Exceptional Education to advance foundational AI technologies, human-centered AI design, and learning science that improve educational outcomes for young children. 

The institute will help address the nationwide shortage of speech-language pathologists and provide services to children ages 3 to 10 who are at increased risk of falling behind in their academic and socio-emotional development – issues exacerbated by the COVID-19 pandemic.

Pamela Hadley, professor and head of the Department of Speech and Hearing Science at the University of Illinois Urbana-Champaign, is one of the co-principal investigators for the grant. 

“In light of the shortage of speech-language pathologists nationwide, there is a pressing need to develop health technologies that can help identify young children at-risk for speech and language disorders at younger ages and do so more efficiently,” said Hadley, a fellow of the American Speech-Language Hearing Association. “Our multidisciplinary team will enhance automatic speech recognition systems, improving early identification and interventions for children with developmental language disorder and other conditions that affect speech and language. Our team will also create advanced artificial intelligence systems that will support tailored interventions for children on the caseloads of speech-language pathologists. By doing so, we will create educational environments that help children thrive socially and academically.”

Institute will help underserved students

The AI Institute for Exceptional Education will focus on serving the millions of children nationwide who, under the Individuals with Disabilities Education Act, require speech and language services.
Specially, it will develop two advanced AI solutions: the AI Screener for early identification of potential speech and/or language disorders; and the AI Orchestrator, which will act as a virtual teaching assistant by providing students with ability-based interventions.

The AI Screener will listen to and observe children in the classroom, collecting samples of children’s speech, facial expressions, gestures and other data. It will create weekly summaries of these interactions that catalogue each child’s vocabulary, pronunciation, video snippets and more. These summaries will help teachers monitor their students’ speech and language abilities and, if needed, suggest a formal evaluation with a speech-language pathologist.

The AI Orchestrator is an app that will help speech-language pathologists, most of whom have caseloads so large that they must provide group-based interventions for children instead of individualized care. The app addresses this by recommending personalized content tailored to students’ needs. It continues to monitor students’ progress and adjusts lesson plans to ensure that the interventions are working.

“The AI Institute for Exceptional Education follows 18 already established NSF-led AI Institutes, an ecosystem of AI research and education in pursuit of transformational advances in AI research and development of AI-powered innovation,” NSF Program Director James Donlon said. “We are happy to welcome this new team to the AI Institutes program.”

Institute comprises top research universities

The institute will consist of more than 30 researchers from nine universities including the University of Buffalo; Stanford University; the University of Washington; Cornell University; the University of Nevada, Reno; the University of Texas at El Paso; Penn State University; and the University of Oregon.

Other investigators at Illinois are Heng Ji (Computer Science), Mark Hasegawa-Johnson (Electrical and Computer Engineering), Yun Huang (Information Science), Hedda Meadan-Kaplansky (Special Education), and Windi Krok (Speech and Hearing Science).

“We are eager to see how this team advances AI research to develop better solutions for children with specific speech-language needs, as well as their families and the U.S. schools who serve them. This project is a great example of how we can harness the opportunities that AI technologies can offer to enhance the services that our nation can offer the American people,” NSF Program Director Fengfeng Ke said.

Editor’s note:

To reach Vince Lara-Cinisomo, email vinlara@illinois.edu.
 

Share on social

Related news

Stretching their Reach: Robotic support for older individuals



University of Illinois researcher Dr. Wendy Rogers is stretching her work with Stretch the Robot.

The Kinesiology and Community Health professor has received a Phase II Small Business Innovation Research grant from the National Institute on Aging (National Institutes of Health), for approximately $2.5 million.

The research will be conducted between December 2022 and November 2024 and builds on a Phase I grant that Rogers and Dr. Aaron Edsinger, CEO of Hello Robot, received last year. Other Illinois collaborators on the new grant include Speech and Hearing Science Associate Professor Raksha Mudar and Harshal Mahajan, Assistant Director of Research for the McKechnie Family LIFE Home. Also part of the new team are ClarkLindsey, an independent, senior living community in Urbana, Ill.; Dr. Vy Nguyen, an occupational therapist at Hello Robot; and Dr. Charlie Kemp, director of the Healthcare Robotics Lab at Georgia Tech and CTO of Hello Robot.

Phase I explored the use of Stretch, a research robot designed by Kemp & Edsinger, to support everyday activities through use of a lightweight telescoping arm mounted on a mobile base. That research identified home tasks for which support is needed; developed tools to enable Stretch to effectively perform these tasks; and designed an easy-to-use interface that older adults can use to control Stretch to carry out their desired tasks.

The Phase II grant will advance the capabilities of Stretch, in partnership with ClarkLindsey, focusing on physical and cognitive tasks. The aim is to determine how assistive robots can support the needs of older adults with cognitive impairment in addition to those with mobility impairment. The researchers plan to refine the remote control interface to be used by caregivers, develop autonomous activities for Stretch, and explore Stretch’s utility in a variety of home environments, including common rooms with multiple people. 

The goal is to create a scalable, affordable, flexible Stretch Cognitive and Physical Assistant that can improve the quality of life for older adults with a range of cognitive and physical impairments, the researchers say.

In addition to ClarkLindsey, research and testing for this grant will be conducted at the McKechnie Family LIFE Home on the University of Illinois campus.
 

Editor’s note:

To reach Vince Lara-Cinisomo, email vinlara@illinois.edu.
 

Share on social

Related news

College of Applied Health Sciences
110 Huff Hall
1206 South 4th Street
Champaign, IL 61820
(217) 333-2131