Imagine a world where stroke survivors can reclaim their voices, where a simple device could bridge the gap between their thoughts and their ability to communicate. This is the promise of Revoice, a groundbreaking innovation that could revolutionize stroke rehabilitation.
The Power of Revoice: Restoring Natural Communication
Revoice is a wearable, non-invasive device that aims to empower stroke patients with post-stroke speech impairment. Developed by researchers at the University of Cambridge, this innovative technology combines ultra-sensitive sensors and artificial intelligence to decode speech signals and emotional cues, enabling natural and fluent communication.
The device, designed as a soft and flexible choker, captures heart rate and throat muscle vibrations, reconstructing intended words and sentences in real-time. This is a far cry from existing assistive technologies that often require tedious letter-by-letter input or invasive brain implants.
Unveiling the Magic: How Revoice Works
Revoice employs two AI agents to interpret the wearer's intentions. The first agent reconstructs words from silently mouthed speech fragments, while the second agent interprets emotional states and contextual information, such as time of day or weather, to craft complete, expressive sentences.
In a small trial with five dysarthria patients (a common post-stroke speech impairment), Revoice achieved impressive results with a word error rate of just 4.2% and a sentence error rate of 2.9%. This technology offers seamless, real-time communication, transforming a few mouthed words into full, fluent sentences.
The Impact and Future of Revoice
The implications of Revoice extend beyond stroke rehabilitation. It could also support individuals with conditions like Parkinson's and motor neuron disease. The researchers are planning a clinical study in Cambridge for English-speaking dysarthria patients to assess the system's viability, with hopes to launch this year.
About half of stroke survivors develop dysarthria, a physical condition causing weakness in facial, mouth, and vocal cord muscles, leading to unclear speech, slurred or slow speech, or speaking in short bursts.
Professor Luigi Occhipinti, who led the research, emphasizes the profound frustration dysarthria causes, not just for patients but also for their caregivers and families. Traditional recovery methods involve repetitive word drills with speech therapists, a process that can take months or even years.
"Patients can perform the drills with practice, but struggle with open-ended questions and everyday conversation," Occhipinti explains. "Many patients do recover most or all of their speech, so invasive brain implants are not necessary, but there is a strong need for more intuitive and portable speech solutions."
Revoice: A Solution for Intuitive Communication
Occhipinti and his team developed Revoice as a response to this need. The device's sensors capture throat vibrations to detect speech signals and decode emotional states from pulse signals, providing a simplified yet effective proxy. It also uses a lightweight large language model (LLM) to predict full sentences, minimizing power usage.
In a small trial with five dysarthria patients and ten healthy controls, participants wore the device and mouthed short phrases. By nodding twice, they could expand these phrases into sentences using the embedded LLM. In one example, "We go hospital" became "Even though it's getting a bit late, I'm still feeling uncomfortable. Can we go to the hospital now?" The device inferred the wearer's frustration and late-night context, allowing the LLM to craft a complete sentence from just three mouthed words.
Participants reported a 55% increase in satisfaction, indicating Revoice's potential to help stroke patients regain their communication abilities. While extensive clinical trials are needed before widespread availability, the researchers aim to enhance future versions with multilingual capabilities, a broader emotional state range, and fully self-contained operation for everyday use.
"This is about restoring independence," Occhipinti says. "Communication is fundamental to dignity and recovery."
The research received support from the British Council, Haleon, and the Engineering and Physical Sciences Research Council (EPSRC), part of UK Research and Innovation (UKRI).
