New brain implant breaks record for turning thoughts into text

A woman typed 62 words per minute — using only her mind.
Sign up for the Freethink Weekly newsletter!
A collection of our favorite stories straight to your inbox

Stanford researchers have developed a speech brain-computer interface (BCI) they say can translate thoughts into text at a record-breaking speed — putting us closer to a future in which people who can’t talk can still easily communicate.  

The challenge: “Anarthria” is a devastating condition in which a person can’t speak, despite being able to understand speech and knowing what they want to say. It’s usually caused by a brain injury, such as a stroke, or a neurological disorder, such as Parkinson’s disease or ALS.

Some people with anarthria write or use eye-tracking tech to communicate, but this “speech” is far slower than the average talking speed. People with anarthria due to total paralysis or locked-in syndrome can’t even move their eyes, though, leaving them with no way to communicate.

The goal is to develop speech BCIs that allow people to “talk” at the rate at which people without impairments speak.

Thought-to-text: Speech BCIs have the potential to give people with anarthria back their voices.

These devices translate people’s brain activity (usually picked up via implanted electrode arrays) into commands for computers. With proper training, they can translate a person’s thoughts into text on a screen.

In past studies, researchers have trained BCIs by asking people to think about adjusting the pitch of an audible tone or using a pen to handwrite individual letters.

While a totally paralyzed man was only able to choose about one character per minute using the tone system, a person with limb paralysis was able to write at a speed of 18 words per minute using the handwriting-based BCI, setting a world record.

Electrodes recorded the woman’s brain activity while she tried saying phonemes, whole words, or entire sentences.

What’s new? While the ability to communicate slowly is better than not at all, the goal is to develop speech BCIs that allow people to “talk” as close as possible to the rate at which people without impairments speak: around 160 words per minute.

We’re now a huge step closer to that goal, according to a draft paper Stanford researchers have shared on the preprint server bioRXiv.

They describe how a person who could no longer speak intelligibly due to ALS was able to communicate at a speed of 62 words per minute, using their in-development speech BCI — more than three times faster than the previous record.

How it works: Rather than asking their study participant, known as “subject T12,” to think about moving her hand or adjusting a tone to produce words, the Stanford researchers asked her to try actually talking.

Over the course of about four months, implanted electrodes recorded the woman’s brain activity while she tried saying phonemes, whole words, or entire sentences shown on a computer screen. This training took place in 2-4 hours sessions about twice a week.

Once they had their training data, correlating brain signals and words, the researchers implemented a word prediction system to increase the accuracy of their speech BCI — this way, if it was trying to decide between multiple words, it would choose the word more likely to follow its predecessors in the context.

“The performance in this paper is already at a level which many people who cannot speak would want.”

Philip Sabes

A new record: To test the system, the woman attempted to say sentences that hadn’t been included in the training set, and the BCI was able to predict her speech at an average speed of 62 words per minute.

When the sentences were constructed using a library of 50 words, the error rate was 9.1%. The previous state-of-the-art BCI designed to translate attempts at speaking into text had a median error rate of 25% on that same library — and a speed of just 18 words per minute.

“The performance in this paper is already at a level which many people who cannot speak would want, if the device were ready,” Philip Sabes, a BCI researcher at UC San Francisco, who was not involved in this study, told MIT Technology Review. “People are going to want this.”

The big picture: The error rate for Standford’s speech BCI was much higher —  23.8% — when the test sentences were constructed using a library of 125,000 words, so the accuracy would need to be improved to give people with anarthria the freedom to say anything.

Even if researchers are able to perfect the software, though, speech BCIs are still extremely experimental, and there are other issues to overcome — over time, scar tissue forms around traditional electrode implants, eventually rendering them useless.

Still, if the Stanford study holds up under peer-review, it represents a major step forward for speech BCIs — putting us closer to a future in which people with anarthria are able to communicate effectively using just their thoughts.

We’d love to hear from you! If you have a comment about this article or if you have a tip for a future Freethink story, please email us at [email protected].

Related
What hybrid mouse/rat brains are showing us about the mind
Modified mice with hybrid brains that include rat neurons could one day lead to new breakthroughs in neuroscience.
How sensory gamma rhythm stimulation clears amyloid in Alzheimer’s mice
Study finds stimulating a brain rhythm with light and sound increases peptide release from interneurons, possibly slowing Alzheimer’s progression.
Brain implant for “artificial vision” is still working after 2 years
A new type of brain implant technology has given a man with total blindness a kind of “artificial vision.”
Why a neurodivergent team will be a golden asset in the AI workplace
Since AI is chained to linear reasoning, workplaces that embrace it will do well to have neurodivergent colleagues who reason more creatively.
In a future with brain-computer interfaces like Elon Musk’s Neuralink, we may need to rethink freedom of thought
In a future with more “mind reading,” thanks to computer-brain interfaces, we may need to rethink freedom of thought.
Up Next
Subscribe to Freethink for more great stories