Scientists at the University of California, San Francisco have developed a bilingual brain implant that uses artificial intelligence to help a stroke survivor communicate in Spanish and English for the first time.
Nearly a dozen scientists from the university’s Center for Neural Engineering and Prostheses have worked for several years to design a decoding system that could turn the man’s brain activity into sentences in both languages and display them on a screen.
An article published May 20 in Nature Biomedical Engineering outlining their research identifies the man as Pancho. At age 20, he became severely paralyzed as a result of a stroke he had in the early 2000s. Pancho can moan and grunt but he can’t articulate clear words. He is a native Spanish speaker who learned English as an adult.
Under the leadership of Dr. Edward Chang, a neurosurgeon who serves as co-director of the Center for Neural Engineering and Prostheses, Pancho received a neural implant in February 2019, allowing scientists to start tracking his brain activity.
By using an AI method known as a neural network, researchers were able to train Pancho’s implant to decode words based on the brain activity produced when he attempted to articulate them. This AI training method basically allows the brain implant, known scientifically as a brain-computer interface device, to process data in a way that is somewhat similar to the human brain.
By 2021, the technology had significantly helped restore Pancho’s ability to communicate, but only in English.
“Speech decoding has primarily been shown for monolinguals but half the world is bilingual with each language contributing to a person’s personality and worldview,” Chang’s research group said on X. “There is a need to develop decoders that let bilinguals communicate with both languages. ”
However, the 2021 research served as the foundation to develop the decoding system that later made Pancho’s brain implant bilingual in Spanish and English.
Allowing a language switch based on preference
After discovering that Pancho’s brain had “cortical activity” across both languages years after he became paralyzed, the scientists realized they could leverage that to train a bilingual brain implant without the need to train separate language-specific decoding systems.
Industry Leaders are Raising Alarm: Artificial intelligence Poses ‘Risk of Extinction
Write a Reply or Comment
You should Sign In or Sign Up account to post comment.