Man controls Alexa with thoughts via brain-computer interface
ALS patient, part of clinical trial, also controlled Apple Vision Pro
A man with amyotrophic lateral sclerosis (ALS) recently became the first person to control an Amazon Alexa device with his thoughts, via an investigational, implanted brain-computer interface (BCI) from Synchron.
The 64-year-old man, identified in a Synchron press release as Mark, lost the function of his upper limbs due to ALS. He was implanted with the BCI as part of a clinical trial. While control of Alexa devices typically involves the ability to tap a screen or speak, Mark is able to use his thoughts to directly control his smart home via the Tap to Alexa feature on an Amazon Fire tablet, Synchron said.
“The integration with smart technology and my BCI is something I’m really excited about,” Mark said. “It’s hard to imagine living in our modern world without the ability to access or control connected devices … that are so prevalent in my daily life. To be able to manage important aspects of my environment and control access to entertainment gives me back the independence that I’m losing.”
Alexa is a cloud-based assistant that enables individuals to control compatible smart devices in their homes using voice commands. It can also be controlled by tapping on-screen tiles on certain compatible tablet devices via the Tap to Alexa feature. By pairing its BCI to Alexa, Synchron aims to enable patients like Mark to use this feature without the need to tap or speak.
The brain computer interface uses the company’s Stentrode technology, a small, tube-like device containing multiple electrodes that’s implanted on the surface of the motor cortex, a brain region involved in voluntary movement. Implantation involves a minimally invasive surgical procedure through which the device is inserted via a small neck incision and then moved through the jugular vein to a blood vessel close to the motor cortex.
Electrical signals bypass need for muscles
Once implanted, the BCI can record electrical signals in the brain and translate them into signals that a computer can understand. This allows a person’s thoughts about intended movements, like tapping on a tablet, to translate into an actionable output while bypassing the need for actual muscle movement.
“While many smart home systems rely on voice or touch, we are sending control signals directly from the brain, bypassing the need for these inputs,” said Tom Oxley, CEO and founder of Synchron.
Synchron’s ultimate goal is to allow patients with significant paralysis the ability to perform everyday activities more independently.
Mark can use his thoughts to select customized tiles on his Amazon Fire tablet that will perform preset actions like turning lights on or off, making video calls, playing music and shows, reading on Kindle, purchasing items on Amazon, and controlling other smart-home devices.
Synchron’s aim is that patients will eventually be able to use the technology to interact with a wider range of Alexa-compatible devices, such as thermostats and cameras.
Last month, Mark became the first person to use his thoughts to control an Apple Vision Pro, through which he could play Solitaire, watch Apple TV, and send text messages.
“Synchron’s BCI is bridging the gap between neurotechnology and consumer tech, making it possible for people with paralysis to regain control of their environment,” Oxley said. “We’re thrilled to utilize our BCI to access Alexa capabilities, so patients can interact with devices in their home hands and voice-free, using only their thoughts, to address a critical unmet need for millions of people with mobility and voice impairment.”
Synchron conducted a clinical trial (NCT03834857) in Australia involving four men with paralysis due to ALS. Within a few months of being implanted with the BCI, patients were able to control a computer with their thoughts and complete tasks such as texting, emailing, and shopping.
About the Author
