ALS Association Supports Mobile App That Tracks Eye Movement to Help Patients

ALS Association Supports Mobile App That Tracks Eye Movement to Help Patients
5
(1)

Computer scientists at Stony Brook University have been awarded $200,000 by the ALS Association to continue the development of a mobile app that helps people with amyotrophic lateral sclerosis (ALS), and others whose mobility has been impaired, to regain some of their independence.

According to a press release, the EyeCanDo app is designed to greatly reduce the burden of ALS for both patients and caregivers, by enabling patients to control smart home devices, write messages, and listen to music, among other things, using only their eyes.

The two-year grant was awarded to professors Xiaojun Bi, PhD, and Fusheng Wang, PhD, who initially developed the application for the 2018 Mount Sinai Medicine Hackathon, along with students at Stony Brook and a local high school student. The app earned them first prize in the competition.

ALS is a condition in which the loss of motor neurons — those controlling voluntary movement — causes patients to progressively lose their ability to move, communicate, and conduct most of their daily activities.

The disease has a significant impact on quality of life, as patients eventually rely on a caregiver for everything, including mundane tasks like turning off the lights. But researchers are aiming to reduce that burden by tracking eye movement, which usually is spared in patients with the ALS.

EyeCanDo is an app for iOS mobile devices that uses Apple’s TrueDepth camera system, the technology behind facial recognition in iPhones and iPads. By creating a detailed 3D map of a user’s face, the technology has the ability to follow eye movement with precise accuracy to see where people are looking on the screen.

By combining this cutting edge technology of eye tracking with a smart home device, the EyeCanDo app  will allow a person with ALS to control multiple features of their homes, such as setting room temperature, turning on a fan, shutting off the television, or turning on the lights.

It also is designed to help patients write and send messages and to listen to music, and includes a text-to-speech feature, overall supporting a broad range of patient and caregiver needs.

Bi and Wang, professors at the Department of Computer Science, believe the app likely will help others with motor impairment and problems in communicating due to underlying diseases such as cerebral palsy, multiple sclerosis, and muscular dystrophy, as well as other problems such as stroke, brain injuries, or spinal cord injury.

Meanwhile, the team will be working to combine human-computer interaction and artificial intelligence technologies to tailor the software to each individual patient depending on their needs, while maintaining high accuracy and stability.

Besides Bi and Wang, others with strong experience in bioinformatics, machine learning, and human-computer interfaces also will participate in the research. Then, clinicians and patients at the ALS Clinic at Stony Brook University Hospital, New York, will be involved in testing and evaluating the upgraded mobile app.

Inês holds a PhD in Biomedical Sciences from the University of Lisbon, Portugal, where she specialized in blood vessel biology, blood stem cells, and cancer. Before that, she studied Cell and Molecular Biology at Universidade Nova de Lisboa and worked as a research fellow at Faculdade de Ciências e Tecnologias and Instituto Gulbenkian de Ciência. Inês currently works as a Managing Science Editor, striving to deliver the latest scientific advances to patient communities in a clear and accurate manner.
Total Posts: 0
Ana holds a PhD in Immunology from the University of Lisbon and worked as a postdoctoral researcher at Instituto de Medicina Molecular (iMM) in Lisbon, Portugal. She graduated with a BSc in Genetics from the University of Newcastle and received a Masters in Biomolecular Archaeology from the University of Manchester, England. After leaving the lab to pursue a career in Science Communication, she served as the Director of Science Communication at iMM.
×
Inês holds a PhD in Biomedical Sciences from the University of Lisbon, Portugal, where she specialized in blood vessel biology, blood stem cells, and cancer. Before that, she studied Cell and Molecular Biology at Universidade Nova de Lisboa and worked as a research fellow at Faculdade de Ciências e Tecnologias and Instituto Gulbenkian de Ciência. Inês currently works as a Managing Science Editor, striving to deliver the latest scientific advances to patient communities in a clear and accurate manner.
Latest Posts
  • CNM-Au8 trial
  • arimoclomol
  • creatinine kinase levels
  • gut microbiota

How useful was this post?

Click on a star to rate it!

Average rating 5 / 5. Vote count: 1

No votes so far! Be the first to rate this post.

As you found this post useful...

Follow us on social media!

We are sorry that this post was not useful for you!

Let us improve this post!

Tell us how we can improve this post?