On Equal Terms

At the latest Apple conference, the company introduced a new technology enabling device control via eye movement. While this may sound like science fiction, for many people, it is a groundbreaking opportunity to interact with technology on equal terms.

We have become accustomed to using computers with a mouse and keyboard, and phones via touch. These interactions are second nature to us because both devices display content on a screen, allowing for visual interaction. However, not everyone has the same opportunities, and for many, standard interaction methods are not accessible.

If we don't use a monitor, how can we display content for the user? How can we select an option on a phone screen if we cannot touch it? There are many tools available to support users in everyday tasks, even when they are unable to use traditional interaction methods.

Screen readers are one of the most important accessibility tools. They are not only for people who are blind; they can benefit a wide range of users with various needs. Screen readers are available across most platforms, from operating systems (Windows, macOS, Android) to gaming consoles and apps. These tools read aloud the text displayed on the screen, enabling blind and low-vision individuals to use technology just like others.

An example of advanced screen reader usage is the game The Last of Us, which has received high praise for its accessibility features, allowing blind individuals to play and experience the story independently. In The Last of Us, the screen reader not only reads text but also describes cutscenes and suggests what is happening on screen. Additionally, the game controller, through vibrations, informs the player about the type of surface they are moving on and any nearby obstacles.

Eye-tracking technology allows users to control computers through eye movement. A user can move the cursor, select options on the screen, and even type by focusing their gaze on the corresponding interface elements. This is especially helpful for individuals with motor disabilities who find it difficult to use traditional interaction methods like a keyboard or mouse.

At the recent conference, Apple introduced an eye-tracking functionality that significantly expands interaction possibilities. With this technology, users will be able to fully control their iPhones and iPads using eye movement. Apple has implemented advanced algorithms and sensors that accurately track the point of gaze, allowing for intuitive and precise control.

This new eye-tracking feature from Apple not only enables cursor movement but also allows for app selection, webpage scrolling, and text input by focusing on the appropriate keys of a virtual keyboard. Integrated with iOS, users can use this feature across all apps, providing a consistent and seamless experience.

For many, using a keyboard and mouse is the natural way to interact with a computer. However, for those with mobility limitations, such traditional methods may be insufficient or even impossible. Juan Carlos Vega, founder and CEO of Augmental, is one of those who decided to change how people with mobility impairments interact with technology.

Aware of his own physical limitations, Vega was inspired by the concept of augmenting human capabilities. He began programming at the age of 12 and helped people with disabilities, including those with mobility impairments and multiple sclerosis, during high school. While studying at the University of California, Berkeley, and later at MIT, Vega worked on technologies that assist people with disabilities in leading independent lives.

One of Augmental's products, MouthPad, allows users to control a computer, smartphone, or tablet through tongue and head movements. The pressure-sensitive pad, located on the palate, translates tongue and head movements into real-time cursor scrolling and clicking via Bluetooth technology.

Some Augmental users, such as those living with quadriplegia, use MouthPad daily to independently interact with their favorite devices. One user, a student studying mathematics and computer science, says the device helps her write mathematical formulas and study in the library.

Vega emphasizes that Augmental's goal is to enhance the accessibility of technology, which has become an integral part of our lives. Through innovations like MouthPad, Augmental aims to ensure that individuals with mobility impairments can be as competent in using mobile phones or tablets as those who use their hands.

Accessibility technology not only makes life easier for individuals with disabilities but also promotes equality and social inclusion. We are on the right track to creating a world where everyone, regardless of their limitations, has equal opportunities to benefit from technological achievements. Software and hardware developers must continue to ensure their products are accessible to all users, supporting their individual needs and promoting inclusivity at every step.

References:

• Mouth-based touchpad enables people living with paralysis to interact with computers | MIT News | Massachusetts Institute of Technology
  
• The Last of Us Part I full list of accessibility features
• Apple announces new accessibility features, including eye-tracking
• Mouth-based touchpad enables people living with paralysis to interact with computers | MIT News