Facebook's neural wristband could replace keyboards

Controlling AR glasses could one day be as easy as lifting a finger — or thinking about lifting one.

Facebook thinks the future of human-computer interactions may be all in the wrist.

At Facebook Reality Labs (FRL), researchers are developing a neural wristband that allows wearers to control their augmented reality (AR) devices simply by moving their fingers.

The tech is still in the early stages of development, but if brought to fruition, it could forever change the way we interact with our AR devices — and the world around us.

Controlling AR Glasses

Unlike virtual reality headsets, which completely replace the real world with a digital one, AR glasses project a digital layer onto the real world — the wearer still sees everything around them, but they also see computer-generated information.

The applications for AR are wide-ranging — pedestrians can use the tech to project directions onto the real world, while doctors can see surgical guides right on patients’ bodies.

AR controller options, however, are less plentiful. Someone using AR glasses to get directions, for example, usually needs to either enter their destination into a connected device, such as a smartphone, or issue a voice command.

The former option means the user still has to look at a traditional screen at some point, while the latter isn’t ideal if the AR system is being used in public, the office, or anywhere else people might not want or be able to talk aloud to their tech.

Facebook’s neural wristband could do the job instead.

The Neural Wristband

When you make the decision to move a finger, your brain sends an electrical signal to your hand — that signal is what instructs your finger to move exactly how you want it to.

Facebook’s neural wristband contains sensors that detect those electrical signals. It then translates them into commands for AR glasses.

In the future, the neural wristband might be able to sense the user’s intention to move.

Pinching your index finger and thumb together might “click” on the AR display, for example. If wearing a neural wristband on each arm, a person could make the motions of typing on a keyboard and have their text appear on the AR screen.

“This is about decoding (the) signals at the wrist — the actions you’ve already decided to perform — and translating them into digital commands for your device,” Facebook explained in a blog post.

“It’s a much faster way to act on the instructions that you already send to your device when you tap to select a song on your phone, click a mouse, or type on a keyboard today.”

The Future of AR

According to FRL, the technique used to detect the electrical signals — electromyography — is so sensitive, it can record millimeter-sized movements.

Eventually, the researchers believe their neural wristband might be sensitive enough to work without any movement at all — it would sense the intention to move and respond to that.

FRL also imagines augmenting the tech to provide haptic feedback for AR users, too — the wristband could vibrate when a person receives an email, for example.

For now, though, the device is still in the research and development phase, and FRL has said it’s years away from unveiling a consumer-ready product.

However, if the neural wristband can live up to its potential, it could blur the line between the real world and the augmented one almost to the point that it disappears altogether.

We’d love to hear from you! If you have a comment about this article or if you have a tip for a future Freethink story, please email us at [email protected].

New AI will teach soldiers to dress wounds, fly helicopters in AR
DARPA is developing AI assistants that will display instructions to military personnel through augmented reality headsets.
New VR app lets you step inside your smartphone videos 
Early-stage startup Wist Labs is developing a VR app that converts smartphone clips into 3D videos users can step inside.
Magic Leap reveals release date, price for new AR glasses 
Two years after laying off half of its staff, Magic Leap is back with a new pair of AR glasses, the enterprise-focused Magic Leap 2.
AR’s first great use: never get lost again 
The tech behind an AR shopping app helping grocery store customers find items could one day help you navigate airports, museums, and more.
You can “see the future” with these smart contact lenses 
Mojo Vision’s smart contact lens has finally made the leap to human testing, bringing the future of AR a major step closer.
Up Next
ar-assisted knee replacement
Subscribe to Freethink for more great stories