Skip to main content
Move the World.
gait recognition

Lead Image © andreusK / Adobe Stock

A bank robbery is caught on a video surveillance system: the suspect — face obscured — walks calmly out of the bank, cash in his bag and a stunned teller in his wake. Law enforcement believes they have located the suspect, but with no way to recognize his face, they cannot be sure.

Before they risk a raid, the officers use the WiFi signals coming from inside the house, like radar, to “see” the suspect moving around. Using gait recognition technology, they match his specific movements to his known walk from the robbery footage and move in for the arrest.

This scenario is not too sci fi — although it is a bit scary; more on that later — and the tech is nearly ready for use. University of California, Santa Barbara researcher Yasamin Mostofi’s lab has already demonstrated it.

“Our proposed approach makes it possible to determine if the person behind the wall is the same as the one in video footage, using only a pair of off-the-shelf WiFi transceivers outside.”

Yasamin MostofiResearcher at UC Santa Barbara

Radio frequency waves, including WiFi, bounce off of and are obscured by objects in their path, including people. These ripples can be used to identify if something or someone is in the way of the radio waves. Mostofi’s lab has already used this technique to accurately estimate the number of people in a room from outside of the room.

These disruptions in the waves are specific to the individuals’ size, shape, and, in this instance, motion.

Using WiFi signals and video footage, Mostofi’s lab achieved gait recognition with over 80% accuracy on a sample of eight subjects. Called the XModal-ID, the identification system recognized the gaits captured on WiFi through both plywood and drywall.

A “candidate video” provides the researchers with the gait information they need. People move in unique ways. These movements are captured by a computer program, which simulates how they would disrupt the WiFi signal. Using this template, the researchers then use WiFi transceivers to see if the disruptions match the template.

“Our proposed approach makes it possible to determine if the person behind the wall is the same as the one in video footage, using only a pair of off-the-shelf WiFi transceivers outside,” Mostofi tells UCSB’s The Current.

A Look at Gait Recognition in the Real World

There are potential uses of gait recognition beyond the obvious security applications. A system could turn the thermostat to a certain worker’s temperature preference when they walk into the room, or make true the dream of a personalized professional wrestling-style entrance song, which would be, quite frankly, awesome.

The work is possible because WiFi and radio frequency data is so richly tracked and measured, says Neal Patwari, who is not involved in Mostofi’s research. A professor at Washington University in St. Louis and Director of Research at Xandem Technology, Patwari researches using radio frequency (RF) signals for imaging and movement mapping, called RF tomography.

It’s a double-edged sword. Those same advantages mean it’s possible for bad actors to use normal devices to set up an RF surveillance system that the victim would be completely unaware of.

Society is drowning in various radio frequencies, which allows researchers like Mostofi and Patwari to develop surveillance systems and sensors. RF based systems present a couple of advantages to traditional surveillance systems, as well as some singularly dystopian possibilities.

They cover large areas of space and, as demonstrated by Mostofi, can “see through” obstructions, including walls. Some materials are trickier than others, Patwari says. Plywood and drywall are practically no hindrance, whereas concrete causes severe degradation and metal is impossible to see through at all. Since these systems, gait recognition included, can run on off-the-shelf technology, they do not require a large investment. And since they operate purely on radio frequencies, they are appropriate to use in situations where a video camera would not be (no more evading a security system by hiding in the bathroom).

It’s a double-edged sword, however. Those same advantages mean it’s possible for bad actors to use normal and commonplace devices to set up an RF surveillance system that the victim would be completely unaware of. As gait recognition technology improves, these secret sensors could even identify specific victims. It does not take much imagination to leap to spies and secret police, cloaks and daggers, jackboots and truncheons.

“That is definitely a good point,” Patwari says. “From the research perspective, one of the big challenges we have is to build next generation protocols and networks that can prevent this.”

While radio frequency jamming devices already exist, they are both illegal to operate in the U.S. and would disrupt other signals as well. Meaning no Hulu or Tinder, too (a sacrifice too great for some).

Up Next

Future of Medicine
Unlocking the Mysteries of Muscles in Motion
Unlocking the Mysteries of Muscles in Motion
Future of Medicine
Unlocking the Mysteries of Muscles in Motion
New kirigami-inspired skin patch may help people avoid injury, as it expands our understanding of muscle activity.
By Caroline Delbert

New kirigami-inspired skin patch may help people avoid injury, as it expands our understanding of muscle activity.

A New Reality
How to Spot a Deepfake
How to Spot a Deepfake
Watch Now
A New Reality
How to Spot a Deepfake
Is artificial intelligence the key to knowing what’s real?
Watch Now

Deepfake videos use video manipulation to show people saying and doing things they never have. These engineers are using blockchain technology to separate fact from fiction. Deepfakes, fake videos generated using artificial intelligence technology, could be the next frontier in misinformation. While news video has historically been the gold standard of veracity, an era where video can be easily created could further erode...

INTEL
Bringing Virtual Reality to Brain Surgery
Bringing Virtual Reality to Brain Surgery
Watch Now
INTEL
Bringing Virtual Reality to Brain Surgery
Virtual reality is helping surgeons and patients prepare for complicated, life-saving surgeries in ways never before possible.
Watch Now

Brain surgery is never easy -- for the doctor or the patient. Now, virtual reality is changing the game. Surgical Theater has created a revolutionary new tool, powered by Intel technology, that allows surgeons and patients to prepare for complicated new surgeries in ways never before possible. Surgeons have previously had to rely on 2D images and their imagination to visualize a surgery, but now they are able to use 3D, VR...

Dispatches
Can DIY Science (Finally) Cut the Cost of Insulin?
Can DIY Science (Finally) Cut the Cost of Insulin?
Dispatches
Can DIY Science (Finally) Cut the Cost of Insulin?
A century after its discovery, insulin is still incredibly expensive, but DIY bio-manufacturing could change that...

A century after its discovery, insulin is still incredibly expensive, but DIY bio-manufacturing could change that in a big way.

Using Fashion to Fool Facial Recognition
Using Fashion to Fool Facial Recognition
Watch Now
Using Fashion to Fool Facial Recognition
Facial recognition software is everywhere - and being used for surveillance. One fashion designer is coming up with looks that fool the software.
Watch Now

With the use of facial recognition technology on the rise, privacy advocates are increasingly concerned about the potential for misuse. Artist Adam Harvey is working to show how fashion can be used to fool facial recognition technology. His most recent project, CV Dazzle, is a scarf with fabric that looks like camouflage but contains elements that mimic a human face. These elements can successfully confuse the software...

Coded
The People’s NSA
The People’s NSA
Watch Now
Coded
The People’s NSA
Hackers and journalists team up to expose crime and corruption around the world
Watch Now

At an undisclosed location in Sarajevo, a group of hackers are working with journalists to expose organized crime and corruption. But those engaged in illicit activity respond with cyber attacks and other intimidation tactics. Can the group fight off the attacks and help journalists bring the truth to light?

Science
What to Expect In a Post-Meat Future
What to Expect In a Post-Meat Future
Science
What to Expect In a Post-Meat Future
From advanced plant-based meat alternatives to real meat grown in a lab, the days of eating meat from once-living...
By Mike Riggs

From advanced plant-based meat alternatives to real meat grown in a lab, the days of eating meat from once-living animals could be numbered.