Here’s what full-color night vision looks like now

Deep learning AI has accurately created color images from night vision images.

Using deep learning AI, researchers at UC Irvine (go anteaters!) have shown a proof-of-concept for full-color night vision.

Their AI was able to turn three images taken using only infrared light and colorize them pretty close to the scenes’ true colors, Interesting Engineering reports.

“You can imagine this having military applications, or just recreational applications to see at night,” study lead author Andrew Browne, an engineer, surgeon, and vision researcher at UCI, told IEEE Spectrum

“You can also imagine this finding use in chemical processing, where people need to work in places that are sensitive to visible light, or in medical or research situations where one has to work with light-sensitive retinal tissue.”

Using deep learning AI, researchers have created a proof-of-concept for full-color night vision.

Sights unseen: So, you obviously can’t see in the dark, right?

But that’s not always due to a complete lack of light. The human eye can only see a narrow band of the light spectrum, from red to violet; wavelengths outside of that range are invisible to us. 

A sealed room with a lamp blasting infrared light would still look pitch black to the unaided eye.

Which is where infrared night vision comes in.

While our eyes can’t see outside of our visible light spectrum, technology can. Some night vision systems see in infrared light and render it into visible light, usually in one color. 

That color often ends up a sickly, action movie green, because that’s the wavelength our eyes are most sensitive to, the Daily Beast explains. If you want night vision that’s not green, there are ultra-sensitive cameras that can glean and amplify visual light rather than infrared, but using visible light in scientific experiments can damage vulnerable tissues and specimens.

Browne Lab, UC Irvine Department of Ophthalmology

Towards full-color night vision: “This began when I was sitting and thinking, ‘Is there a way to do everything in the dark?’” Browne told Spectrum.

The Irvine researchers turned to training a deep-learning algorithm.

For their proof-of-concept study, published in the journal PLOS One, the team began by taking a bunch of photos of color palettes and faces using monochromatic light sources, both with various visible lights and infrared, Interesting Engineering reports. 

AI looked at all of these labeled images and learned to predict how an infrared image from a night vision camera would look in full color. 

To test it, the AI was shown 20 faces lit only with near-visible infrared light, Spectrum reported, which it successfully reproduced in true, visible-light colors.

Work in progress: Even in this very narrow case, the results weren’t perfect — and importantly, the AI’s predictions are limited to what it’s been taught.

“There is some variability because you can put them side-by-side and see some differences here and there,” Browne told the Daily Beast. “[But they’re] basically indistinguishable like you wouldn’t even know you were looking at a predicted image.”

While far from ready for the battlefield, the tech may eventually have applications beyond the obvious military ones.

While far from ready for the battlefield, the tech will eventually have applications beyond the obvious military ones, Spectrum reports. 

“You can also imagine this finding use in chemical processing, where people need to work in places that are sensitive to visible light, or in medical or research situations where one has to work with light-sensitive retinal tissue.”

We’d love to hear from you! If you have a comment about this article or if you have a tip for a future Freethink story, please email us at [email protected]

Related
Target is now offering the world’s first “robot manicure”
A robot that uses AI and 3D cameras to paint fingernails is now giving Target customers 10-minute manicures for just $8.
Meta can (kinda) guess what you’ve heard via your brain waves 
Meta has created an AI that can tell what you’re hearing based on non-invasive brain scan measurements.
First-of-its-kind trial shows AI beat humans at analyzing heart scans 
Echonet, an AI trained to assess a measure of heart function, has outperformed trained technicians in both accuracy and efficiency.
How AI could learn from Aesop’s fables 
When USC researchers tried to teach an AI simple fables, they discovered that the process is a lot harder than it sounds.
On the road to autonomous cars, driver fatigue will be a problem
New research from Waymo points the way to overcoming driver fatigue in cars that are almost — but not quite — self-driving.
Up Next
Subscribe to Freethink for more great stories