AI is helping to ID victims in Holocaust photos

A new facial recognition website is putting names to faces.

A Google engineer has built a website that uses facial recognition to identify previously anonymous faces in Holocaust photos — and Holocaust survivors and their descendents are using it to find themselves and their relatives in historical archives.

“It’s so important to identify these photos,” Scott Miller, director of curatorial affairs at the US Holocaust Memorial Museum (USHMM), told BBC News. “You’re restoring some semblance of dignity to them, some comfort to their family, and it’s a form of memorial for the entire Jewish community.”

The atrocity: An estimated six million Jewish people were killed during the Holocaust, and the names of about a million of them are still unknown. Another 3.5 million people were displaced, persecuted, or sent to concentration camps during the Holocaust, but managed to survive. 

“Every person has a name, every person has a face.”

Scott Miller

Thousands of photographs and films of Holocaust victims and survivors taken before and during the war have been preserved and archived online, and in physical collections, but many of the faces in the photos have not yet been identified.

“We all know the figure — six million Jews were killed — but it’s really one person six million times,” said Miller. “Every person has a name, every person has a face.”

The inspiration: Daniel Patt, a software engineer for Google, knows the names of at least three Holocaust survivors because they’re his grandparents. 

When he visited the POLIN Museum of the History of Polish Jews in Poland in 2016, he noted how many of the faces in its photo collection were unidentified — he might have walked right past pictures of his own grandparents or other family members and not even known it. 

“I felt like when I was looking at those pictures, I was looking at myself.”

Daniel Patt

That inspired him to create From Numbers to Names (N2N), a website that uses facial recognition tech to identify people in Holocaust photos and videos preserved by the USHMM, Yad Vashem (Israel’s official Holocaust memorial center), and others.

“I felt like when I was looking at those pictures, I was looking at myself,” Patt told the Jewish Standard. “These weren’t people who lived hundreds of years ago — this was 80 years ago. I felt like there was something wrong with not working to identify them and sharing them with their descendants.”

How it works: Anyone can go to the N2N website and upload a photo of a person who experienced the Holocaust. AI-based facial recognition software then searches faces in a database of 500,000 archived Holocaust photos and videos for the 10 best matches for the person in the original photo.

The idea is that a Holocaust survivor or their descendents could use photos they do have to find ones they’ve never seen before.

“We make no software-based assertions about identifications and leave this judgment to individuals using the site,” Patt told the Times of Israel. “We simply show results, with similarity scores, and let individuals decide whether the results contain a positive identification.”

Holocaust survivors can use photos they do have to find ones they’ve never seen before.

Domino effect: If an N2N user does spot themselves or a loved one in a photo, that discovery can then lead to the identification of others in it.

Holocaust survivor Blanche Fixler, for example, used N2N and an old family photograph to find herself in a group photo taken in France during the war — when she saw the new photo, she recognized a boy in it as well as one of her aunts.

Geddy Lee, lead singer of the band Rush, meanwhile, used the platform to find a photo of his deceased mother, a Holocaust survivor, taken when she was a child living in a displaced person’s camp. That led to the discovery of other photos of his mother’s extended family.

Looking ahead: Patt, who is currently working on N2N in his free time, hopes to add another 700,000 Holocaust photos and videos to its searchable database. Eventually, he’d like to see the site contribute to Holocaust eduction.

“Students can use the software to help identify faces and artifacts in photo and video archives and potentially discover new connections between living Holocaust descendants and their ancestors,” he told the Times of Israel.

We’d love to hear from you! If you have a comment about this article or if you have a tip for a future Freethink story, please email us at [email protected].

Related
How three students wrote history by winning the Vesuvius Challenge
Thanks to the Vesuvius Challenge, we may be on the verge of the biggest literary discovery of the ancient world in decades.
AI solves huge problem holding back fusion power
Princeton researchers have trained an AI to predict and prevent a common problem during nuclear fusion reactions.
Watch: Figure’s humanoid robot just learned something new
Robotics startup Figure AI just shared a video showing its humanoid robot completing a fully autonomous “real world task.”
Sam Altman on the future of AI
In the Davos session, “Technology in a Turbulent World,” OpenAI CEO Sam Altman explained where he sees AI heading.
AI for agriculture: How Indian farmers are harvesting innovation
India’s farmers combat climate change, pestilence, and financial burdens, with AI-driven initiatives offering transformative solutions.
Up Next
robot rooms
Subscribe to Freethink for more great stories