Skip to main content
Move the World.
what is a deepfake

Lead Image © Andrew Brumagen

Deepfakes — feared internet deception du jour — have inspired both amazement and alarm.

What is a deepfake? Essentially, it's really, really good fake data.

Capable of rendering lifelike facsimiles, deepfakes can be used to make videos of essentially anyone saying anything — up to and including, oh, Barack Obama. The implications are awesome, and potentially frightening. 

Deepfakes could be used to create fake stories about politicians, celebrities, scientists — imagine a realistic-enough Fauci imploring us not to take a COVID-19 vaccine.

What is a deepfake? Essentially, it's really, really good fake data.

But deepfakes don't have to be about deception. "Welcome to Chechnya," a film documenting the lives of gay and lesbian Chechens, used deepfakes to protect the anonymity of its sources without scrubbing them of their humanity.

Or the South Park creators can give their fictional TV reporter Donald Trump's face. Just endless possibilities, really.

So, if deepfakes are here to stay, we should learn to understand them — and that starts with the obvious: how are deepfakes made?

The Forger and the Inspector

Deepfakes are made using a type of deep learning AI, called a "generative adversarial network" or GAN. The name says it all: these networks generate an output by pitting two AIs against each other.

Sharon Zhou, a deepfakes instructor at Stanford and Coursera, explains it like this: picture two programs, one for an art forger and the other for an art inspector.

Naturally, the forger is attempting to forge a piece of art, and the inspector is trying to catch the telltale signs. The inspector is shown the real piece of art, as well as the fake, but it doesn't know which is which.

The two AIs then pass the fake back and forth, as the forger tries to tweak the counterfeit until the inspector can't tell the difference between the real and the fake. 

We do need to give the GAN some rules to guide whatever output we want. If I wanted to deepfake a tarantula (for some unfathomable reason), I would give the inspector a list of guardrails: it needs a certain amount of eyes, two fanged chelicerae, eight legs, fur, etc. The more of these parameters I can give the GAN upfront, the better this horrifying deepfake will become. 

Initial rules in hand, the forger sends round after round of hairy hell-spiders to the inspector, whose feedback then informs the forger. 

"The art forger realizes 'oh, you think this one looks realistic?'" Zhou told me. "'I'm gonna keep drawing like this until it looks like Mona Lisa.'" 

(Or, in the tarantula case, my worst nightmare.)

By being locked in battle, the GAN sharpens every output, increasingly deducing what the real McCoy looks like, until the inspector declares that it is real — and what it turns out is usually pretty damn real looking to us, too. 

Deepfakes' True Potential

GANs have a major advantage over CGI or just Photoshopping something.

Pitting two networks against each other allows GANs to rapidly create the most realistic simulated data possible — which is essentially what we're talking about when we're talking about deepfakes.

Once you see it from that frame, the true power of deepfakes comes sharply into relief: GANs can be harnessed to create incredibly realistic artificial data for anything, from Hillary Clinton speeches to particle physics experiments. 

That's a bit of foreshadowing for you.

Up Next

Innovation
How the Technology Behind Deepfakes Can Help Us Create a Better World
How the Technology Behind Deepfakes Can Help Us Create a Better World
Innovation
How the Technology Behind Deepfakes Can Help Us Create a Better World
Deepfakes have ignited fierce media criticism and call into question the public’s ability to discern fact from...
By Jackie Snow

Deepfakes have ignited fierce media criticism and call into question the public’s ability to discern fact from fiction. But the technology behind Deepfakes, called GANs, has enormous potential to drive innovation beyond fake social media videos. Read more to find out some of the amazing things being done with this technology.

Artificial Intelligence
Deep Learning vs. Machine Learning: Explained
deep learning vs machine learning
Artificial Intelligence
Deep Learning vs. Machine Learning: Explained
Deep learning vs. machine learning AI: what’s the difference?

Deep learning vs. machine learning AI: what’s the difference?

Neuroscience
These Brain-Sensing Headphones Could Help You Focus
brain-sensing headphones
Neuroscience
These Brain-Sensing Headphones Could Help You Focus
Boston startup Neurable is now accepting preorders for Enten, brain-sensing headphones that use EEG data to help users’ maximize their focus.

Boston startup Neurable is now accepting preorders for Enten, brain-sensing headphones that use EEG data to help users’ maximize their focus.

Agriculture
A Seaweed Diet Could Eliminate Most of Cows’ Greenhouse Emissions
cows methane emissions
Agriculture
A Seaweed Diet Could Eliminate Most of Cows’ Greenhouse Emissions
Researchers found that feeding dairy cows just a touch of seaweed dramatically lowered the amount of methane emissions they released.

Researchers found that feeding dairy cows just a touch of seaweed dramatically lowered the amount of methane emissions they released.

Vaccines
A New Molecule May Take The Edge Off Vaccines — And Make Them Perform Better
adjuvants
Vaccines
A New Molecule May Take The Edge Off Vaccines — And Make Them Perform Better
Adjuvants create a better vaccine immune response, but they also cause inflammation. A peptide may help curb their side effects while improving protection.

Adjuvants create a better vaccine immune response, but they also cause inflammation. A peptide may help curb their side effects while improving protection.

Public Health
FDA to Begin Testing Chloroquine as Coronavirus Treatment
Chloroquine
Public Health
FDA to Begin Testing Chloroquine as Coronavirus Treatment
The FDA has announced plans to begin testing chloroquine, an anti-malaria drug, as a potential treatment for the novel coronavirus behind COVID-19.

The FDA has announced plans to begin testing chloroquine, an anti-malaria drug, as a potential treatment for the novel coronavirus behind COVID-19.

Uprising
Tree-Planting Drones Restore Charred Forests
tree-planting drones
Uprising
Tree-Planting Drones Restore Charred Forests
This Seattle startup is bringing new life to charred forests by releasing swarms of smart, tree-planting drones equipped with seeds, mini seedbeds, and cameras.

This Seattle startup is bringing new life to charred forests by releasing swarms of smart, tree-planting drones equipped with seeds, mini seedbeds, and cameras.

Coded
Nico Sell on Recruiting Hackers for Good
Nico Sell on Recruiting Hackers for Good
Watch Now
Coded
Nico Sell on Recruiting Hackers for Good
Nico Sell, founder and chairman of the Wickr Foundation, on teaching kids how to hack and encouraging them to use their new-found talents for good.
Watch Now

People often have a bad perception of hackers, conjuring up images of either 20-somethings in their parents’ basement or sophisticated criminals responsible for massive data breaches. Nico Sell, founder and chairman of the Wickr Foundation, wants to change that. She thinks not only are hackers some of the smartest, most creative people around, but also that hacking will prove to be the most powerful tool for our...