Skip to main content
Move the World.
deep learning vs machine learning

Lead Image © Andrew Brumagen

Well, you clicked this, so obviously you're interested in some of the finer nuances of artificial intelligence. Little wonder; it's popping up everywhere, taking on applications as far ranging as trying to catch asymptomatic COVID infections via cough, creating maps of wildfires faster, and beating up on esports pros.

It also listens when you ask Alexa or summon Siri, and unlocks your phone with a glance.

But artificial intelligence is an umbrella term, and when we start moving down the specificity chain, things can get confusing — especially when the names are so similar, e.g. deep learning vs. machine learning.

Deep Learning vs. Machine Learning

Let's make that distinction between deep learning vs machine learning; they're pretty closely related. Machine learning is the broader category here, so let's define that first.

 Machine learning is a field of AI wherein the program "learns" via data. It existed on paper in the 1950s and in rudimentary forms by the 1990s, but only recently has the computing power it needs to really shine been available.

That learning data could come from a large set labeled by humans — called a ground truth — or it can be generated by the AI itself.

For example, to train a machine learning algorithm to know what's a cat — you knew the cat was coming — or not you could feed it an immense collection of images, labeled by humans as cats, to act as the ground truth. By churning through it all, the AI learns what makes something a cat and something not, and can then identify it.

The key difference for deep learning vs machine learning is that deep learning is a specific form of machine learning powered by what are called neural nets.

As their name suggests, neural nets are inspired by the human brain. Between your ears, neurons work in concert; a deep learning algorithm does essentially the same thing. It uses multiple layers of neural networks to process the information, delivering, from deep within this complicated system, the output we ask it to.

Take the computer program AlphaGo. By playing the strategy board game Go against itself countless times, AlphaGo developed its own unique playing style. Its technique was so unsettling and alien that during a game against Lee Sedol, the best Go player in the world, it made a move so discombobulating that Sedol had to leave the room. When he returned, he took another 15 minutes to think of his next step.

He has since announced his retirement. "Even if I become the number one, there is an entity that cannot be defeated," Sedol told Yonhap News Agency.

Notice how Sedol called AlphaGo an "entity?" That's because it didn't play like a run-of-the-mill Go program, or even a typical AI. It made itself into something ... else.

Deep learning systems like AlphaGo are, well, deep. And complex. They create programs we really do call entities because they take on a "thinking" pattern that is so complex that we don't know how they arrive at their output. In fact, deep learning is often referred to as a "black box.".

The Black Box Problem

Since deep learning neural nets are so complex, they can actually become too complex to comprehend; we know what we put into the AI, we know what it gave us, but in-between, we don't know how it arrived at that output — that's the black box.

This may not seem too concerning when the AI in question is recognizing your face to open your iPhone, but the stakes are considerably higher when it's recognizing your face for the police. Or when it is trying to determine a medical diagnosis. Or when it is keeping autonomous vehicles safely on the road. While not necessarily dangerous, black boxes pose a problem in that we don't know how the entities are arriving at their decision — and if the medical diagnosis is wrong or the autonomous vehicle goes off the road, we may not know exactly why.

Deep learning uses multiple layers of neural networks to process the information, delivering, from deep within this complicated system, the output we ask it to.

Does this mean we shouldn't use black boxes? Not necessarily. Deep learning experts are divided on how to handle the black box.

Some researchers, like Auburn University computer scientist Anh Nguyen, want to crack open these boxes and figure out what makes deep learning tick. Meanwhile, Duke University computer scientist Cynthia Rudin thinks we should focus on building AI that doesn't have a black box problem in the first place, like more traditional algorithms. Still other computer scientists, like the University of Toronto's Geoff Hinton and Facebook's Yann LeCun, think we shouldn't be worried about black boxes at all. Humans, after all, are black boxes as well.

It's a problem we'll have to wrestle with, because it can't really be avoided; more complex problems require more complex neural nets, which means more black boxes. In deep learning vs machine learning, the former's going to wipe the floor with the later when problems get tough — and it uses that black box to do so.

As Nguyen told me, there's no free lunch when it comes to AI.

Up Next

Uprising
Can Humans Figure Out How Deep Learning AI Thinks?
deep learning ai
Uprising
Can Humans Figure Out How Deep Learning AI Thinks?
Deep learning AI is becoming more complex, capable, and impenetrable, but these scientists are attempting to break the black box.

Deep learning AI is becoming more complex, capable, and impenetrable, but these scientists are attempting to break the black box.

Entertainment
Storm Chasers Explore Hurricane Laura With New Flight Simulator
New Flight Simulator
Entertainment
Storm Chasers Explore Hurricane Laura With New Flight Simulator
Virtual storm chasers are using Microsoft’s new flight simulator to explore Hurricane Laura as it moves across the U.S.

Virtual storm chasers are using Microsoft’s new flight simulator to explore Hurricane Laura as it moves across the U.S.

Robotics
Japan Automates Construction With the First Bot-Built Dam
robots taking over jobs
Robotics
Japan Automates Construction With the First Bot-Built Dam
A Japanese construction company has robots taking over jobs that are understaffed, due to a labor shortage.

A Japanese construction company has robots taking over jobs that are understaffed, due to a labor shortage.

Genetics
Genetic “Off Switch” May Lead to New Breast Cancer Treatment
Breast Cancer Treatment
Genetics
Genetic “Off Switch” May Lead to New Breast Cancer Treatment
A much-needed triple negative breast cancer treatment could center on the suppression of a single gene identified in a new Tulane University study.

A much-needed triple negative breast cancer treatment could center on the suppression of a single gene identified in a new Tulane University study.

Virology
Bats Are Not The Enemy
bat-borne viruses
Virology
Bats Are Not The Enemy
Researchers are developing options from the domestic to the deific to allow humans and bats to live together in...

Researchers are developing options from the domestic to the deific to allow humans and bats to live together in harmony while reducing the risk of viral disease.

Music
This Algorithm Just Generated 68 Billion Unique Melodies
melodies
Music
This Algorithm Just Generated 68 Billion Unique Melodies
Two musicians built an algorithm that could write every melody in the popular music range — and then released the melodies into the public domain.

Two musicians built an algorithm that could write every melody in the popular music range — and then released the melodies into the public domain.

Digital Detectives
Keeper of the Missing
Keeper of the Missing
Watch Now
Digital Detectives
Keeper of the Missing
One woman is tracking thousands of missing people. Autism is her superpower.
Watch Now

Subscribe for More Stories From the Digital Detectives Series Email Subscribe Meaghan Good has made it her life’s mission to track missing people. She runs The Charley Project, an important database compiling information on thousands of missing...

Made With Intel
The Future of Cancer Research
The Future of Cancer Research
Watch Now
Made With Intel
The Future of Cancer Research
Intel's Bryce Olson used genomic sequencing to help fight his cancer. Now he’s helping researchers use artificial intelligence to discover entirely new cancer treatments.
Watch Now

Intel employee Bryce Olson was diagnosed with stage 4 prostate cancer. When the standard of care didn’t work, Bryce turned to genomic sequencing which allowed his doctors to identify specific genetic drivers of his disease and specific treatments and clinical trials that were a fit for his cancer. This precision medicine approach helped send his cancer into remission for several years. Now that his cancer has returned,...

Superhuman
Three Women Who Changed the Way We Think About Medicine
Three Women Who Changed the Way We Think About Medicine
Superhuman
Three Women Who Changed the Way We Think About Medicine
From newborn health to AIDS treatment to DNA research, these brilliant women paved the way for incredible advances...
By Mike Riggs

From newborn health to AIDS treatment to DNA research, these brilliant women paved the way for incredible advances in the field of medicine.