Skip to main content
Move the World.
deep learning vs machine learning

Lead Image © Andrew Brumagen

Well, you clicked this, so obviously you're interested in some of the finer nuances of artificial intelligence. Little wonder; it's popping up everywhere, taking on applications as far ranging as trying to catch asymptomatic COVID infections via cough, creating maps of wildfires faster, and beating up on esports pros.

It also listens when you ask Alexa or summon Siri, and unlocks your phone with a glance.

But artificial intelligence is an umbrella term, and when we start moving down the specificity chain, things can get confusing — especially when the names are so similar, e.g. deep learning vs. machine learning.

Deep Learning vs. Machine Learning

Let's make that distinction between deep learning vs machine learning; they're pretty closely related. Machine learning is the broader category here, so let's define that first.

 Machine learning is a field of AI wherein the program "learns" via data. It existed on paper in the 1950s and in rudimentary forms by the 1990s, but only recently has the computing power it needs to really shine been available.

That learning data could come from a large set labeled by humans — called a ground truth — or it can be generated by the AI itself.

For example, to train a machine learning algorithm to know what's a cat — you knew the cat was coming — or not you could feed it an immense collection of images, labeled by humans as cats, to act as the ground truth. By churning through it all, the AI learns what makes something a cat and something not, and can then identify it.

The key difference for deep learning vs machine learning is that deep learning is a specific form of machine learning powered by what are called neural nets.

As their name suggests, neural nets are inspired by the human brain. Between your ears, neurons work in concert; a deep learning algorithm does essentially the same thing. It uses multiple layers of neural networks to process the information, delivering, from deep within this complicated system, the output we ask it to.

Take the computer program AlphaGo. By playing the strategy board game Go against itself countless times, AlphaGo developed its own unique playing style. Its technique was so unsettling and alien that during a game against Lee Sedol, the best Go player in the world, it made a move so discombobulating that Sedol had to leave the room. When he returned, he took another 15 minutes to think of his next step.

He has since announced his retirement. "Even if I become the number one, there is an entity that cannot be defeated," Sedol told Yonhap News Agency.

Notice how Sedol called AlphaGo an "entity?" That's because it didn't play like a run-of-the-mill Go program, or even a typical AI. It made itself into something ... else.

Deep learning systems like AlphaGo are, well, deep. And complex. They create programs we really do call entities because they take on a "thinking" pattern that is so complex that we don't know how they arrive at their output. In fact, deep learning is often referred to as a "black box.".

The Black Box Problem

Since deep learning neural nets are so complex, they can actually become too complex to comprehend; we know what we put into the AI, we know what it gave us, but in-between, we don't know how it arrived at that output — that's the black box.

This may not seem too concerning when the AI in question is recognizing your face to open your iPhone, but the stakes are considerably higher when it's recognizing your face for the police. Or when it is trying to determine a medical diagnosis. Or when it is keeping autonomous vehicles safely on the road. While not necessarily dangerous, black boxes pose a problem in that we don't know how the entities are arriving at their decision — and if the medical diagnosis is wrong or the autonomous vehicle goes off the road, we may not know exactly why.

Deep learning uses multiple layers of neural networks to process the information, delivering, from deep within this complicated system, the output we ask it to.

Does this mean we shouldn't use black boxes? Not necessarily. Deep learning experts are divided on how to handle the black box.

Some researchers, like Auburn University computer scientist Anh Nguyen, want to crack open these boxes and figure out what makes deep learning tick. Meanwhile, Duke University computer scientist Cynthia Rudin thinks we should focus on building AI that doesn't have a black box problem in the first place, like more traditional algorithms. Still other computer scientists, like the University of Toronto's Geoff Hinton and Facebook's Yann LeCun, think we shouldn't be worried about black boxes at all. Humans, after all, are black boxes as well.

It's a problem we'll have to wrestle with, because it can't really be avoided; more complex problems require more complex neural nets, which means more black boxes. In deep learning vs machine learning, the former's going to wipe the floor with the later when problems get tough — and it uses that black box to do so.

As Nguyen told me, there's no free lunch when it comes to AI.

Up Next

Uprising
Can Humans Figure Out How Deep Learning AI Thinks?
deep learning ai
Uprising
Can Humans Figure Out How Deep Learning AI Thinks?
Deep learning AI is becoming more complex, capable, and impenetrable, but these scientists are attempting to break the black box.

Deep learning AI is becoming more complex, capable, and impenetrable, but these scientists are attempting to break the black box.

Dope Science
Scientists Can Induce Out-Of-Body Experiences Without Drugs
Scientists Can Induce Out-Of-Body Experiences Without Drugs
Dope Science
Scientists Can Induce Out-Of-Body Experiences Without Drugs
The human brain is a powerful and mysterious place, and researchers have just gotten closer to understanding another important phenomenon taking place inside dissociative experiences.
By Sarah Wells

The human brain is a powerful and mysterious place, and researchers have just gotten closer to understanding another important phenomenon taking place inside dissociative experiences.

Prosthetics
How a Paralympic Swimmer Helps Advance AI Bionic Limbs
morgan stickney
Prosthetics
How a Paralympic Swimmer Helps Advance AI Bionic Limbs
Morgan Stickney shares about her experimental Ewing amputations and training for the 2024 Paralympics.

Morgan Stickney shares about her experimental Ewing amputations and training for the 2024 Paralympics.

Health
“Electronic Nose” Can Detect a Cancer Precursor on Patients’ Breath
electronic nose
Health
“Electronic Nose” Can Detect a Cancer Precursor on Patients’ Breath
A new study found that an electronic nose could be an improved screening tool for Barrett’s esophagus, a precursor to esophageal cancer.

A new study found that an electronic nose could be an improved screening tool for Barrett’s esophagus, a precursor to esophageal cancer.

A New Reality
How to Spot a Deepfake
How to Spot a Deepfake
Watch Now
A New Reality
How to Spot a Deepfake
Is artificial intelligence the key to knowing what’s real?
Watch Now

Deepfake videos use video manipulation to show people saying and doing things they never have. These engineers are using blockchain technology to separate fact from fiction. Deepfakes, fake videos generated using artificial intelligence technology, could be the next frontier in misinformation. While news video has historically been the gold standard of veracity, an era where video can be easily created could further erode...

Coded
The Lawyer Who Defends Anonymous
The Lawyer Who Defends Anonymous
Watch Now
Coded
The Lawyer Who Defends Anonymous
Jay Leiderman isn’t your normal defense attorney. He’s committed his career to defending hackers, including...
Watch Now

Jay Leiderman isn’t your normal defense attorney. He’s committed his career to defending hackers, including Anonymous, the world’s most secretive and famous hacking organization.

On the Cusp
How Virtual Reality is Changing Medicine
How Virtual Reality is Changing Medicine
On the Cusp
How Virtual Reality is Changing Medicine
From virtual hearts to immersive battlefields, doctors and scientists are using virtual reality to transform medicine
By Brandon Stewart

From virtual hearts to immersive battlefields, doctors and scientists are using virtual reality to transform medicine

Coded
How an Exiled Cryptographer is Protecting Journalists in His Native Ethiopia
How an Exiled Cryptographer is Protecting Journalists in His Native Ethiopia
Watch Now
Coded
How an Exiled Cryptographer is Protecting Journalists in His Native Ethiopia
An exiled blogger teaches journalists in his native Ethiopia how to avoid capture
Watch Now

In Ethiopia, the main prison is divided into eight zones. Many refer to the rest of the country as “Zone 9.” But Endalk Chala is fighting back. Chala moonlights as an encryption expert, helping bloggers in his native Ethiopia escape capture and torture.

Superhuman
Three Women Who Changed the Way We Think About Medicine
Three Women Who Changed the Way We Think About Medicine
Superhuman
Three Women Who Changed the Way We Think About Medicine
From newborn health to AIDS treatment to DNA research, these brilliant women paved the way for incredible advances...
By Mike Riggs

From newborn health to AIDS treatment to DNA research, these brilliant women paved the way for incredible advances in the field of medicine.