Skip to main content
Move the World.
drawing ai

Image © OpenAI

OpenAI has just introduced two new machine learning algorithms that improve computer vision and can use text cues to draw unique and often offbeat images — like a dog-walking radish wearing a tutu.

Even though it is still a long way from replacing the discerning human eye, it shows that creative AI is gaining momentum. 

What They Do

Like GPT-3 (the OpenAI text generator), DALL-E, a neural network model, aims to "think" like humans.

DALL-E's training uses images and associated text prompts. Then, based on what it's learned, it responds to a text prompt like "an armchair in the shape of an avocado."

Instead of responding with words, the AI responds by creating hundreds of pictures. Then CLIP (another new neural network) ranks them to find the best few dozen. And, surprisingly, the images often appear genuine, as if a human made them.

For example, a prompt that says "storefront with that has the word openai written on it," will generate an image like this:

drawing ai

Credit: OpenAI

Or "an armchair in the shape of an avocado" will prompt the following image:

drawing ai

Credit: OpenAI

"Last year, we were able to make substantial progress on text with GPT-3, but the thing is that the world isn't just built on text," Ilya Sutskever, OpenAI co-founder and chief scientist, reports to Axios. "This is a step towards the grander goal of building a neural network that can work in both images and text."

Why It Matters

These new models are the next step toward achieving machine learning algorithms that can carry out tasks that have real-world value, while promising to show general human intelligence — sort of.

But it's more than just a whimsical way to make cute pictures — like "an illustration of a baby daikon radish in a tutu walking a dog," — the machine learning algorithm's advantage is efficiency.

drawing ai

Credit: OpenAI

Training a new model can take a lot of computer power, but Sutskever, according to Axios, says that CLIP improves existing computer vision techniques with less computational cost.

So, Are AIs Going to Take Over?

GPT-3 is the third generation of autocomplete tools designed by OpenAI. It looks for patterns in large amounts of data and then predicts what words should come after a text prompt. A simple example is if you input "fire," it might add "truck" or "alarm."

But OpenAI claims that GPT-3 can do more than that — even write full essays or poems.

When it was first released in June 2020, the media was buzzing about its capabilities. GPT-3 could be an important step toward a future where AI can exhibit a human-like ability to reason. But it also attracted criticism because the text it generated sometimes appeared to be unhinged from reality.

While DALL-E is one small step for artificial intelligence — inching toward achieving human creativity's likeness — it is still far from perfect. It still needs input from a grammar expert, as poorly worded phrases result in fumbled pictures.

We'd love to hear from you! If you have a comment about this article or if you have a tip for a future Freethink story, please email us at [email protected]

Up Next

Dope Science
Scientists Can Induce Out-Of-Body Experiences Without Drugs
Scientists Can Induce Out-Of-Body Experiences Without Drugs
Dope Science
Scientists Can Induce Out-Of-Body Experiences Without Drugs
The human brain is a powerful and mysterious place, and researchers have just gotten closer to understanding another important phenomenon taking place inside dissociative experiences.
By Sarah Wells

The human brain is a powerful and mysterious place, and researchers have just gotten closer to understanding another important phenomenon taking place inside dissociative experiences.

Uprising
Robot Bees Could One Day Save Your Life
robot bees
Uprising
Robot Bees Could One Day Save Your Life
For the first time, a microbot powered by soft actuators has achieved controlled flight.

For the first time, a microbot powered by soft actuators has achieved controlled flight.

Science
Scientists Grew a Mini Brain in a Lab. It Has Human-Like Brain Waves.
Scientists Grew a Mini Brain in a Lab. It Has Human-Like Brain Waves.
Science
Scientists Grew a Mini Brain in a Lab. It Has Human-Like Brain Waves.
For the first time, a lab-grown mini brain has brain waves. Researchers can now launch new ways to study brain disorders. But the question of consciousness in the brain-like organoid could raise concern.

For the first time, a lab-grown mini brain has brain waves. Researchers can now launch new ways to study brain disorders. But the question of consciousness in the brain-like organoid could raise concern.

Dispatches
What We Learned from a Decade of Commercial Space Travel
What We Learned from a Decade of Commercial Space Travel
Dispatches
What We Learned from a Decade of Commercial Space Travel
Businesses have gotten to space; now what?
By Joel Wooten

Businesses have gotten to space; now what?

Dispatches
The Gut Microbiome Affects Brain Structure
The Gut Microbiome Affects Brain Structure
Dispatches
The Gut Microbiome Affects Brain Structure
What happens in your gut in childhood can change how your brain works later in life.

What happens in your gut in childhood can change how your brain works later in life.

Wrong
Beware the Frankenbabies!
Beware the Frankenbabies!
Watch Now
Wrong
Beware the Frankenbabies!
Frightening predictions almost stopped the invention that has helped millions of families.
Watch Now

As scientists began to develop in-vitro fertilization in the ‘70s for parents struggling to have a baby, experts and media piled on with frightening predictions that almost stopped the invention that has helped millions of families today dead in its track.

Superhuman
Meet the Paralyzed Man Who Can Walk Again
Meet the Paralyzed Man Who Can Walk Again
Superhuman
Meet the Paralyzed Man Who Can Walk Again
Robert is paralyzed from the chest down. But now a robotic exoskeleton is giving him what he calls "a second chance...
By Mike Riggs

Robert is paralyzed from the chest down. But now a robotic exoskeleton is giving him what he calls "a second chance at life."

Science
How to Rebuild a Broken Brain
How to Rebuild a Broken Brain
Science
How to Rebuild a Broken Brain
The unbelievable story of the day Jordan Riley was declared brain dead and his journey of re-learning how to be human.
By Mike Riggs

The unbelievable story of the day Jordan Riley was declared brain dead and his journey of re-learning how to be human.