Skip to main content
Move the World.
drawing ai

Image © OpenAI

OpenAI has just introduced two new machine learning algorithms that improve computer vision and can use text cues to draw unique and often offbeat images — like a dog-walking radish wearing a tutu.

Even though it is still a long way from replacing the discerning human eye, it shows that creative AI is gaining momentum. 

What They Do

Like GPT-3 (the OpenAI text generator), DALL-E, a neural network model, aims to "think" like humans.

DALL-E's training uses images and associated text prompts. Then, based on what it's learned, it responds to a text prompt like "an armchair in the shape of an avocado."

Instead of responding with words, the AI responds by creating hundreds of pictures. Then CLIP (another new neural network) ranks them to find the best few dozen. And, surprisingly, the images often appear genuine, as if a human made them.

For example, a prompt that says "storefront with that has the word openai written on it," will generate an image like this:

drawing ai

Credit: OpenAI

Or "an armchair in the shape of an avocado" will prompt the following image:

drawing ai

Credit: OpenAI

"Last year, we were able to make substantial progress on text with GPT-3, but the thing is that the world isn't just built on text," Ilya Sutskever, OpenAI co-founder and chief scientist, reports to Axios. "This is a step towards the grander goal of building a neural network that can work in both images and text."

Why It Matters

These new models are the next step toward achieving machine learning algorithms that can carry out tasks that have real-world value, while promising to show general human intelligence — sort of.

But it's more than just a whimsical way to make cute pictures — like "an illustration of a baby daikon radish in a tutu walking a dog," — the machine learning algorithm's advantage is efficiency.

drawing ai

Credit: OpenAI

Training a new model can take a lot of computer power, but Sutskever, according to Axios, says that CLIP improves existing computer vision techniques with less computational cost.

So, Are AIs Going to Take Over?

GPT-3 is the third generation of autocomplete tools designed by OpenAI. It looks for patterns in large amounts of data and then predicts what words should come after a text prompt. A simple example is if you input "fire," it might add "truck" or "alarm."

But OpenAI claims that GPT-3 can do more than that — even write full essays or poems.

When it was first released in June 2020, the media was buzzing about its capabilities. GPT-3 could be an important step toward a future where AI can exhibit a human-like ability to reason. But it also attracted criticism because the text it generated sometimes appeared to be unhinged from reality.

While DALL-E is one small step for artificial intelligence — inching toward achieving human creativity's likeness — it is still far from perfect. It still needs input from a grammar expert, as poorly worded phrases result in fumbled pictures.

We'd love to hear from you! If you have a comment about this article or if you have a tip for a future Freethink story, please email us at [email protected]

Up Next

The Brain
Researchers Have Built a Mini-Lab for Mini-Brains
brain organoids
The Brain
Researchers Have Built a Mini-Lab for Mini-Brains
Researchers have created a “tiny machine” to better study brain organoids, clumps of stem cells that simulate the brain.

Researchers have created a “tiny machine” to better study brain organoids, clumps of stem cells that simulate the brain.

The Future Explored
This Canadian Startup Wants to Make Our Buildings Out of CO2
carbon capturing
The Future Explored
This Canadian Startup Wants to Make Our Buildings Out of CO2
Carbon capture technology is here, but how do we make it feasible?

Carbon capture technology is here, but how do we make it feasible?

Vaccines
The Future of Vaccines May Be Injectable Gels
The Future of Vaccines May Be Injectable Gels
Vaccines
The Future of Vaccines May Be Injectable Gels
Scientists have designed a slow-releasing vaccine that can more accurately match the timeframe of a natural infection.
By Sarah Wells

Scientists have designed a slow-releasing vaccine that can more accurately match the timeframe of a natural infection.

Future of Medicine
New Drug Could Provide Long-Term HIV Prevention
hiv prevention
Future of Medicine
New Drug Could Provide Long-Term HIV Prevention
HIV prevention typically requires a daily pill. A new, injectable drug may be able to work for over a month at a time.

HIV prevention typically requires a daily pill. A new, injectable drug may be able to work for over a month at a time.

Medical Breakthroughs
AI Beats Neurologists at Making Alzheimer's Diagnosis
Alzheimer's Diagnosis
Medical Breakthroughs
AI Beats Neurologists at Making Alzheimer's Diagnosis
Scientists have created an AI capable of making an Alzheimer’s diagnosis that’s more accurate than the one delivered by a group of neurologists.

Scientists have created an AI capable of making an Alzheimer’s diagnosis that’s more accurate than the one delivered by a group of neurologists.

Dispatches
AI Will Make You Smarter
AI Will Make You Smarter
Dispatches
AI Will Make You Smarter
Artificial intelligence will multiply your own intelligence, in ways that will surprise you.
By Terrence Sejnowski

Artificial intelligence will multiply your own intelligence, in ways that will surprise you.

The New Space Race
The Market for Tiny Satellites Is Going to Be Huge
The Market for Tiny Satellites Is Going to Be Huge
The New Space Race
The Market for Tiny Satellites Is Going to Be Huge
Fleets of small satellites can gather far more accurate and timely data than conventional satellites. And investors...
By Mike Riggs

Fleets of small satellites can gather far more accurate and timely data than conventional satellites. And investors are taking notice.

Science
Could Your Brain Regenerate Like Skin?
Could Your Brain Regenerate Like Skin?
Science
Could Your Brain Regenerate Like Skin?
Brain regeneration used to be considered a medical fantasy. But research shows that fantasy could eventually become...
By Levi Gadye

Brain regeneration used to be considered a medical fantasy. But research shows that fantasy could eventually become a reality.