DALL-E 2 by OpenAI: How to Create Digital Art in a Few Seconds


What Is DALL·E 2?

DALL-E 2 is a type of generative artificial intelligence (AI) that produces images from text. These generated images can look like drawings, paintings, and photos created by humans.

To use DALL-E 2, a user types in a sentence (a text prompt) describing a visual scene. Then the software creates a relevant graphic instantly.

For example, the tool generated four images for the prompt “3D render a diver meeting a sea turtle in the ocean.”

DALL-E results for “3D render a diver meeting a sea turtle in the ocean” prompt

Fun fact: The name of DALL-E is a mix of Pixar’s WALL-E movie and artist Salvador Dali.

When its creators updated the way the software generates images, they changed its name to DALL-E 2.

How Does DALL-E 2 Work?

DALL-E 2’s trainers “showed” the software millions of images (all with associated meanings) from all over the web.

The art generator refers to this dataset when given a prompt and then uses statistical patterns to create its own.

DALL-E 2 relies on a computer program called a diffusion model

A diffusion model analyzes images to learn the underlying patterns and features of each part:

an example of an image analyzed by a diffusion model

Then it can use these pieces to recreate its own original, AI-generated images.

For example, DALL-E has analyzed thousands of images of cats and birds. Which is why it recognizes that cats have pointy ears and whiskers while birds have beaks and wings.

So if a user asks for AI art that includes a cat, DALL-E can replicate what it thinks a cat looks like.

For example, here are the results for the prompt, “A realistic photo of a cat with a bird’s wings.”

DALL-E results for “A realistic photo of a cat with a bird’s wings” prompt

Now that you know the basics, let’s generate some images.

How to Use OpenAI’s DALL-E 2 to Generate Compelling Digital Art

To use DALL-E 2’s image creator, set up an account on OpenAI and generate your first graphic.

Want to align them better with your expectations? 

Work on your prompts, edit your graphics, and discover what DALL-E struggles with.

Set Up an Account on OpenAI

To sign up for an account, go to chat.openai.com and click “Sign up.”

chat.openai.com homepage

Then, follow the prompts to create and verify your account.

With the original DALL-E, new users got 50 free credits when they set up a new account. Plus an extra 15 to use every month.

Unfortunately, those perks only apply to users who signed up for the AI system before April 6, 2023. 

Now, you have to buy 115 credits for $15 to try it out.

Take Note of DALL-E 2’s Image Generation Guidelines

Before you use your account, take note of DALL-E 2’s content policy.

Here are a few examples of images you can’t create, upload, or share:

a section from DALL-E 2’s content policy

OpenAI also encourages users to share that AI was involved in your work. You can remove the DALL-E signature, but you can’t say it was entirely human-generated.

You are also not allowed to:

  • Upload images of anyone without their consent
  • Upload images you do not own the rights to
  • Create images of celebrities and public figures

Breaking these rules can get you banned. 

Find Out What Content You Need for Your Marketing

Look at your website, blog posts, and social media platforms. Then decide which kind of images will help to promote different aspects.

Let’s say you run an online candy store.

You may have landing pages that categorize different types of candy you sell. For example, chocolate, fudge, gummies, and vegan candy.

You already have your product shots for these. But they don’t stand out from any other candy shop.

Instead, you want more arty, whimsical images. 

For example, a cartoon drawing of a lollipop in space:

four cartoon drawings of a lollipop in space

DALL-E 2 can create these kinds of images in a few seconds.

To decide what you need, break down your marketing channels.

You may already have:

  • A website with landing pages for each category of candy
  • An Instagram and Facebook account where you ask for feedback on new products
  • A blog where you write about the “top 10 types” of each candy
  • An email marketing newsletter where you promote monthly deals
  • A scheduled social media post to promote your event or products

Note your channels and which upcoming pages you need images for. Including older posts you want to refresh with new content.

Pro tip: If you need to create social media content (images or videos with a caption), then check out Semrush’s AI Social Content Generator.

AI Social Content Generator
"What do you want to make?" page in AI Social Content Generator offers various content type templates

Simply provide the following information:

  • The post topic
  • The language the post should be in
  • Your brand logo, colors, and preferred font
creating a new post in AI Social Content Generator

And the tool will generate entire social media posts for you. Including the caption, image, carousel, or video.

examples of ready social media posts from "Content Library"

Once you have your list of channels, move on to the next step.

Generate Your First Generated Image (+ Prompts)

Head to DALL-E 2’s landing page. Then type a detailed description (a prompt) into the text box and click “Generate.” 

DALL-E 2’s text box

There will be a short loading time. 

Then the software will generate several variations of AI images that it thinks match your prompt.

Let’s try to create an image to promote your candy store’s new “Day at the Fairground” treats on social media.

Note: DALL-E 2 is faster than the original version and offers variations of higher-resolution images.

Here are four generated images for the prompt, “A blue elephant made of candy floss flying above a fairground.” 

DALL-E results for “A blue elephant made of candy floss flying above a fairground” prompt

Not exactly how you pictured? Add a few more details to the prompt box and click “Generate.”

DALL-E 2 suggests adding a style to improve the quality of results.

Let’s add “a painting of” before the original prompt:

DALL-E results for “a painting of a blue elephant made of candy floss flying above a fairground” prompt

The fairground is now more accurate. But the candy floss texture of the elephant is gone.

Keep tweaking your prompt until you get the results you want. After all, more detail usually means more accurate graphics.

For example, DALL-E 2 suggests that you can get more specific by adding an artistic style or your favorite artist.

Here are a few variations of “An oil painting of a single coconut tree on an island surrounded by water:”

DALL-E results for “An oil painting of a single coconut tree on an island surrounded by water” prompt

But more detail isn’t always better.

These images started with the prompt “A happy mushroom skipping through a meadow:”

image results for “A happy mushroom skipping through a meadow” prompt

But in this case, adding “with legs and a face” lowered the quality.

image results for “A happy mushroom skipping through a meadow with legs and a face” prompt

Here were two variations for “A tiger climbing a tree in the jungle with a monkey sitting on a branch eating an apple, pixel art:”

two image results for “A tiger climbing a tree in the jungle with a monkey sitting on a branch eating an apple, pixel art” prompt

DALL-E 2 got the style and the subjects right. But the tiger isn’t climbing the tree and the monkey isn’t eating an apple.

Here are some of the ways you can improve your prompts for more accurate graphics:

  • Be more specific and detailed
  • Don’t add too many subjects doing different things
  • Try various styles and artists (other than realism)
  • Join OpenAI’s Discord to ask the community for tips
  • Read this free ebook of prompts

You can also try Semrush’s free Sentence Rewriter Tool.

Simply type in your sentence and click “Paraphrase.” And the tool will come up with three versions of your sentence.

Semrush’s Sentence Rewriter Tool

When you’re happy with the rephrased version, click “Copy” and paste the text into your content.

Download Your First Generated Image

Let’s go back to our fairground prompt.

Once you’re happy with one of the generated images, click on it to view a larger size.

Note: The image will shrink slightly when you hover over it, so you know which image you’re selecting.

an example of hovering over an image (shrinked)

You can then click the top right icon on the image to download it. 

How to download the image in DALL-E

You can also “Share” it to a public page. Or “Save” it to a customized collection:

DALL-E 2 offers "Edit" "Variations" "Share" and "Save" options for images

Recent variations are available in a toolbar on the right side of the DALL-E 2 dashboard.

Edit Your Graphics In-App or with a Third-Party Tool

You can use DALL-E 2’s inpainting and outpainting features to tweak your images in the app. Or download them and use a third-party tool like Adobe Photoshop for editing.

Here’s what “outpainting” with DALL-E 2 looks like for the prompt “Landscape:”

“outpainting” with DALL-E 2 for a landscape image

And here’s how it compares to Photoshop’s Generative Fill feature:

Photoshop’s Generative Fill feature for a landscape image

DALL-E offers two main types of in-app editing:

  • Inpainting allows you to change visual elements within a graphic 
  • Outpainting expands an original image past its borders with visual elements of the same style

Here are two examples of inpainting where the user asked DALL-E 2 to “add a flamingo” and specified where:

two examples of inpainting where DALL-E 2 added a flamingo to the image based on user’s instructions

You can use this feature (and outpainting) to make your composition more interesting.

Try outpainting on one of the earlier images.

Choose an area outside the image (in this case, it overlapped) and add a new prompt:

using outpainting in a generated image on "a mountain rises from the sea in the background of the palm tree"

You still get four variations to choose from. So scroll through and click “Accept” when you’re satisfied:

click “Accept” when you’re satisfied with the image

If you click “Cancel,” DALL-E 2 won’t add the additional part.

You can use these features for images you generate within the tool. Or you can upload your own and edit it in-app.

Be aware that each generation will use a credit. Even if you don’t pick any of the variations.

Because of that, a third-party tool like Photoshop might be a better option. Since it gives you more options and could be more cost-effective in the long run.

But money isn’t the only issue. DALL-E 2 also has some creative limits.

Use Your Graphics in Your Content

When you’re happy with all of your DALL-E images, use them in your content. For example, share them as social media posts, videos, or blogs.

Ketchup giant Heinz based an entire marketing campaign around DALL-E 2 images in 2022.

The brand noticed that any ketchup-related prompt looked like a bottle of Heinz:

examples of DALL-E results for ketchup-related prompts

So it created a clever YouTube video and used a variety of DALL-E 2 images to “prove” that even AI prefers Heinz.

The brand shared the images on social media, its website, billboards, and paper ads.

DALL-E 2 images used by Heinz on bus station boards

Their creative use of DALL-E 2 even won the marketing agency several awards. 

You can use your images in a similar way.

For example, Semrush’s AI Social Content Generator can help you generate the copy and design parts of your social posts.

Semrush’s AI Social Content Generator

Instead of using stock images, you can start with one of your DALL-E 2 creations. Or have the tool suggest a post idea and go back to DALL-E to create a relevant image.

You can also create banners with Instant Banner Generator.

Instant Banner Generator tool

The tool allows you to pick options from stock photography site Unsplash. But you can get more creative with your DALL-E images instead.

Once you fill your blogs with eye-catching AI imagery, try Instant Video Creator to turn your posts into videos.

Simply upload the URL and the tool will create your video. 

Instant Video Creator turns your posts into videos

If you want to add any extra images, you can do so before sharing.

Whatever the format, DALL-E 2 images add a unique twist to any marketing materials.

Bonus: Be Aware of DALL-E 2’s Limitations

DALL-E can produce some amazing graphics. But it’s not perfect. 

It struggles with composition, spelling, and objects it doesn’t recognize.

At the time of writing, here are some of the main elements that DALL-E 2 has trouble with:

  • Scenes with two or more characters
  • Objects it doesn’t “recognize” (e.g., a specific type of skateboard)
  • Distinguishing between foregrounds and backgrounds
  • Spelling out words within graphics
  • Hyper-realistic scenes (e.g., human hands usually have more or fewer fingers than they should)

Let’s look at a few examples.

Here’s what “A female gangster in a fedora hat talking to a cat wearing sunglasses around a ***** table” produced:

DALL-E 2 results for “A female gangster in a fedora hat talking to a cat wearing sunglasses around a ***** table” prompt

The prompt specifies that the cat should be the one wearing sunglasses. But DALL-E 2 misunderstood.

So try being more specific: “A female gangster wears a fedora, a cat wears sunglasses, they talk around a ***** table.”

But that doesn’t work either.

DALL-E 2 results for “A female gangster wears a fedora, a cat wears sunglasses, they talk around a ***** table” prompt

Instead it created three characters. But no cat wearing sunglasses.

Another element DALL-E 2 can’t produce are words within a graphic.

DALL-E 2 results for “An octopus in Times Square holding a sign that says - Save our oceans" prompt

For whatever reason, anything you ask for will be a jumbled mess of characters.

The software also tends to ignore elements it doesn’t “recognize.” 

For example, it created a pretty accurate “drawing of a blonde woman riding a longboard.”

DALL-E 2 results for “drawing of a blonde woman riding a longboard” prompt

But the longboard looks different in each image.

Luckily, the tech is always learning despite these limitations. And something DALL-E 2 struggles with today may not be an issue tomorrow. 

You may also find a way to phrase your prompt to achieve more accurate results.

The only solution is to keep experimenting.

Use DALL-E 2 to Enhance Your Content Creation Efforts

OpenAI’s photo generator DALLE-2 is powering a new creative renaissance for marketers. 

As a result, those with little artistic ability can now create original graphics from a line of text.

Once you have your images, head to Semrush’s AI Social Content Generator to get help with your captions and hashtags. Or start with a banner using Instant Banner Generator.

Want to turn your new image-packed blogs into videos? Try Instant Video Creator.



Source link : Semrush.com

Social media & sharing icons powered by UltimatelySocial
error

Enjoy Our Website? Please share :) Thank you!