DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Describe a scene to this AI and it creates a picture

Apr 8, 2022 by Dunja Djudjic 4 Comments

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

I’ve had the chance to write about some amazing and creepy AI solutions over the past couple of days. And today, I was mind-blown by another one. It’s called DALL-E 2, and yeah, it’s kinda like an AI blend of WALL-E and Salvador Dali.

OpenAI’s cleverly named AI is able to create realistic “photos” based on your textual description. An astronaut riding a bike, a koala dunking a basketball, a bowl of soup that looks like a monster… You name it, DALL-E 2 will turn it into a picture that’s likely never been seen before.

DALL-E 2 is the younger and let’s say, the more handsome brother of DALL-E. It gives you higher-resolution and more accurate image results. It relies on your textual input created in natural language. It combines concepts, attributes, and styles to create the image you describe, and basically, the sky is the limit.

In addition, you can use DALL-E 2 for image editing. After all, AI-based editing seems to be a thing nowadays. You can modify existing images by giving the AI a natural language input. It can add and remove elements while taking shadows, reflections, and textures into account. In addition, you can create different variations of a photo (e.g. at different angles and in different styles) inspired by the original image.

My first thought when I started reading about DALL-E 2 was Dream by WOMBO app. It also uses text cues you give it to produce an AI-generated picture. However, the Dream app creates surreal artwork, while DALL-E 2 generates quite realistic pictures. For example, here’s the “monster plasticine bowl of soup” I got with the Dream app:

And here are a few examples of how DALL-E 2 imagines it:



“DALL·E 2 has learned the relationship between images and the text used to describe them,” writes OpenAI. “It uses a process called ‘diffusion,’ which starts with a pattern of random dots and gradually alters that pattern towards an image when it recognizes specific aspects of that image.”

This kind of technology could be used for a number of purposes by artists, illustrators, photographers, comic book creators… Or just by us regular folks out of pure fun. I’ve even signed up for the waitlist hoping to be able to test it out (you can do it here). However, we can’t disregard potential misuses such as fake news or fake revenge porn, to name a few. As always, even the most harmless technology can become a weapon in the wrong hands.

But OpenAI promises that they’ve taken all necessary steps to prevent the misuse of DALL-E 2. First, they’ve limited its ability to generate violent, hateful, or adult images. “By removing the most explicit content from the training data, we minimized DALL·E 2’s exposure to these concepts,” OpenAI writes. “We also used advanced techniques to prevent photorealistic generations of real individuals’ faces, including those of public figures.” Furthermore, OpenAI has both automated and human monitoring systems to guard against misuse. After all, DALL·E 2 is still a research project so it’s not available in OpenAI’s API. “As part of our effort to develop and deploy AI responsibly, we are studying DALL·E’s limitations and capabilities with a select group of users,” the company writes. So, as they improve it and protect it further, I hope that it will become available to everyone to test out. It sure seems fun!

[via PetaPixel]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

Default ThumbnailiPad + iPhone Picture in Picture In 8 Easy Steps How I describe the world to myself to improve my street photography Kodak motion picture film infrastructure being rebuilt including 5 year deal with Pinewood Studios Facebook tests “Profile Picture Guard,” a feature that prevents your profile photo from being stolen

Filed Under: news Tagged With: AI, Artificial Intelligence, DALL-E 2

Dunja Djudjic: from diyphotography.net

About Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

« Wildlife photographer Steve Perry gets his hands on the new Nikon Z 800mm f/6.3 VR S lens
The Phantom VEO 610 is the new “budget-friendly” Super 35mm camera that shoots HD at 7,420fps »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup

Recent Comments

Free Resources

Advanced lighting book

Learn photography

Recent Posts

  • Nanlite announces powerful AC-powered FC500B and FC300B LED lights
  • The Laowa Aurogon is a full-frame 10-50x super micro APO lens kit
  • Watch: Amateur astronomer captures a rare giant fireball on Jupiter
  • AI-generated deepfake nude images of school girls shake Spanish town
  • The Nikkor S Plena is a 135mm f/1.8 Z mount portrait lens

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy