DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

This free web tool lets you explore bias in AI-generated images

Nov 10, 2022 by Dunja Djudjic 1 Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Ever since AI became widely available and used in every possible app, we’ve seen as many of its advantages as drawbacks. One of those drawbacks is racial and gender bias, and increasingly popular text-to-mage generators aren’t free from it.

Enter Stable Diffusion Bias Explorer, a tool that lets you explore AI-generated images and the biases they contain. It’s free, accessible to anyone, and quick to show that both humans and artificial intelligence still have a long way to go before they get rid of deeply rooted stereotypes.

“Research has shown that certain words are considered more masculine- or feminine-coded based on how appealing job descriptions containing these words seemed to male and female research participants,” the Explorer’s description reads. It also relies on “to what extent the participants felt that they ‘belonged’ in that occupation.”

Speaking about the project, its leader and a research scientist at HuggingFace, Dr. Sasha Luccioni told The Motherboard:

“When Stable Diffusion got put up on HuggingFace about a month ago, we were like oh, crap. There weren’t any existing text-to-image bias detection methods, [so] we started playing around with Stable Diffusion and trying to figure out what it represents and what are the latent, subconscious representations that it has.”

The tool is simple to use: you have two groups to compare to each other. For each of them, you choose an adjective (which you can also leave blank), an occupation, and a random seed to compare results. Dr. Luccioni demonstrates how the tool works and the results it gives when using different combinations of adjectives and occupations.

What's the difference between these two groups of people? Well, according to Stable Diffusion, the first group represents an 'ambitious CEO' and the second a 'supportive CEO'.
I made a simple tool to explore biases ingrained in this model: https://t.co/l4lqt7rTQj pic.twitter.com/xYKA8w3N8N

— Dr. Sasha Luccioni 💻🌎✨ (@SashaMTL) October 31, 2022

I played with Stable Diffusion Bias Explorer myself to see what I’d get. I used adjectives and occupations that are perceived as exclusively masculine and exclusively feminine… And I pretty much got what I expected: highly biased results. In some cases I used both adjectives and occupations, and in the other I left the “adjective” fields blank.

Remembering this research, I wanted to check what I’d get for “photographer” and “model.” However, there was some sort of an error when I selected “photographers”, and “model” wasn’t among the offered occupations. But here are some screenshots of the results I got.





To be fair, artificial intelligence was built, developed, and trained by humans. It uses human knowledge and input – and hence inherits human biases. It would be irrational to expect AI to be more aware and less biased than its makers. And if we really want to have unbiased AI generators, we need to get rid of prejudices and stereotypes ourselves.

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

DJI FPV Drone “hacked” to increase transmission power with free web tool Online database ImageNet to remove 600,000 images after art project exposes its racist and gender bias This nightmare music video was made from AI-generated images based on the song lyrics Instagram now lets you control how much sensitive content you’ll see in Explore

Filed Under: Inspiration Tagged With: AI, bias, text to image

Dunja Djudjic: from diyphotography.net

About Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

« Pentax has officially announced the new Pentax KF DSLR but it’s basically a K-70 with a flippy out LCD
Elinchrom releases FIVE – A 522Ws battery strobe with 450 full power flashes and charges over USB-C »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Ace your next portrait shoot with these composition tips
  • This is how to get photography clients on Instagram – even with few followers
  • “I prefer using smaller cameras” – an unorthodox take on size
  • A pigeon scares a meteorologist as it photobombs a live camera
  • Photographer files lawsuit against NFL receiver and teams after shoving incident

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy