DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Google trained its portrait lighting AI with 64-camera and 331-light rig

Dec 15, 2020 by Dunja Djudjic 1 Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Our phone cameras are getting better and better, and AI has been all the rage in photography lately. Google wants to bring AI lighting to your photos and help you relight your images after you’ve taken them. To train the algorithm, Google used an impressive rig with 64 cameras and 331 LED lights, and judging from the demos, the results are pretty awesome.

Portrait Light is a new feature recently added to the Pixel Camera and Google Photos apps. It was originally introduced for Pixel 4a 5G and Pixel, but then older Pixel phones also got an access to it. On its AI Blog, Google explains how AI was trained for Portrait Light and how this feature enables you to change the lighting in a photo after it has been taken.

Google had to capture literally millions of pairs of portraits. One photo in the pair had the extra light, and the other didn’t. They shot the photos using the rig I mentioned above, which contains 64 cameras with different viewpoints and 331 individually-programmable LED light sources. Here’s a little peek at what it looks like:

Image credits: Google

The algorithm trained this way enabled two new capabilities, as Google explains:

  • Automatic directional light placement: For a given portrait, the algorithm places a synthetic directional light in the scene consistent with how a photographer would have placed an off-camera light source in the real world.
  • Synthetic post-capture relighting: For a given lighting direction and portrait, synthetic light is added in a way that looks realistic and natural.

In other words, you can create lighting as you please on your phone after taking the photo. “We optimized the full pipeline to run at interactive frame-rates on mobile devices, with total model size under 10 MB,” Google writes. And judging from the examples, the results are much more realistic than on my Huawei (my phone does a pretty lame job, actually).

Image credits: Google

Of course, I’m always into setting or finding the best light possible and not adjusting the light in post. However, if we’re shooting with our phone it probably means we’re on the go. Therefore, we might not be able to really choose the lighting on all occasions. In such cases, it’s pretty useful to have the relighting option that does a good job, and Google’s Portrait Light sure looks like it.

[via Engadget]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

This Is How The Military Police Trained Photographers In 1965 This is how trained eagles knock drones out of the sky GoPro and Google officially launch Omni, their smaller, cheaper 6-camera VR rig Apollo app for iOS creates cool lighting effects better than Apple’s Portrait Lighting

Filed Under: Gear Tagged With: AI, Artificial Intelligence, google, Relighting

Dunja Djudjic: from diyphotography.net

About Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

« Osee G7 camera monitor takes on the top 3000 nit monitors
Apple has now released ProRAW for the iPhone 12 Pro/Pro Max with iOS version 14.3 »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Here’s a bullet time video booth you can build yourself
  • Ricoh has discontinued the HD PENTAX-DA 21mm F3.2AL Limited silver lens
  • This “stellar flower” unravels the twilight’s evolution in 360 degrees
  • Strobes vs Continuous LEDs – Which is right for you?
  • Wave goodbye to Apple’s My Photo Stream next month

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy