DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Google used this crazy 5-phone case to tweak Portrait Mode on the Pixel 3

Dec 3, 2018 by John Aldred Add Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

When the Google Pixel 2 came out it was extremely impressive. Despite only having the single rear camera, it beat out everything else on DxOMark and held the position for quite a while. When the Pixel 3 was announced, it also had only the single rear camera. And despite one or two issues with the phone overall, Google made some great improvements with it.

Google has published a blog post on how they taught the Pixel 3 to predict depth for its Portrait Mode. Given that it only has a single camera, and not the dual cameras of other brands, it seems like it wouldn’t be possible, but the techniques used are pretty interesting. And involve a case that holds five separate cameras.

Essentially, the Pixel 3’s portrait mode is based on a lot of very AI-educated guesswork combined with phase detection autofocus (PDAF). It’s a little like the dual pixel autofocus in Canon DSLRs and mirrorless cameras. It uses the slight shift between the pixels to capture two slightly different views of the scene.

This was the system introduced in the Pixel 2 and Pixel 2 XL and it was very good, but it wasn’t perfect. And to fix some of the issues it had and overcome challenges with the PDAF system, Google created an AI to identify objects within the scene. But to teach this AI, they used this weird contraption.

The above case holds five Pixel 3 phones, and has a WiFi-based triggering system that lets the operator capture a scene simultaneously (within about 2 milliseconds) with all five cameras. They can then feed the AI several images that show the same moment in time from multiple angles to help determine foreground and background elements and “teach” it.

The middle animated image above shows five such images. The shot on the right is a generated depth map, with the black pixels being areas of low confidence (basically, there wasn’t enough detail to track between the images).

With the phone trained to identify not only objects but also their scale, and with the tiny difference in parallax between PDAF pixels, the Pixel 3 is much more accurate than its predecessor at understanding depth. The comparison below shows the more traditional stereo depth image vs the trained AI image.

What’s most impressive of all, though, is that this is all calculated inside a supercomputer that can fit in our pockets in fractions of a second.

Head on over to the Google blog to find out more about how it works.

[via Android Police]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

You can now have Google Pixel 2’s Portrait mode on older phones, for free This is how Google Pixel 4’s Portrait Mode works Google Pixel 2 fans duped by iPhone XS “Portrait Mode” photo Google’s new Pixel phone boasts an 89 DXO mobile score (highest ever given to mobile phone)

Filed Under: news Tagged With: AI, google, Google Pixel 3, Google Pixel 3 XL, portrait mode, tech

John Aldred: from diyphotography.net

About John Aldred

John Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

« Six signs that you are over-editing your landscape images
2018 DIYP Gift Guide – Cameras »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup

Recent Comments

Free Resources

Advanced lighting book

Learn photography

Recent Posts

  • The Nour Triplet V 2.0 lens is more about art than sharpness
  • Surreal Icelandic landscape wins 2023 Epson International Pano Awards
  • 2023 Siena International Photo Awards winner shows the pain and meaninglessness of war
  • Why and how to use photography to document your personal life
  • Shooting long exposures on film with minimal gear

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy