DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Google opens up AI tech behind “Portrait Mode” to developers as open source

Mar 14, 2018 by John Aldred 1 Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Portrait Mode has been simultaneously one of the biggest jokes and coolest advancements in smartphone camera technology. Google’s version of it can be found in the portrait mode of the Pixel 2 and Pixel 2 XL smartphones. And they have just released their latest version of it as Open Source, available to any developer who can make use of it.

It’s detailed in Semantic Image Segmentation with DeepLap in Tensorflow on the Google Research blog. And reading how it works is quite interesting, even if you have no idea how to actually do it. Semantic Image Segmentation is basically the process by which pixels in an image are defined by labels, such as “road”, “sky”, “person” or “dog”. It allows apps to figure out what to keep sharp and what to blur.

DeepLab-v3+ is the new version, and it’s implemented in the Tensorflow machine learning library. It builds on top of a powerful convolutional neural network (CNN) for accurate results intended for server-side deployment. Google is also sharing their Tensorflow training and evaluation code, along with pre-trained models.

They say that the software has come a long way since the first incarnation of DeepLab three years ago. It features improved CNN feature extractors, better object scale modelling, assimilation of contextual information, and improved training procedures.

Modern semantic image segmentation systems built on top of convolutional neural networks (CNNs) have reached accuracy levels that were hard to imagine even five years ago, thanks to advances in methods, hardware, and datasets. We hope that publicly sharing our system with the community will make it easier for other groups in academia and industry to reproduce and further improve upon state-of-art systems, train models on new datasets, and envision new applications for this technology.

While I do find the topic absolutely fascinating, I’ve no desire to actually play with the code myself. I just have no practical use for it. Not even the curiosity to experiment with it. And I know if I did, it would become a huge time suck figuring it all out.

But if you do, or you want to find out more, head on over to the Google Research Blog and check it out for yourself.

[via DPReview]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

GoPro opens up the Hero 9 Black to developers with new Open GoPro API Default ThumbnailThe Open Source Portrait – Equipment & Environment (Part 1) Default ThumbnailThe Open Source Portrait – Postprocessing (Part 2) Google used this crazy 5-phone case to tweak Portrait Mode on the Pixel 3

Filed Under: news Tagged With: AI Vision, DeepLab, google, portrait mode

John Aldred: from diyphotography.net

About John Aldred

John Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

« Photographing family and friends for free? Here’s how to accept or reject it
This rotating GoPro rig captures realistic VR images »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Botched selfie escalates to draining of reservoir
  • Panasonic PanaTrack is a big bendy motorised camera slider
  • Once again, tourists are getting too close to bison for photos
  • Fujifilm announces shipping delays for the new Fuji X-S20
  • International Photography Awards reveals breathtaking 2022 winners (mildly NSFW)

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy