DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Google explains how Pixel phones use AI for astrophotography

Nov 29, 2019 by Dunja Djudjic Add Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Ever since the first video and images leaked, we knew that the new Google Pixel 4 was capable of shooting astrophotography, even handheld. If you have wondered how a humble smartphone camera can capture the night sky, Google is now offering an explanation on its blog.

Florian Kainz and Kiran Murthy, software engineers at Google, have shared some details on Google AI Blog. They write that the Night Sight mode was introduced last year in Pixel 3. But in Pixel 4, it has pushed the boundaries in terms of performance.

The engineers have encountered a number of challenges when developing Night Sight. “Taking pictures of real night skies we found that the per-frame exposure time should not exceed 16 seconds,” they write on the blog. Otherwise, the starts would start to look like streaks rather than points of light. The 16-second exposure is a “sweet spot” between capturing enough light, yet making the stars look like dots and not like light trails. But there was one problem that couldn’t be avoided: hot pixels.

With Night Sight, Pixel 4 uses AI to get rid of warm and hot pixels:

“Warm and hot pixels can be identified by comparing the values of neighboring pixels within the same frame and across the sequence of frames recorded for a photo, and looking for outliers. Once an outlier has been detected, it is concealed by replacing its value with the average of its neighbors. Since the original pixel value is discarded, there is a loss of image information, but in practice this does not noticeably affect image quality.”

Another challenge to overcome was that the sky in long exposure photos looks brighter than it really is during the night. So, Pixel 4’s AI determines where the sky is in photos and selectively darkens it to make the photos more realistic. But other than that, sky detection makes it possible to reduce noise by only targeting the sky. It also selectively increases contrast to make clouds, color gradients, or the Milky Way more prominent, the blog reads further.

“With the phone on a tripod, Night Sight produces sharp pictures of star-filled skies,” Google engineers write. “As long as there is at least a small amount of moonlight, landscapes will be clear and colorful.” But even though Pixel 4’s AI is pretty powerful, they admit that it’s not limitless and that there’s always room for improvements.

If you’d like to read more, head over to Google AI Blog for a more detailed explanation and some sample images. Google has even prepared an article with tips and tricks for better night photos, and you can read it here.

[via FStoppers; image credits: FelixMittermeier on Pixabay]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

Google goes ultra-wide with the new Pixel 5 and Pixel 4a phones Google Pixel phones may soon enable astrophotography timelapse mode Google Pixel 4 will have a dedicated astrophotography mode, leaked video shows It’s official: Night timelapse is now available for Google Pixel phones

Filed Under: Gear Tagged With: AI, Artificial Intelligence, Google Pixel, Google Pixel 3, Google Pixel 4, Milky Way, Milky Way Photography, night sky, night sky photography

Dunja Djudjic: from diyphotography.net

About Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

« Panasonic has sold its semiconductor business for $250 million
Five photography items under $50 that you need in your camera bag »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Here’s a bullet time video booth you can build yourself
  • Ricoh has discontinued the HD PENTAX-DA 21mm F3.2AL Limited silver lens
  • This “stellar flower” unravels the twilight’s evolution in 360 degrees
  • Strobes vs Continuous LEDs – Which is right for you?
  • Wave goodbye to Apple’s My Photo Stream next month

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy