DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

This AI uses tourist photos to create mind-blowing 3D renderings

Aug 11, 2020 by Dunja Djudjic 5 Comments

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

A team of researchers at Google has come up with really awesome use of all those photos of popular tourist spots. They’ve created an algorithm that takes those photos and turns them into realistic and very detailed 3D renderings. And the best of all is that it even edits out interfering objects and evens out the changes in lighting.

The researchers used thousands of photos to train the algorithm to recognize the object. These photos show the object from many different angles, which is how the system can later create a 3D. But there are also various lighting conditions and times of day when these photos were taken. There are also often obstructing objects in the photos, like people, cars or signs. And as you can probably imagine, there are also tons of different editing techniques people apply to their photos. But it’s impressive that this tech is able to even them all out and create a 3D rendering that looks like it takes you through the scene.

The system was named “NeRF in the Wild” or simply NeRF-W. This is because the system for 3D reconstruction of landmarks was made from unconstrained, “in-the-wild” photo collections, as the team explains. The results are pretty impressive, especially considering all the challenges the system had to overcome to create smooth and uniform renderings.

There could be AR and VR various applications of this system, according to the researchers. I believe it could also be used in video games and for special effects in movies. Perhaps also for virtual tours, which would be useful especially now that we can’t travel anywhere.

If you’d like to read the full paper, you can find it here. You can also see a few examples in the video above, or via this link.

[NeRF-W via PetaPixel]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

These are NASA’s mind-blowing photos of 2017 solar eclipse A man photoshops himself into his childhood photos, and the result is mind-blowing The Epson International Pano Awards 2020 is a mind-blowing collection of panoramic images Top ten mind-blowing photography projects of 2021

Filed Under: Inspiration Tagged With: 3d, 3D render, AI, Artificial Intelligence, Nerf, neural network, Neural Networks, Photogrammetry

Dunja Djudjic: from diyphotography.net

About Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

« Those images you lost on image.canon? Yeah, you ain’t getting them back Canon says
Laowa finally releases their OOOM 25-100mm T2.9 Zer-D cinema lens »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Here’s a bullet time video booth you can build yourself
  • Ricoh has discontinued the HD PENTAX-DA 21mm F3.2AL Limited silver lens
  • This “stellar flower” unravels the twilight’s evolution in 360 degrees
  • Strobes vs Continuous LEDs – Which is right for you?
  • Wave goodbye to Apple’s My Photo Stream next month

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy