DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Neural networks can now turn a 2D photo into a surprisingly accurate 3D render

Dec 8, 2016 by Dunja Djudjic Add Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

neural-networkd-3d-face

A detailed and accurate face mapping is a complex task. It requires a series of photos with ideal and consistent lighting from different angles. If you want to capture all the details and imperfections of the face, you need professional lighting and multiple shots. However, a group of researches is on the way of changing this method.

Researchers Hao Li, Shunsuke Saito, Lingyu Wei, Koki Nagano, and Liwen Hu use deep neural networks to create detailed and quite accurate 3D models using a single 2D photo. The researchers used an extensive online face database to create a library of fine details and textures of the face. Neural networks first filter through a network of possible textures, and then scan and blend the suitable facial features and skin tones with the 3D model. And the result is remarkable, even with the photos that aren’t exactly sharp.

The scientists submitted their research to Cornell University, where they state this invention “could widely impact new forms of immersive communication, education, and consumer applications.” Some video games, such as NBA 2K17, already offer the option of scanning your face for the game. However, the results are not always as accurate as you would like them to be. But unlike the NBA 2K17’s face scanner, the use of deep neural networks makes the 3D models very precise.tumblr_ohtqycd8b81qav3uso1_540

Since official face databases are easily available online (and tons of photos on social networks on top of that), there are some privacy and ethical questions to be raised. This method can provide a high degree of realism in virtual world, but it can also allow different kind of improper and unethical use. But, let’s hope it will just stay an important discovery and have many useful and ethical applications.

[Photorealistic Facial Texture Inference Using Deep Neural Networks (ArXiv 2016) via Gizmodo]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

Everypixel Aesthetics uses neural networks to judge quality of your photos Ostagram uses neural networks to create mind-bending images Photographer coloured a 100 year old glass plate portrait in Photoshop using neural networks How Social Media Networks Enable Creative Content Theft IntroSocial Media Networks Don’t Give a Flying Fudge-Nugget About Your Copyright!

Filed Under: news Tagged With: 2D to 3D, 3D face model, 3D render, face mapping, Neural Networks

Dunja Djudjic: from diyphotography.net

About Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

« This filmmaker dismantled his GoPro to make it light enough for his tiny drone
How to photograph LED Christmas lights »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup

Recent Comments

Free Resources

Advanced lighting book

Learn photography

Recent Posts

  • Nanlite announces powerful AC-powered FC500B and FC300B LED lights
  • The Laowa Aurogon is a full-frame 10-50x super micro APO lens kit
  • Watch: Amateur astronomer captures a rare giant fireball on Jupiter
  • AI-generated deepfake nude images of school girls shake Spanish town
  • The Nikkor S Plena is a 135mm f/1.8 Z mount portrait lens

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy