This AI tool makes a 3D model from a single portrait photo

Sep 20, 2017

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Sep 20, 2017

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Join the Discussion

Share on:

Creating a 3D model of someone’s face usually requires multiple shots taken from different angles. But researchers from the University of Nottingham and Kingston University have created an AI tool that makes it from a single portrait photo.

The scientists describe the 3D face reconstruction as a “problem of extraordinary difficulty.” However, they’ve managed to use neural networks to turn any 2D portrait into a 3D model. There’s also a free online demo for you to try it yourself.

YouTube video

When developing the algorithm, the team used Convolutional Neural Network (CNN). Other than being simple to use and requiring only a single image, their approach works with all sorts of photos. You can render a 3D model from facial photos of arbitrary poses, different facial expressions, and head orientation.

The team approached the problem by feeding the neural network with a large set of photos and their corresponding 3D models. By doing this, they taught the AI system to quickly derive the 3D model from a 2D face.

If you’d like to read more, you can find the full paper here. As The Verge writes, this technique could find various applications in the digital world: avatars, video games, AI videos and VR social media. The result still isn’t exactly perfect, though, but it’s still pretty impressive that you can make a 3D model out of a single 2D image in only a few seconds. And not to mention that it’s fun. I tried it and it felt like looking at a character from The Sims, which was pretty weird. You can also try it here and see what you’ll get.

[via The Verge]

Filed Under:

Tagged With:

Find this interesting? Share it with your friends!

Dunja Djudjic

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Join the Discussion

DIYP Comment Policy
Be nice, be on-topic, no personal information or flames.

Leave a Reply

Your email address will not be published. Required fields are marked *

2 responses to “This AI tool makes a 3D model from a single portrait photo”

  1. Reynardt Badenhorst Avatar
    Reynardt Badenhorst

    Sorry I missed the DIY part in this (re)post

  2. Prue Phillip Avatar
    Prue Phillip

    The big issue for me is that fact there’s a face but no head.