DIY Photography

Hacking Photography - one Picture at a time

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Researchers will soon turn your selfies into videos

Oct 11, 2017 by Dunja Djudjic Leave a Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Facebook has relatively recently introduced the so-called “reactions” to posts. But soon, instead of clicking on the heart or a laughing emoji, you will be able to “react” with your profile photo. The researchers at Tel Aviv University and Facebook have come up with a method to bring your selfies to life. All they need to do it is a single photo, and the resulting animation is pretty impressive. It seems like your photo is actually a short video, and it’s incredibly accurate considering that they only use one 2D image for the animation.

https://www.youtube.com/watch?v=-RetOjL1Fhw

According to the study, the team uses a “driving video” of an “actor” to map out facial expressions of various emotions. You can see the examples in the video how they use a “model face” to act out being angry, happy, surprised, sad and idle.

The team performs mapping of the facial features in both the driving video and the image. Other than mapping the regions on the face, they also add reference points outside the facial region to make the animation more realistic. But it doesn’t end here. The facial expression is transferred from the video onto the 2D image, but it’s still not entirely realistic. So, the researchers have worked out the method to add the fine-scale details we associate with facial expressions. As a result, the animated picture gets tiny wrinkles and the recreated hidden regions, like those inside the mouth. You can see it in the example of the “angry” animation:

According to the researchers, the biggest challenge was to keep the identity of the target face while applying the expressions from the arbitrary driving video. If you ask me, I think they did a really good job.

 

Other than applying it to portrait photos (selfies), this method can also be used on photo-unrealistic pictures, like paintings and even emojis. It looks fun (and slightly creepy) to see a painting of Frida Kahlo with the animated crooked smile:

The researchers mention that photos animated like this “resemble the moving portraits from Harry Potter’s magical world, where people in photographs move, wave, etc.” The team writes that their primary application is “creating reactive profiles,” or avatars that “can react to different stimuli.” So, I guess this will be particularly interesting for the Harry Potter fans. I’m not among them, though, but I still find this pretty amazing. I hope they’ll add the eye-rolling feature, too. I would use that one on Facebook a lot.

[Bringing Portraits to Life via Engadget]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

Researchers will soon be able to take tack-sharp photos of a black hole Are we ready to use selfies as a tool? Here are top 10 possible applications of selfies in near future The selfie paradox: people like taking selfies, but hate looking at selfies of others Adobe might turn selfies into decent portraits using AI

Filed Under: news Tagged With: AI, animation, selfies, Video

About Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

« Women’s suit company reverses gender roles in this advertising campaign using naked men as props
An alphabet photography challenge changed the way I shoot »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Apply to this Maldives resort to ‘win’ a 3 week job as Honeymoon photographer
  • Reviving a Legend: Repairing a Mamiya RB67
  • Sony’s ZV-E1 is a cut-down FX3 in a vlogging form factor
  • Watch: How good (or bad) is an $8.50 tripod?
  • How to light and photograph Lego building interiors

Alex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

Dave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy