DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Researchers will soon turn your selfies into videos

Oct 11, 2017 by Dunja Djudjic Add Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Facebook has relatively recently introduced the so-called “reactions” to posts. But soon, instead of clicking on the heart or a laughing emoji, you will be able to “react” with your profile photo. The researchers at Tel Aviv University and Facebook have come up with a method to bring your selfies to life. All they need to do it is a single photo, and the resulting animation is pretty impressive. It seems like your photo is actually a short video, and it’s incredibly accurate considering that they only use one 2D image for the animation.

https://www.youtube.com/watch?v=-RetOjL1Fhw

According to the study, the team uses a “driving video” of an “actor” to map out facial expressions of various emotions. You can see the examples in the video how they use a “model face” to act out being angry, happy, surprised, sad and idle.

The team performs mapping of the facial features in both the driving video and the image. Other than mapping the regions on the face, they also add reference points outside the facial region to make the animation more realistic. But it doesn’t end here. The facial expression is transferred from the video onto the 2D image, but it’s still not entirely realistic. So, the researchers have worked out the method to add the fine-scale details we associate with facial expressions. As a result, the animated picture gets tiny wrinkles and the recreated hidden regions, like those inside the mouth. You can see it in the example of the “angry” animation:

According to the researchers, the biggest challenge was to keep the identity of the target face while applying the expressions from the arbitrary driving video. If you ask me, I think they did a really good job.

 

Other than applying it to portrait photos (selfies), this method can also be used on photo-unrealistic pictures, like paintings and even emojis. It looks fun (and slightly creepy) to see a painting of Frida Kahlo with the animated crooked smile:

The researchers mention that photos animated like this “resemble the moving portraits from Harry Potter’s magical world, where people in photographs move, wave, etc.” The team writes that their primary application is “creating reactive profiles,” or avatars that “can react to different stimuli.” So, I guess this will be particularly interesting for the Harry Potter fans. I’m not among them, though, but I still find this pretty amazing. I hope they’ll add the eye-rolling feature, too. I would use that one on Facebook a lot.

[Bringing Portraits to Life via Engadget]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

Researchers will soon be able to take tack-sharp photos of a black hole Are we ready to use selfies as a tool? Here are top 10 possible applications of selfies in near future The selfie paradox: people like taking selfies, but hate looking at selfies of others Adobe might turn selfies into decent portraits using AI

Filed Under: news Tagged With: AI, animation, selfies, Video

Dunja Djudjic: from diyphotography.net

About Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

« Women’s suit company reverses gender roles in this advertising campaign using naked men as props
An alphabet photography challenge changed the way I shoot »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup

Recent Comments

Free Resources

Advanced lighting book

Learn photography

Recent Posts

  • Hands on with the Kelvin Epos 600 RGBLAC light
  • Hands on with the Godox MG2400Bi LED beast
  • Hands on with the Saramonic WiTalk
  • Another tourist falls off a cliff while taking a selfie
  • Stop doing these dangerous photoshoots

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy