DIY Photography

Hacking Photography - one Picture at a time

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

MegaPortraits turns your photos into creepily accurate deepfake videos

Jul 25, 2022 by Dunja Djudjic Leave a Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Deepfakes have been a thing for a while now, and they’ve been used for fun, useful, but also malicious purposes. Samsung has now introduced yet another deepfake tool that turns a single still image into a creepily accurate video.

Samsung’s Megapixel portraits, or MegaPortraits, is able to create high-resolution human avatars. All it needs is a single portrait, and it doesn’t even have to be a photo – you can also turn paintings into moving portraits, for some extra creepiness.

In their paper, researchers from Samsung Labs elaborate on the technology behind MegaPortraits, describing the training setup as “relatively standard.”

“We sample two random frames from our dataset at each step: the source frame and the driver frame. Our model imposes the motion of the driving frame (i.e., the head pose and the facial expression) onto the appearance of the source frame to produce an output image. The main learning signal is obtained from the training episodes where the source and the driver frames come from the same video, and hence our model’s prediction is trained to match the driver frame.”

Samsung AI Center in Mosci and the Skolkovo Institute of Science and Technology introduced similar technology back in 2019. In the latest work, they have made the technology more advanced. The team writes that they focused on a “challenging task of cross-driving synthesis.” This means that “the appearance of the driving image is substantially different from the animated
source image.”

While the facial features been improved, the researchers note that their method underperforms in terms of shoulders and clothing. This makes the resulting videos a bit jittery and less believable, but Samsung Labs says that improving this will be their focus in the future. I’d say that the hair also looks a bit weird when the photos and paintings begin to move, which is giving them away. Still, it’s hard not to think how much better deepfakes will become in the near future, and how easy they will be to believe even when you view them on a large screen where it’s easy to spot the imperfections with today’s deepfake videos.  So, don’t forget to keep your critical thinking on a high level as I believe we’ll see more and more believable deepfakes as time goes by.

[via PetaPixel]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

This tool turns you into a creepily realistic AI clone Twitter soon to start labeling manipulated photos and deepfake videos Adobe’s new deepfake tool turns your photos into realistic animations Ready Player One poster ridiculed for bad Photoshop, turns out to be accurate

Filed Under: news Tagged With: AI, Artificial Intelligence, cloning tool, Computational Imaging, Deep Learning, Deepfake, digital cloning, Samsung

About Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

« NASA photos of Lake Mead’s extreme drought are a concerning illustration of climate change
Photographer captures rare aurora borealis in England »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Whale with severe scoliosis captured by drone video
  • Photographer builds 11-foot electronic waste skull to show Bitcoin’s impact on climate change
  • Fuji’x April X Summit reported to be cancelled
  • Yongnuo announces 85m f/1.8 AF lens for Canon RF (again)
  • Canva adds a slew of new AI tools that could rival Adobe’s

Alex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

Dave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy