DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Disney’s face swapping AI is fast, accurate, and creepy as hell

Jul 22, 2020 by Dunja Djudjic Add Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Artificial intelligence has already gone pretty far in face swapping. In fact, there are some deepfake videos that are very difficult to figure out. But Disney Research Studios and ETH Zurich just made it even more precise, and also cheaper than before. And it can be so accurate that it’s kinda creepy.

Disney Research Studio published a paper explaining the research and the results they got with the new algorithm. Of course, you can also see some examples in the video above. The researchers relied on several existing methods: encoder-decoder (autoencoder) methods, GAN-based image-to-image translation, and geometry-based morphable models.

The resulting face swaps gave realistic results at a 1024 x 1024 resolution and even preserved a high level of detail and contrast. For comparison, the researchers only achieved 256 × 256 pixels with DeepFaceLab on an 11GB GPU. or DeepFakes, they were able to produce 128 × 128 images, and the morphable models approach gave a resolution of 500×500 pixels. However, the results of the morphable models approach were typically unrealistic.

I can’t even start to wonder how many bad implications these face swaps could have. However, Disney didn’t have anything bad in mind when developing the algorithm. We all know by now that CGI is used to recreate actors that have aged or deceased. Just remember Carrie Fisher and Peter Cushing in Rogue One. This is the major goal of the new algorithm: to recreate actors accurately and relatively cheap. According to Disney, other applications include stunt scenes that would be dangerous for an actor to perform but still require high-quality face images.

If you’d like to read the full paper, you can find the PDF here.

[via DPReview]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

This new gadget gives fast, accurate continuous autofocus to the Blackmagic Pocket 4K Monkey selfie photographer considers swapping careers to tennis coaching. Says he’s totally broke Default ThumbnailSix Great Swapping Ideas Bellus3D will launch a fast and cheap 3D face scanning camera for mobile devices

Filed Under: news Tagged With: AI, Artificial Intelligence, Disney, face swap

Dunja Djudjic: from diyphotography.net

About Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

« Adobe recruits Google and Stanford imaging genius Marc Levoy to make their new camera app
Can you tell which of these two zebras is looking at the camera? »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Here’s a bullet time video booth you can build yourself
  • Ricoh has discontinued the HD PENTAX-DA 21mm F3.2AL Limited silver lens
  • This “stellar flower” unravels the twilight’s evolution in 360 degrees
  • Strobes vs Continuous LEDs – Which is right for you?
  • Wave goodbye to Apple’s My Photo Stream next month

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy