DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Deepfake technology is now being used to “visually dub” movies to remove profanity for PG-13 ratings

Aug 14, 2022 by John Aldred 3 Comments

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

This is probably the most practical and one of the least creepy ways I’ve seen deepfake technology being used since it was initially created. While it’s had some very impressive showcases, particularly as an alternative to badly CGI’d versions of actors looking years younger than they are or even bringing them back from the dead, this application is a little less drastic and a little more seamless.

In what is being termed “vubbing”, deepfake technology is being used to generate new frames when lines are changed in post or certain things (like profanity) are cut out completely in order to appease the censors (the MPAA, in this case). With deepfake technology falling far below the budget of reshoots, it makes a lot of sense, but that the technology has come this far so quickly is also very impressive.

YouTube video

As No Film School reports, the idea seems to stem from the independent action-thriller Fall. In one particular scene, two friends are climbing an abandoned radio tower when a section of the ladder breaks away and the pair are left stranded on the tower. In what would probably be the natural response for many of us, the occasional profanity slips out regarding the situation but the Motion Picture Association of America (MPAA) didn’t approve it for the PG-13 rating the crew needed in order to maximise the potential audience. With a production budget of what is reported to be only $3 million, reshooting the scenes and angles all over again with new lines just wasn’t an option. So, they turned to deepfake.

It just so happens, though, that Scott Mann, the director and co-writer of Fall founded a company called Flawless in 2021. It was originally established as a company that used deepfake as a way to more realistically dub movies from one language to another – another fantastic use of deepfake technology – and have the mouth movements match up to whatever language the voice was speaking rather than seeing the original mouth movements in the movie’s originally recorded language. Mann realised he could apply this technology to the situation they were facing with Fall and the MPAA.

And it appears to have worked. Actors were even reported to say that they couldn’t tell when things had changed and what was an original recording. “As far as I know, every movement my mouth made in that movie, my mouth made”, said actor Grace Carolina Curry. The movie did get its PG-13 rating in the end, too.

I still think there’s a little way for it to go in order for it to become 100% believable all of the time but in the samples video above, it looks pretty close. It’s only a matter of time before you won’t be able to tell the difference between the AI-generated shots and the real thing. At least, you wouldn’t know if you didn’t realise who the actors were and hadn’t seen the movie already in its native language.

It’s a great tool for the movie industry, no doubt, but it’s definitely scary how good it’s getting. The implications outside of Hollywood are far-reaching.

Now, if only somebody would run Demolition Man through this so that when they say “Pizza Hut” they’re not mouthing the words “Taco Bell”. Or, you know, just put the original dialogue back.

[via No Film School / Lead Image: Lionsgate]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

Default ThumbnailAdvice From J.J. Abrams: “It’s More Important You Learn What to Make Movies About Than How to Make Movies” IP ratings and what they mean to your gear. Camera makers, please be clear! Instagram adds photo descriptions to aid visually impaired users Visually Impaired Photographer creates stunning, moody images

Filed Under: news

John Aldred: from diyphotography.net

About John Aldred

John Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

« Create NYC 2022 (AKA PhotoPlus Expo) cancelled – the next one is in 2023
Which lens is right for your Milky Way photos? Watch this 20-28mm f/1.4 shootout to find out »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup

Recent Comments

Free Resources

Advanced lighting book

Learn photography

Recent Posts

  • The slow death of creativity in modern photography
  • Holiday Gift Guide – Our favourite gadgets and accessories of 2023
  • Stability AI’s new AI generator creates images faster than you imagine them
  • AstrHori new 28mm f/13 2x Macro Periscope lens sees round corners
  • Sony World Photography Awards under fire for age limitations in Student contest

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy