Adobe Research and UC Berkeley can detect facial manipulations in photographs

Jun 16, 2019

John Aldred

John Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter – and occasional beta tester – of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Jun 16, 2019

John Aldred

John Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter – and occasional beta tester – of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Join the Discussion

Share on:

It sometimes seems like the phrase “with great power comes great responsibility” has never been more true than with Adobe Photoshop. Originally released in 1990, Photoshop has grown into an application that offers both the most amazing possibilities ever available to photographers as well as the option to potentially do harm by manipulating images to show something that isn’t real.

Adobe researchers Richard Zhang and Oliver Wang, along with Sheng-Yu Wang, Dr Andrew Owns and Professor Alexi A. Efros at UC Berkeley have now developed a system for detecting some of those manipulations.

At the moment, the detection is limited to Photoshop’s Face Aware Liquify feature. It’s a great tool for helping to make minor adjustments to make a face appear closer to how it does in real life. Naturally, though, such a tool is also often used to completely change somebody’s face to mask what they really look like.

While still in its early stages, this collaboration between Adobe Research and UC Berkeley, is a step towards democratizing image forensics, the science of uncovering and analyzing changes to digital images.

This new research is part of a broader effort across Adobe to better detect image, video, audio and document manipulations.

Image manipulation detection is nothing new to Adobe, and in the past, they’ve worked on detecting splicing, cloning and removable. But this latest effort focuses on the Face Aware Liquify feature because it’s become so popular for tweaking facial features, including completely changing facial expressions and mood.

The team trained a Convolutional Neural Network, a form of deep learning, to be able to recognise images based thousands of images found via the Internet and then modified with the Face Aware Liquify tool using Photoshop scripts.

The new research is based on three simple questions…

  • Can you create a tool that can identify manipulated faces more reliably than humans?
  • Can that tool decode the specific changes made to the image?
  • Can you then undo those changes to see the original?

That last one, I think will be somewhat challenging.

A lack of content authenticity and cries of “fake news!” are all over the Internet today. Hopefully, this technology can help to thwart some of that.

You can read more about it on the Adobe blog.

Filed Under:

Tagged With:

Find this interesting? Share it with your friends!

John Aldred

John Aldred

John Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter – and occasional beta tester – of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Join the Discussion

DIYP Comment Policy
Be nice, be on-topic, no personal information or flames.

Leave a Reply

Your email address will not be published. Required fields are marked *

2 responses to “Adobe Research and UC Berkeley can detect facial manipulations in photographs”

  1. CanonMinolta Avatar
    CanonMinolta

    The government and other have had this technology for years
    It even works on prints

  2. John Shark Avatar
    John Shark

    Yeah… I’m sure they made this technology to detect manipulations in fashion magazines… ?????