Adobe has announced today a groundbreaking addition to After Effects: content-aware fill for video. The feature is powered by Adobe Sensei, the company’s AI platform which helps to remove various visual elements automatically. This feature has been available in Photoshop, and it makes it much easier for photographers to remove unwanted objects from images. But now, the same feature is coming to After Effects, making life easier for video editors, too.
Adobe is showing off a new sneak peek tech preview. This time, it’s a completely overhauled Content-Aware Fill interface that offers a great deal of control over the existing Content-Aware Fill feature. The old one is there if you want it, but the new one makes it a whole lot more powerful.
When the Content-Aware Fill tools were added to Photoshop a number of years back, they were hailed as being the best thing since Photoshop itself was created. Now, with a couple of clicks, you could get rid of the stuff you didn’t want in your image and Photoshop would magically replace it with what you wanted. The reality was that it didn’t always do what it said on the tin, leading to the nickname “Content-Aware Fail”.
It’s come a long way since then. It’s smarter than it was, and soon it may expand to include fill sources from Adobe’s vast stock library. Nvidia’s taking a slightly different approach, though, using deep learning AI to help fill in the gaps, and while the aesthetics are still fairly primitive, the AI seems to do a great job of recognising what’s what.
This is one of those features that many of us wish was added years ago. It’s common for photographers to fill in holes from one photograph, of things they want to remove, from sections of another. I’ve done it many times myself to fill in undergrowth in forests or even rebuild entire moss-covered walls behind my subject on location. But it’s a pain, and takes forever to do well.
Shown off at Adobe MAX, Adobe’s new Scene Stitch technology aims to solve this. Essentially, it works like Content Aware Fill. You select an area you wish to replace, and Photoshop figures out what to put in its place. Instead of looking only at the loaded image, though, it will look at a huge database of images. Then presents several possible options to fill the space.
The Adobe MAX conference just ended today, and its closing brought about some very cool sneak peeks of Adobe tech. One such piece of new technology is what Adobe call “Cloak”. It allows you to remove unwanted things from videos. Essentially, it’s like Content Aware Fill for video. And it’s pretty amazing.
Adobe do warn, though this is an early look at the technology. It may or may not be features that they integrate into products down the road. But I can’t imagine that this won’t be added into After Effects (in which the tech was demonstrated) or Premiere somewhere down the line.
Content Aware Fill is one of those features of Photoshop that many users love to hate. So much so that quite a few of us have called it Content Aware Fail since it was first introduced in CS5. Personally, I’ve only found it to be really all that useful for extending clear blue skies, and even there it occasionally wants to put a branch or a building flying in the middle of nowhere.
This video from the Jesús Ramirez Photoshop Training Channel, though, shows me something I never knew about Content Aware Fill. That it respects layer masks. Something which turns it into a much more reliable and useful tool. This method makes it very easy to use Content Aware Fill where you previously might not have even tried.
The video, presented by Stephen Neilson from the Adobe Photoshop team, walks us through the new feature. Designed to help us fill in the gaps when rotating and cropping images, Stephen shows us how content aware crop differs to the current crop tool.
Adobe’s Content Aware Fill tool is one of the most incredible pieces of editing technology to come around in a long time. Sure, it’s nothing more than an automated clone and stamp tool, but with each update it seems to get more and more intelligent, making removal of unwanted objects more simple than ever.
To demonstrate, YouTube user wopkins has created a helpful tutorial showing how the Content Aware Fill tool can be used to help finish your homework, make a sandwich and even clean your room![Read More…]