Object recognition and AI has come such a long way in such a short amount of time that effects that used to take hours can now be automated in just a few seconds. Adobe MAX 2018 is going on right now and they’re showing off one example of this in their Sneak Peeks. It’s called Moving Stills, and it’s insane how well it works for a concept demo.
Basically, you feed in a still photograph, click a button and it will automatically figure out the depth of objects in the scene. Then it will animate a virtual camera through the scene to simulate a real camera movement. And it can do it with no intervention. But you can also override things if you wish.
The idea of this isn’t new. Andrew Kramer’s had a tutorial on how to do this in Adobe After Effects on Video Copilot for 11 years. But what is new is the technique. It would previously require a lot of manual cutting out and cloning in Photoshop, saving out to a bunch of separate images, and then bringing them into After Effects in a 3D scene to simulate some real depth between them, and then animating the camera.
Now it’s all possible with the click of a button and some fancy code.
But what’s really cool is that it doesn’t just spit out some random camera movement. You are offered a whole bunch of different camera movement from which to choose.
And you’re not limited to just these 8 options, either, you can manually define an area, and then it will simulate camera movement in three dimensions.
The concept still has a little way to go. You can see in some of the examples shown in the video, particular scenes with chairs that have holes in the backs, that it doesn’t always correctly determine what is part of the background. But the technology is still in its early days. So, I imagine this can only get better over time as the AI and object recognition improves.
There’s no word on when this might actually become available yet, or if it will come at all. And even if it does become available, there’s no mention of whether it’ll come to Photoshop, Premiere, After Effects or something else entirely. It’s just a tech sneak peek. But it’s amazing that a technique that was once so time-consuming is now possible in just a few clicks and may soon be available to the masses, even if it’s not quite perfect yet.
If you want to check out the full video with all of Adobe’s sneak peeks from Adobe MAX 2018, here you go…
And you can read about the other sneak peeks on the Adobe blog.