Nvidia uses AI to transform standard videos into slow motion

Jun 19, 2018

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Nvidia uses AI to transform standard videos into slow motion

Jun 19, 2018

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Join the Discussion

Share on:

If you’ve ever tried slowing down a video shot at 30 fps, you know that it becomes choppy and unusable. Nvidia has an AI-based solution for that which can turn your standard videos into watchable slow motion. The algorithm predicts what should come between two frames and fills in the space between them. As a result, you can get perfectly usable slow motion videos even if they were shot at 30 fps.

Basically, the AI observes two different frames of the footage. It tracks the movement of objects from one frame to the next and based on this, it creates the frame to fill in space. This way, you get more frames, and thus a slow motion footage that looks smooth.

“But my smartphone already shoots slow motion at 240 fps!” I hear you say. True, there are even phones shooting at 960 fps. However, Nvidia researchers explain that shooting slow motion with smartphones can be impractical, “as it requires large memories and is power-intensive for mobile devices.”

With this new technology from Nvidia, you should be able to record a standard video and slow it down later. The AI will predict frames that will fill in the empty space. You’ll use much less of the phone’s memory, and still end up with a nice and smooth slow motion footage. There are still some improvements to be made, though, but you can expect to see this tech in your phone in the near future, The Verge writes.

Finally, here’s a video demonstration so you can see how this works. Although it still needs some improvement, it looks pretty impressive already:

YouTube video

[Nvidia via The Verge]

Filed Under:

Tagged With:

Find this interesting? Share it with your friends!

Dunja Djudjic

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Join the Discussion

DIYP Comment Policy
Be nice, be on-topic, no personal information or flames.

Leave a Reply

Your email address will not be published. Required fields are marked *

2 responses to “Nvidia uses AI to transform standard videos into slow motion”

  1. Aankhen Avatar
    Aankhen

    This isn’t perfect, but it’s stunning nevertheless. If I weren’t seeing the videos side-by-side it would be hard to say with confidence that the interpolated videos weren’t genuine (although the artifacts would give them away).

  2. rutenrudi Avatar
    rutenrudi

    > If you’ve ever tried slowing down a video shot at 30 fps, you know that it becomes choppy and unusable.

    Regardless that the demo is impressive in most parts, you guys never heard of motion estimation or optical flow? It’s not really new. Sure, often comes with artifacts, but nVidia does too.