Nvidia trains AI to remove noise and watermarks by looking only at corrupted photos

Jul 10, 2018

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Jul 10, 2018

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Join the Discussion

Share on:

There are different ways to remove or reduce noise, and there are also ways of removing watermarks from images. But Nvidia has recently introduced a deep learning-based approach which has learned to fix photos by looking only at corrupted photos.

YouTube video

Noise reduction

The researchers from NVIDIA, Aalto University, and MIT have worked on this project. Similar work in this field has been focused on training neural networks by showing both clean and corrupted images as examples. But in this method, the approach is different. The researchers only used two input images with noise or grain to train the AI to fix them.

 

While this approach can be useful in photography, I find it interesting that it’s also potentially useful in medicine. The method can be used to enhance noisy MRI images, which can certainly make these images clearer and help doctors see MRI images in more detail.

Text removal

While noise reduction is definitely a welcomed feature and can be used in the fields other than photography, the same method can also remove text from images. To train the neural network, the researchers used images corrupted with large, varying number of random strings of letters in random places. They were also on top of each other, and with the randomized font size and color.

While the result is pretty impressive, this method can potentially be misused to remove watermarks from images. On the other hand, there are solutions that help to make watermarks difficult to remove. Or perhaps an invisible digital watermarking system can keep your photos safe from theft and watermark removal. At least for now.

[Research at NVIDIA: AI Can Now Fix Your Grainy Photos by Only Looking at Grainy Photos |Nvidia]

Filed Under:

Tagged With:

Find this interesting? Share it with your friends!

Dunja Djudjic

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Join the Discussion

DIYP Comment Policy
Be nice, be on-topic, no personal information or flames.

Leave a Reply

Your email address will not be published. Required fields are marked *

2 responses to “Nvidia trains AI to remove noise and watermarks by looking only at corrupted photos”

  1. Madara Avatar
    Madara

    Adobe, your move.

  2. Franco Kailsan Avatar
    Franco Kailsan

    If I have old digital photos that have had its format changed a few times causing it to be pixelated and blurry, is there a software that can clean it up? Most of the software I tried just smoothen things out too much.
    * When digital photography was in its infancy, I didnt know about the perils of changing a photo’s size and format which is why I messed up those photos. I’m smarter now.. not by much though…