This app perfectly retouches your photos before you take them

Aug 3, 2017

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

This app perfectly retouches your photos before you take them

Aug 3, 2017

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Join the Discussion

Share on:

Photo enhancing apps have come a long way over the past few years. However, researchers from MIT have worked with Google and have gone a step further: they are introducing an app able to retouch your photos before you even take them.

They use deep learning to create the software. When you turn the app on, it enhances your images in real time, and you can see the expected outcome on the display before you snap a photo. It’s able to retouch the images in different styles, and it should be small enough not to be laggy on a mobile device.

YouTube video

The researchers trained neural networks on 5,000 images by MIT and Adobe Systems. Five different photographers retouched these images, and the neural network based its guidelines on these enhancements. They also trained the system on thousands of pairs of images produced by other enhancing algorithms, such as the one for creating HDR images.

There were previous attempts to achieve real-time image enhancements. They were based on retouching a low-resolution image, with the output of a high-res one. However, it turned out not to be a good solution in practice, because the low-res image would leave out too much data. The new app uses a set of formulae that apply enhancements directly to all pixels in a hi-resolution version of the source photo.

Although this app shows image modifications in real time, the developers state on MIT blog that it shouldn’t take up more space than a single digital photo. So, thanks to this, it will be possible to “process images in a range of styles.”

We’ve seen many interesting (more or less successful) apps so far that rely on machine learning: from resolving blurry footage to predicting the next photo from the previous one. You can even change the weather in a photo or apply the style of one photo to the other. However, all of them are intended to be used after you take the shot. This app, however, is the first one so far that edits the photo as you still frame the shot.

As the MIT blog states, even the casual phone photographers spend at least some time editing their photo (not to mention the professionals). So, this app is aimed at saving time and energy you spend on the editing. Judging from the sample video, the results aren’t bad at all, but I’m curious to see more.

If you’d like to learn more about the app, you can check out this link, and visit the official MIT blog.

[via Gizmodo]

Filed Under:

Tagged With:

Find this interesting? Share it with your friends!

Dunja Djudjic

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Join the Discussion

DIYP Comment Policy
Be nice, be on-topic, no personal information or flames.

Leave a Reply

Your email address will not be published. Required fields are marked *

7 responses to “This app perfectly retouches your photos before you take them”

  1. Keith A Varley Avatar
    Keith A Varley

    Isn’t that just being lazy?

  2. Bob Harris Avatar
    Bob Harris

    Just take my money and get it over. ??

  3. catlett Avatar
    catlett

    Well that’s interesting. I never knew there was such a thing as perfect retouching. #sarcasm

  4. William Falls Jr. Avatar
    William Falls Jr.

    When is it supposed to be available?

  5. Jade Holing Avatar
    Jade Holing

    It renders an HDR in real time, which ain’t exactly retouching, and image used in the example looks like all it’s done is lift the shadows and lost the drama in the sky

    1. Sandro Alencar Mrowinski Avatar
      Sandro Alencar Mrowinski

      just on examples, but truth is that is far more complicated. first, as u can see in the examples there are none (or much less) hallo. second u can see that u still can recover the shadows and highlight (just need to recover the info from 3d matrix). blieve m is really beautiful solution for a mobile phone

  6. Hert Niks Avatar
    Hert Niks

    Get back to me when this is more than a concept.