Adobe Lightroom and Camera Raw now use AI to enhance details in your photos

Feb 12, 2019

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Adobe Lightroom and Camera Raw now use AI to enhance details in your photos

Feb 12, 2019

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Join the Discussion

Share on:

Adobe has been using its AI-powered Sensei technology to introduce various upgrades to its apps. In the most recent upgrade, Camera Raw, Lightroom Classic, and Lightroom CC became able to enhance details in your images and give you up to 30% higher resolution on raw files.

The new feature is called Enhance Details and it uses machine learning to provide “state-of-the-art quality” for your images. Adobe explains that it approaches demosaicing in a new way, so it provides better resolving fine details and fixing issues like false colors and zippering.

Demosaicing process can be tricky if your image has some more regions: texture, fine details, repeating patterns, or sharp edges. In these cases, “standard demosaicing methods can struggle, producing lower resolution and problematic artifacts,” Adobe explains in a blog post. It is possible to handle these complicated areas, but the problem with the advanced methods is that they’re computationally expensive. This is where Enhance Details steps in, and Adobe explains how it works:

Enhance Details uses an extensively trained convolutional neural net (CNN) to optimize for maximum image quality. We trained a neural network to demosaic raw images using problematic examples, then leveraged a new machine learning frameworks built into the latest Mac OS and Win10 operating systems to run this network. The deep neural network for Enhance Details was trained with over a billion examples.

Each of these billion examples contained one or more of the major issues listed above that give standard demosaicing methods serious trouble. We trained two models: one for the Bayer sensors, and another for the Fujifilm X-Trans sensors.

Adobe promises that Enhance Details delivers higher resolution, more accurate rendering of edges and details, and fewer artifacts like false colors and moiré patterns. It’s worth noting that it works on both Bayer (Canon, Nikon, Sony, etc.) and X-Trans (Fujifilm) raw mosaic files.  However, there are some system requirements and things to take into consideration:

  • Enhance Details requires Apple’s Core ML and Microsoft’s Windows ML. In other words, it won’t work on older operating systems, so you need to update to macOS 10.13 or Win 10 (1809) or later.
  • Enhance Details requires intensive processing, and it can take some time to do its work.
  • Faster GPU means faster results. An eGPU (external GPU) can make a big difference.

[image credits: Adobe]

Find this interesting? Share it with your friends!

Dunja Djudjic

Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Join the Discussion

DIYP Comment Policy
Be nice, be on-topic, no personal information or flames.

Leave a Reply

Your email address will not be published. Required fields are marked *

7 responses to “Adobe Lightroom and Camera Raw now use AI to enhance details in your photos”

  1. Viktor Wågman Avatar
    Viktor Wågman

    Enhanced Details?

  2. Paul Monaghan Avatar
    Paul Monaghan

    Took me 12 seconds on a Sony a7ii file, it just looked the same really although I only tried one file and it was a landscape with a river

    I’ll try some more but really I think I’ll stick to my Foveon :).

    https://uploads.disquscdn.com/images/4e0b7fc43875c5f4cc2308148128521b949a53afa0e24a70a83ccd347baba2de.jpg

  3. MegaNickels Avatar
    MegaNickels

    Looks the same to me :/

  4. Paul H Avatar
    Paul H

    My son is a software developer who specialises in AI software. If I want to annoy him I just send him the link to articles like this, and then I get the lecture that using algorithms does not an AI make, and that I should not be duped by what is nothing more than a marketing ploy. He reckons if this was AI all software capable of Image sharpening would also meet the definition of AI. If I really want to get him going I just have to say that the Pixel 3 phone uses AI in image processing!!!!

  5. Lorenzo Coopman Avatar
    Lorenzo Coopman

    I have a little Panasonic tz90 that is notoriously bad with fine details (small sensor, lots of megapixels) I thought if this really works it should improve the raw files really visually but no, it’s just marketing.

    1. Paul H Avatar
      Paul H

      Topaz was the first to use algorithm technology, The have AI clear at $60 and AI gigapixel at $100. I don’t use these but I do use a few of their non AI modules and find them quite good.

  6. Chas Avatar
    Chas

    I cant see any difference in my RAW files ??