DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

MIT Researchers Developed an Algorithm That Removes Reflections

May 11, 2015 by Liron Samuels 1 Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

MIT-Reflection-Removal-A1

Windows have been ruining photos ever since the first time a photographer tried shooting through one.

Unless you bring along dedicated contraptions or start messing around with cloths and funny angles, shooting through the glass will likely lead to an annoying reflection that will make you want to smash it to pieces. (If you’re actually trying to get a reflection then scratch everything I said; windows are awesome).

This problem might soon come to an end, though; as researchers say they’ve developed an algorithm that can automatically remove reflections from digital photos. The algorithm can’t remove all types of reflections, but it does an impressive job with the ones it can remove.

In order for the algorithm to work the photo must include a set of almost identical reflections, says YiChang Shih of MIT.

The first author on the paper, who just completed his PhD in computer science, say double-paned windows create the perfect reflections for the algorithm. “With that kind of window, there’s one reflection coming from the inner pane and another reflection from the outer pane”, he explained. ”But thick windows are usually enough to produce a double reflection, too. The inner side will give a reflection, and the outer side will give a reflection as well”.

Shih’s co-authors include his thesis advisors – professors of computer science and engineering Frédo Durand and Bill Freeman, and Dilip Krishnan – a former postdoc at MIT and current Google Research employee.

Once the group had the desired double slightly offset reflection, they discovered that the standard techniques used in camera vision wouldn’t work for their purposes.

Eventually they used a new technique co-developed by another of Freeman’s postdocs, Daniel Zoran, and another researcher named Yair Weiss.

MIT News explains how this technique works and helps the final goal of removing reflections:

“Zoran and Yair Weiss of the Hebrew University of Jerusalem created an algorithm that divides images into 8-by-8 blocks of pixels; for each block, it calculates the correlation between each pixel and each of the others. The aggregate statistics for all the 8-by-8 blocks in 50,000 training images proved a reliable way to distinguish reflections from images shot through glass”.

Yoav Schechner, a professor of electrical engineering at Israel’s Technion, said that there have been previous attempts to eliminate reflections, but they had only partial success. One of the drawbacks of these methods was that they were unable to automatically distinguish between the desired image and the reflection.

MIT researchers have created a new algorithm that, in a broad range of cases, can automatically remove reflections from digital photos. On the left is the original photo taken through a window, with the photographer's reflection clearly visible. On the right, the reflection has been separated from the photo. Credit: Courtesy of the researchers

MIT researchers have created a new algorithm that, in a broad range of cases, can automatically remove reflections from digital photos. On the left is the original photo taken through a window, with the photographer’s reflection clearly visible. On the right, the reflection has been separated from the photo. Credit: Courtesy of the researchers

“The ideas here can progress into routine photography, if the algorithm is further robustified and becomes part of toolboxes used in digital photography,” Schechner adds. “It may help robot vision in the presence of confusing glass reflection”.

[via MIT News via Reddit]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

Google & MIT’s New Algorithm Uses Edge Detection To Remove Reflections From Photos There, I fixed it: Google removes the gorilla label from its ‘racist’ algorithm This algorithm removes water from underwater photos, and they look incredible These MIT cinematography drones get the perfect shot every time

Filed Under: Gear

Liron Samuels: from diyphotography.net

About Liron Samuels

Liron Samuels is a wildlife and commercial photographer based in Israel.

When he isn't waking up at 4am to take photos of nature, he stays awake until 4am taking photos of the night skies or time lapses.

You can see more of his work on his website or follow him on Facebook.

« The 20 most Influential Street Photographers According to Streethunters.net Readers
New Bill Could Penalize Well Intentioned Photographers With Fines & Possible Jail Time »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup

Recent Comments

Free Resources

Advanced lighting book

Learn photography

Recent Posts

  • Rode acquires US pro audio company Mackie
  • Panasonic Lumix G9 II to get 12-Bit raw over HDMI for BRAW and ProRes RAW
  • This 3D printed stereoscopic macro lens is the weirdest camera rig you ever saw
  • OBSBOT Tail Air review – a streaming studio the size a soda can
  • Everything you need to know about the photographer-agent relationship

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy