DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Move Over Schlieren, Scientists Are Upping The Sound Wave Photography Ante

Aug 5, 2014 by Tiffany Mueller Add Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Okay, Schlieren photography is still pretty awesome. I’m actually still quite fascinated with our ability to photograph sound waves. I also love that I can do it myself for less than $10.  But, this project announcement from MIT is pretty wicked, too. Scientists from Microsoft, MIT, and Adobe have developed a way to use similar science to recover the audio from images taken using high speed cameras and even a prosumer level DSLR.

MIT_sound_photo

By placing a camera behind a window of soundproof glass and focusing the camera on an object in a room on the other side of the glass, researchers have successfully reproduced sound from vibrations bouncing off the object. Here’s how Abe Davis’s Research explains it:

“When sound hits an object it causes that object to vibrate, the motion of this vibration creates a subtle visual signal that’s usually invisible to the naked eye. In our work, we show how using only a video of the object and a suitable processing algorithm we can extract these minute vibrations and partially recover the sounds that produced them letting us turn everyday objects into visual microphones.”

To be clear, no audio microphones were used to record any of the data. An algorithm processes data taken from the images, all of which were captured using cameras capable of shooting thousands of frames per second (not by coincidence, that is faster than the frequency of an audio signal). However, they were also able to replicate the results using an ordinary consumer level DSLR, though, admittedly, the results are not nearly as clear as with the high speed images. Take a look:

They discovered a loophole of sorts in the DSLR’s rolling shutter which essentially allows them to recover sound at frequencies 3 times greater than the frame rate of the video.  (For those not in the know, a rolling shutter captures images one row of pixels at a time by rapidly scanning the scene horizontally or vertically rather than just recording the entire scene at the same time.)

To put their audio creations to the test, the team employed Shazam (an app which recognizes a song and outputs the title and artist) to see if it could actually recognize a song they reproduced by photographing a pair of earbuds connected to a laptop.

MIT_sound_photo_1

And just how tiny are these vibrations? According to the scientists, some of the motions they recorded were one tenth of a micrometer. In lamen’s terms that is about five thousandths of a pixel if you are looking at it in close-up view.

As for it’s purpose other than just being cool, the potential uses of such a tool seem obvious, but I like to see it the way UC Berkley professor, Alexei Efros, so eloquently puts it:

“I’m sure there will be applications that nobody will expect. I think the hallmark of good science is when you do something just because it’s cool and then somebody turns around and uses it for something you never imagined. It’s really nice to have this type of creative stuff.”

The science side of this story is pretty interesting, but I’d be especially excited to see what kind of artistic applications can be made of it were the project ever to become available for such uses. What do you think creatives, what sort of things are possible for us with this technology?

[ via MIT | PetaPixel ]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

Scientists Capture The First Ever Photo Of Light As A Particle And Wave Need sound effects? Rode’s entire Ambisonic Sound Library is now available to download for free Get perfect sound in your videos with $5 DIY sound absorbing panels Scientists Announce Worlds Fastest Camera, Capable of Capturing 4.4 Trillion Frames Per Second

Filed Under: news Tagged With: high speed photography, Rolling shutter, SCHLIEREN PHOTOGRAPHY

Tiffany Mueller: from diyphotography.net

About Tiffany Mueller

Tiffany Mueller is a photographer based in Hawi, Hawaii. You can follow her Twitter here and her personal life here.

« DJI’s Newest UAV Adresses Function Over Form, and Manages to Keep its Form As Well
This King’s Canyon Timelapse Is A Display Made For Kings »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Nikon adds Z8 support for NX Studio, SnapBridge and other Nikon apps
  • Your brain is lying to you – These eyes aren’t blue
  • Adobe and MIT develop new way to identify materials in images using AI
  • Sony refreshes its compact vlogging camera with the ZV-1 II
  • Take better self portraits with this advice from professional models

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy