DIY Photography

Hacking Photography - one Picture at a time

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

This camera can record sound without a microphone, it just sees the vibrations

Jun 24, 2022 by Alex Baker Leave a Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Researchers from Carnegie Mellon University appeared to have solved the age-old problem of microphone bleed-through, using just a couple of cheap video cameras. Instead of recording sound using microphones, the cameras see the vibrations created by individual instruments and then translate that back into sound waves.

No matter how good microphones are, there are always going to be drawbacks when recording multiple instruments. In order to be able to edit the sound in post-production of just one instrument, they first have to be isolated. That’s why recording studios are set up usually with more than one room, or the instrument tracks are recorded separately and layered one on top of the other.

But recording music that way takes a considerable amount of time, equipment, and money, and it also isn’t the most effective way to get the best musical performance from musicians who are more used to playing live together in a grungey bar than separately in a sterile studio environment.

What if you were able to record all the musicians performing together but you were also able to retain the ability to mix each instrumental track separately without bleed through?

Well, that’s where the researchers at Carnegie Mellon University’s School of Computer Science’s Robotics Institute turned to video cameras instead. If you pluck the string of a guitar or violin, you don’t just create sound waves, you can actually see the vibration. With the right equipment, those vibrations can be visualized and analyzed to recreate the sounds being produced, even if no sounds are recorded.

Optical microphones are not a new idea, but what the CMU researchers have come up with, and shared in a recently published paper, ‘Dual-Shutter Optical Vibration Sensing,’ is a way to make them work using low-end, and more affordable, camera gear.

The new system shines a bright laser light source on a vibrating surface, like a guitar’s body, and captures the movements of the resulting speckled pattern of light. The range of human hearing can detect sounds oscillating as fast as 20,000 times every second, so optical microphones have typically relied on expensive high-speed cameras to capture physical vibrations oscillating just as quickly.

However, the team at CMU have got around that issue by using 2 types of camera at the same time. One with a global shutter that captures entire frames of video, resulting in distinct speckled patterns, and one with a rolling shutter that captures frames line-by-line from the top to the bottom of the sensor, resulting in distorted speckled patterns that actually contain more information about how they move back and forth over time.

The frames from each camera are then compared with each other using a special algorithm up to 63,000 times a second. That’s as fast as a super expensive optical microphone but at a fraction of the cost.

The audio quality isn’t yet as high as a traditional microphone would give, however it could give sound engineers and producers more control when recording live music or very large ensembles such as symphony orchestras.

The system also has other potentially interesting applications outside of music. A video camera monitoring all the machines on a factory floor, or pointed at the engine of a running car, could determine when individual parts or components are making an abnormal sound, indicating maintenance may be required before a problem actually becomes a problem.

[Via Gizmodo]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

Five tips to record better quality sound with your shotgun microphone Need sound effects? Rode’s entire Ambisonic Sound Library is now available to download for free Easily and cheaply record external audio for cameras without microphone sockets Get perfect sound in your videos with $5 DIY sound absorbing panels

Filed Under: news Tagged With: Carnegie Mellon, Music video, optical microphone

About Alex Baker

Alex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

« Want to take macro wildlife photos? Start with these five tips
Hoya has launched their new Mist Diffuser Black series No0.5 and No1 filters »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Hipstamatic app relaunches as a social network, but only for iOS
  • Instagram now has ads even in search results. Sigh
  • Panasonic has finally developed its 8K organic global shutter OPF CMOS sensor
  • Instagram co-founder hates how “soulless” the app has become
  • Watch: 14-Earths tall tornado hurls across the Sun’s surface

Alex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

Dave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy