DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Tiny vibrations bring still photos to life in dynamic interactive images

Aug 4, 2016 by John Aldred 2 Comments

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

vibration_interactive_photos

A photograph is, by its very nature, a still image. Good ones perform their task very well. As technology has evolved the lines between photo and video have started to become a little blurred. We’ve got live photos, Instagram supports video, and now wants to be SnapChat.

Then we have augmented reality. The combination of computer generated data and real world imagery in real time.

The big problem with augmented reality is that the two don’t really mix together too fluidly yet. MIT PhD student Abe Davis has figured out a possible way to solve this problem. It’s a process he calls Interactive Dynamic Video. It uses tiny vibrations picked up in video to simulate real world movement in still images.

It’s a very cool concept. The principle of the whole thing seems fairly straightforward. I would imagine the implementation is far more complex, though.

A video of anywhere from a few seconds to a few minutes is recorded and processed to detect “vibration modes”. Each of these modes represents a different way that an object can move. Analysing the vibration modes then allows the software to predict how the object will act in new situations.

In short, you can click and drag sections of it and it’ll react somewhat as it would in reality.

vibration_modes

The process can work with some pretty complicated objects, too. One of the markets this technology targets is the low budget filmmaker. Indeed, it could be an inexpensive way to have CG interact with the real world in your footage.

What’s really exciting about this technique is that it can work even when we don’t know the 3D shape of an object.

– Abe Davis

Complex subjects with lots of detail are still difficult and expensive to 3D scan. This becomes especially so when you can’t take them into a controlled and lit studio environment. While interactive dynamic video doesn’t allow the same versatility as a 3D scanned digital model, it will get you part of the way there.

moving_bush

This technology means you could have green screened actors, or completely CG characters interacting with the environment around them. This principle also holds true for augmented reality, as you can see in one of Abe’s more amusing demonstrations.

It’s a fascinating technology, and I really wish I fully understood the technology behind it. The implications of what it offers are huge, far beyond the filmmaker or augmented reality examples mentioned above.

A slightly more serious and potentially life saving application of this technology is for structural health monitoring. This is a process of monitoring structures to ensure that they’re still sound. Structures get weak over time, or become damaged due to accidents or nature. These weaknesses aren’t always easy to detect. In the future, they may become obvious after recording just a few minutes of video.

structural_health_monitoring

Wherever the technology goes, the possibilities and applications for it seem pretty wide. The only question we have to ask now is how much will Facebook attempt to buy it for?

What ideas can you think of where this technology could be useful? Let us know in the comments.

[via BBC]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

Yale Organized 170,000 Depression Era Images And Organized Them Into An Awesome Interactive Photo Map The ultimate selfie machine: a 14ft interactive head displaying photos taken inside of it This DIY interactive globe helps you quickly browse your travel photos NASA’s free interactive e-book is full of spectacular aerial photos of Earth

Filed Under: news Tagged With: Abe Davis, augmented reality, Interactive, Massachusetts Institute of Technology, MIT, PhD, pokemon go

John Aldred: from diyphotography.net

About John Aldred

John Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

« Photographing wild horses has left me in peace
How to shoot an iconic whiskey ad on a giant ice cube »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup

Recent Comments

Free Resources

Advanced lighting book

Learn photography

Recent Posts

  • Nikon announces Zf shortage (Surprise!)
  • Finally! Sennheiser EW-DP SKP plug-on transmitter offers 32-bit float recording
  • Photographing an abandoned Italian villa: A time capsule of history and mystery
  • The Tascam DR-10L Pro is an unclippable 32-bit float personal audio recorder
  • This year’s Nature TTL POTY winner puts global warming right in our faces

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy