DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

AI “Deep Nostalgia” images have deep limitations

Mar 2, 2021 by Allen Murabayashi 5 Comments

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

News outlets and social media accounts have been overrun with old photos that have been animated with MyHeritage’s “Deep Nostalgia” feature, an AI-based deep learning algorithm licensed from Israeli-based D-ID.

In this episode of PhotoShelter’s podcast, Vision Slightly Blurred, Sarah and Allen discuss “Deep Nostalgia” along with The Silver List, Juergen Teller’s latest for W Magazine, and the hype around the photo app Dispo.

Using several reference videos around which static photos are mapped, the technology makes eyes dart around, blank expressions turn into smiles, and heads move as if looking back at the viewer. The effect, like many previous deep fake examples, isn’t quite human – but judging by the excited social media reaction, it’s clear that the technology has cleared the uncanny valley. It’s a strange blend of Apple’s LivePhotos meets Harry Potter.

Eager to test the technology and having recently read “To Make Their Own Way in the World: The Enduring Legacy of the Zealy Daguerreotypes,” I uploaded high-resolution versions of the two most famous Zealy Daguerreotypes that depict the enslaved father and daughter Renty and Delia.

But after uploading I received the following message:

“We did not detect any face in your photo. Please try animating another photo.”

Giving the service the benefit of doubt, I uploaded a second image of Delia, but received the same error.

Bias in facial recognition software is a known problem. Black and brown people have been misidentified as gorillas and are subject to lower accuracy rates, so much so that companies like IBM have restricted its use from law enforcement organizations. Without knowing the specifics of the facial recognition algorithm, it’s hard to explain what’s happening, but suffice it to say, there is clearly a face in the image. And MyHeritage’s tech can’t find it.

Instead, I decided to upload a photo of my deceased grandparents. This time the service was able to easily detect faces and generated the following animation of my grandmother.

While the casual observer might marvel at the animation, I can decidedly tell you that this does not appear like my grandmother at all. The generated movements, expressions, and facial shape when her head swivels does not match what she looked like in real life.

This incongruity led me back to this animation of Frederick Douglass.

Frederick Douglass, the mighty abolitionist, was the single most photographed person in the United States during the nineteenth century. Here's how he might've looked in motion. Brace yourself and press play. pic.twitter.com/HOxDK7jGyh

— La Marr Jurelle Bruce (@Afromanticist) February 28, 2021

Of course, MyHeritage is making no claims as to the accuracy of the animations. This nascent use of “deep fake” technology still falls under the novelty category, and has clearly been a huge marketing win for the genealogy company.

But we live in an age of disinformation, and people will be fooled into thinking that this is how people appeared in the past, or that these short snippets are actual films made before motion pictures even existed.

Historical fiction exists in literature and in movies and TV (i.e. Netflix’s The Crown), so why not this application of technology and photography? Would it be palatable if it were more accurate (and over the top) like @deeptomcruise on TikTok?

@deeptomcruise

I love magic!

♬ original sound – Tom

Nothing will stop this technology freight train that we’re on. But the high availability and ease-of-use shouldn’t preclude us from critically assessing the limits of the technology, and the psychology of why we desire them so much.

About the Author

Allen Murabayashi is a graduate of Yale University, the Chairman and co-founder of PhotoShelter blog, and a co-host of the “Vision Slightly Blurred” podcast on iTunes. For more of his work, check out his website and follow him on Twitter. This article was also published here and shared with permission.

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

White House Lifts Ban on Photography, But With Limitations Melting Ice Cream Never Looked As Good It Does In These Nostalgia Inducing Long Exposures This Kodak Portra promotional video from 1998 fills us with glorious nostalgia Adobe’s new deep learning tech might make green screen keying obsolete

Filed Under: Inspiration Tagged With: AI, Allen Murabayashi, Artificial Intelligence, Deep Nostalgia

Guest Author: from diyphotography.net

About Guest Author

This article was contributed to DIYP by a member of our community. If you would like to contribute an article, please contact us here.

« This Milky Way photo reaches deeper into space than you’re used to
Watch and learn the difference between “YouTube lighting” vs “cinematic lighting” »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Here’s a bullet time video booth you can build yourself
  • Ricoh has discontinued the HD PENTAX-DA 21mm F3.2AL Limited silver lens
  • This “stellar flower” unravels the twilight’s evolution in 360 degrees
  • Strobes vs Continuous LEDs – Which is right for you?
  • Wave goodbye to Apple’s My Photo Stream next month

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy