DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Meta launches text-to-video generator and it’s giving me nightmares

Sep 30, 2022 by Dunja Djudjic 1 Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

AI text-to-image generators have been in full swing lately. Even text-to-video has become a thing, now Meta has introduced its own. Just like the rest of these generators, Meta’s Make-A-Video AI model lets you turn textual prompts into short video clips.

Make-A-Video offers three different styles of videos: surreal, realistic, and stylized. And while I still find it impressive that this technology even exists – even the “realistic” videos give me the creeps.

“It’s much harder to generate video than photos because beyond correctly generating each pixel, the system also has to predict how they’ll change over time,” Meta CEO Mark Zuckerberg writes in a Facebook post. “Make-A-Video solves this by adding a layer of unsupervised learning that enables the system to understand motion in the physical world and apply it to traditional text-to-image generation.”

All of these videos were generated by an AI system that our team at Meta built. We call it Make-A-Video. You give it a text description and it creates a video for you.We gave it descriptions like: "a teddy bear painting a self-portrait", "a baby sloth with a knitted hat trying to figure out a laptop", "a spaceship landing on mars", and "a robot surfing a wave in the ocean".This is pretty amazing progress. It's much harder to generate video than photos because beyond correctly generating each pixel, the system also has to predict how they'll change over time. Make-A-Video solves this by adding a layer of unsupervised learning that enables the system to understand motion in the physical world and apply it to traditional text-to-image generation.We plan to share this as a demo in the future. In the meantime, enjoy the videos…

Posted by Mark Zuckerberg on Thursday, September 29, 2022

It’s worth noting that Meta isn’t the first to use this kind of technology in a social media app. TikTok introduced it in August, but it’s text-to-image rather than text-to-video. So it looks like Meta will finally do something first rather than ripping off TikTok’s ideas.

As I said, Meta’s text-to-video generator creates surreal, realistic, and stylized types of videos. The surreal ones are… Well, surreal, and all of the examples are going to give me nightmares for sure.

Some realistic video examples are pretty awesome, like this artist brush painting on a canvas:

But this couple walking in the rain is creepy as hell, they look like conjoined twins:

Zuckerberg writes that Meta plans to share this as a demo in the future, although it’s not specified when. In the meantime, check out the announcement page and see the videos generated from a few lines of text.

[via Digital Trends]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

TikTok launches text-to-image generator in app You’ve heard of text-to-image AI, now text-to-video is here This Time Lapse Of Hatching Bees Will Give You Nightmares Tenikle is not a creature from your nightmares – It’s a camera mount

Filed Under: news Tagged With: AI, Meta, text to image, text to video

Dunja Djudjic: from diyphotography.net

About Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

« AI image creator DALL-E is now open for everyone
A pair of Sony’s new 640GB CFexpress Type A cards costs more than your Sony FX30 preorder »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Here’s a bullet time video booth you can build yourself
  • Ricoh has discontinued the HD PENTAX-DA 21mm F3.2AL Limited silver lens
  • This “stellar flower” unravels the twilight’s evolution in 360 degrees
  • Strobes vs Continuous LEDs – Which is right for you?
  • Wave goodbye to Apple’s My Photo Stream next month

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy