Meta Movie Gen just launched – new AI video generator competes with OpenAI's Sora

Meta announced today (October 4) a new AI-powered video and audio generator to compete with OpenAI's Sora and ElevenLabs' AI voice tools. Called Movie Gen, it can create realistic-looking video and audio clips based on user input, as well as edit existing footage or images with text.

While there's no timeline yet for when Movie Gen will be available to the public, samples of its creations shared by Meta showed videos of thunderous claps over the desert, animals swimming and a child running along the beach with a kite, all through text prompts were generated.

The software suite can also generate audio signals such as ambient sounds, sound effects and background music that are synchronized with the images, Meta said in a blog post. Movie Gen can create 1080p videos up to 16 seconds long in various aspect ratios, while audio can be up to 45 seconds long, Meta said.

In addition to generating new clips, Movie Gen can also be used to edit existing video recordings. In one such video, Meta had the tool replace a floating lantern with a series of bubbles. In another, pom-poms were placed in the hands of a man running through the desert, while in a third his clothes were replaced with an inflatable dinosaur costume, showing how further optimizations can be made via text input. Meta also demonstrated how it can create a video of a person using just a still image and a text prompt.

Meta Movie Gen is on site! Our groundbreaking generative AI research for media enables: – Convert text to video – Create personalized videos – Precise video editing – Audio creation And while it's just research today, we can't wait to see how humans improve everything. .. pic.twitter.com /I4Bq9if3eKOctober 4, 2024

Chris Cox, chief product officer at Meta Platforms, said a full release is still some way off.

“We're not ready to release this as a product any time soon – it's still expensive and the generation time is too long – but we wanted to share where we're at as the results are pretty impressive,” he wrote in Threads.

The announcement makes Meta the latest major tech company to move full-force into the AI space. In recent months, both Google and Adobe have unveiled AI video generators to compete with third-generation AI video tools from leading media generation startups.

In its announcement, Meta shared data showing blind testing that suggests Movie Gen performs well compared to offerings from startups like Runway, OpenAI, ElevenLabs and Kling. So while we'll have to wait and see if Movie Gen makes our list of the best AI video generators, the early results are promising.

Meta Movie Gen just launched – new AI video generator competes with OpenAI's Sora

You may also like...

Recent Posts

Meta Movie Gen just launched – new AI video generator competes with OpenAI's Sora

You may also like...

7UP to add Shirley Temple flavor for the holidays

DOT urges state Supreme Court to take Map Act case

New lawsuit accuses Sean Combs of rape after he recorded an assault and later distributed it as porn

Recent Posts