Source: Glonui.

Global social media giant $Meta Platforms (META.US)$ launches the latest large-scale movie generator Movie Gen, officially entering the cultural and life video field!

Just last night, Meta publicly demonstrated its groundbreaking generative AI research for media: Meta Movie Gen. And at this critical moment, on October 4th, it was reported that Sora, the head of OpenAI, suddenly announced his departure to join Google DeepMind next.

Precision editing, and even music matching

The biggest technological highlight is that Movie Gen can directly generate videos with precise music, a feature currently unavailable in leading products like Sora, Runway, Luma, and others. It can generate high-definition videos (1080p) up to 16 seconds long at a frame rate of up to 16fps based on text prompts, meeting users' personalized video content needs.

Even more amazing, users can upload their own images to generate personalized videos with their own likeness, offering an unprecedented level of personalized experience.

Understanding object motion, subject-object interaction, and camera motion, various concepts of reasonable motion are all within reach. Specifically, the model can perform precise video editing, including adding, removing, or replacing elements, as well as making global modifications such as changing backgrounds and styles.

Although many video models have been unveiled one after another this year, most can only produce "silent films," which is a pity to discard after tasting. This is also the most eye-catching feature of Movie Gen, as it can generate high-quality sound effects and music based on video content and text instructions, highly matching and synchronizing with the video content.

On a technical level, Movie Gen adopts the latest Llama 3 architecture and introduces stream matching technology. This innovative training method not only improves generation efficiency but also enhances the detail representation of videos.

Meta platforms used as many as 6144 H100 GPUs for large-scale training, ensuring the high performance of Movie Gen.

The application prospects of Movie Gen are very broad.

In the entertainment industry, it can be used to generate movie trailers, music videos, and other content to provide users with a more rich and personalized entertainment experience.

In the education sector, Movie Gen can assist teachers in creating instructional videos to enhance students' learning interests and effectiveness.

In the advertising industry, Movie Gen can quickly generate attractive video advertisements based on advertising ideas to enhance the spread effect of advertisements.

At the same time, Meta is very confident in the performance of Movie Gen. They have conducted a series of manual evaluations, and the results show that in the four aspects of video generation, video personalization, video editing, and audio generation, Movie Gen outperforms similar models in the industry!

The era of q&m dental video creators is opening.

Meta's Movie Gen model has received widespread attention in the industry after its release.

It not only demonstrates Meta's technical strength in the field of AI, but also points out a new direction for the entire industry. With the continuous progress of technology and the continuous expansion of applications, AI video generation will become an important trend in future media content creation.

Meta CEO Mark Zuckerberg stated that Movie Gen will go live on Meta's social media Instagram next year.

Interestingly, he also posted a video generated by Movie Gen on his personal Instagram account, showing him using a leg press machine, with the background changing as he starts exercising.

First, he is shown exercising in a neon-lit futuristic style gym, then it transitions to him working out in gladiator armor, followed by him pushing a burning solid gold machine, and finally transitioning to him using his legs to lift a box of chicken nuggets, surrounded by fries.

After watching the demo presented by Lex Fridman, many netizens expressed admiration concisely. Many users once again criticized OpenAI's futures Sora, but more eagerly awaiting users have already begun to look forward to the opening of the testing experience qualifications.

Some netizens are quite shocked by the comprehensive features of Movie Gen, stating that Meta has made a higher-profile release of Sora than OpenAI.

Meta AI's Chief Scientist Yann LeCun also publicly promotes Meta Movie Gen. On social media, users are equally enthusiastic about the discussion of Movie Gen.

A netizen named @VideoCreator said, "Meta's Movie Gen has shown me the future of video creation, making video production as simple as writing an article."

Editor / jayden