New AI-powered video generator Meta Movie Gen amazes everyone with editing, replacement, and custom videos
Meta does not stop for a single second, and it is that just a couple of days ago and as if nothing had happened, it has presented what will be its new video generator through artificial intelligence called Meta Movie Gen
The company that owns Whatsapp, Instagram and Facebook Follow step by step with his adventures in the world of AI. Continue with LLama and new models with ever more capabilities —more than 400B parameters—
On the other hand, it also bets on the gadgets powered by artificial intelligence and increasingly the Ray-Ban Meta is starting to become a reference in this field of AI devices, in which others are failing almost recurrently, to my misfortune…
That is why this presentation has been so striking, and it is that Meta Movie Gen It's not just going to be an AI video generator as we've seen on other occasions. We have the well-known Runway, Kling or most recently the current version of Pika which I talked about not long ago.
Meta Movie Gen: Artificial Intelligence that Creates High Definition Videos from Text
What can this video creation tool do? Perhaps the right question would be: "what can't he do", and it feels like they are going to revolutionize this emerging AI-generated video space, given what they have shown.
At the moment, it is able to generate high-quality videos just by providing a written description. But this is the easy part. This AI doesn't just create videos, but you can also customize and edit them with great precision. Below, I explain how it works and what makes it so innovative.
What is MetaMovieGen?
Meta Movie Gen is a set of AI models designed to create high definition videos (currently FullHD 1080p), following written instructions. Come on, the prompts for lifeThis means that you can describe a scene, and the AI will generate a video that fits that description.
But we had already seen this before in other AI's like the ones I mentioned before. The most interesting part comes now, since in addition, If you provide an image, Meta Movie Gen can generate a custom video in which the person in the photo appears performing the actions you indicate.
How do you train MetaMovieGen?
The system uses a technique based on transformers, a type of AI model that has proven to be very effective at interpreting large amounts of data. Meta Movie Gen was trained with millions of videos and images from the Internet.
This allows you to understand how objects and people move in the real world, as well as how certain environments sound. This allows it to not only generate coherent videos, but also sounds synchronized with actions, such as the sound of footsteps or the sound of wind.
MetaMovieGen's Core Capabilities
MetaMovieGen stands out for its ability to perform several key tasks in media generation:
- Generating videos from text: It is capable of generating videos just by describing what you want to see. In essence, this is a functionality that we already know. There are many artificial intelligences that do the same thing today.
Here the fight is to see who manages to adapt the style we want in the best way. At the moment and based on the examples that the same has given Meta on your website, it seems that he has mastered the hyperrealistic style…
- Personalization of videos: This is where a big part of the appeal of this new tool comes in. If you provide an image of someone, whoever it is, the AI can generate a video in which that person is the protagonist.
Imagine the possibilities with this concept: prank videos, gift videos, personalized movies… I can't imagine everything that could be done with a little imagination.
- Video editing: These edits are great if they turn out to be what they showed in the presentation. You can give instructions to modify an existing video, such as changing the background or adding new elements.
It doesn't matter the landscape, the clothes or the accessories. We can take a flat video and turn it into something fantastic simply with a text prompt.. Look at the result of this example… As before, the possibilities are endless.
- Synchronized sound generation:And this really blew my mind… Give volume to the video. Meta Movie Gen can create sound effects and music that perfectly fit the generated video.
In this case you have a waterfall and the sound of falling water, but no more searching for audio effects. The AI will recognize the landscape and be able to add the sound it needs to make it coherent with the image…
Technical Innovations
The heart of Meta Movie Gen is its ability to handle large amounts of video and audio data simultaneously. It uses an approach known as compression spatiotemporal, which allows you to efficiently process videos without losing quality.
And it's not just that, it also implements advanced techniques to train and generate high-resolution videos, ensuring that the result is realistic and fluid. If it doesn't fail in that and maintains that consistency in the composition, it would be almost perfect.
Furthermore, this generative AI is capable of create videos in different formats and lengths, all in high definition. However, I imagine that since all this is not available, it is likely to change in the future.
If you add to all this that it also has sound models that synchronize music and effects with what happens in the video, tell me what else do we need to put together a short film without even leaving our house…
What Makes Meta Movie Gen Special?
I would say that today - taking into account that it is a preview - it differs from other video generation systems, in that offers unique precision in customization and editingThis puts it a step ahead of other commercial systems, such as Runway Gen3 or OpenAI Sora.
In addition, AI not only understands how scenes should look, but also how they should sound, giving it a very advanced touch of realism. For me it can be a before and after in this type of generative video AI.
We'll see how it develops...
