Meta announces AI model that produces video with audio.
The Facebook owner claims Movie Gen creates realistic-looking video and audio clips that rival competitors.
Meta, the owner of Facebook and Instagram, announced on Friday that it has developed a new artificial intelligence model called Movie Gen that can generate realistic-looking video and audio clips in response to user prompts, claiming that it can rival tools from leading media generation startups such as OpenAI and ElevenLabs.
Meta provided samples of Movie Gen’s works, which included recordings of animals swimming and surfing, as well as footage of real individuals performing tasks such as painting on canvas.
According to Meta’s blog post, Movie Gen can also generate background music and sound effects that are synchronized with the movie material. Users can also use the model to edit existing videos.
In one of these films, Meta had the tool insert pompoms into the hands of a man running alone in the desert, and in another, it transformed a parking lot where a man was skateboarding from dry ground to a splash pool.
According to Meta, Movie Gen’s films can last up to 16 seconds and their sounds up to 45 seconds. It revealed blind testing results that show the model surpasses options from companies including Runway, OpenAI, ElevenLabs, and Kling.
The announcement comes as Hollywood grapples with how to use generative AI video technology this year, following Microsoft-backed OpenAI’s demonstration in February of how its product Sora could make feature film-like films based on text prompts.
Technologists in the entertainment industry are eager to use such tools to improve and speed up film production, but others are concerned about using algorithms that appear to have been trained on copyrighted works without permission.
Lawmakers have also expressed concerns about how AI-generated fakes, or deepfakes, are being used in elections around the world, including the United States, Pakistan, India, and Indonesia.
According to Meta executives, the business is unlikely to make Movie Gen available for free to developers, as it did with its Llama series of large-language models, and the risks are reviewed individually for each model. They declined to respond to Meta’s assessment of Movie Gen directly.
Instead, they said Meta was working directly with the entertainment community and other content creators on Movie Gen applications, which will be incorporated into Meta’s own products sometime next year.
According to a blog post and a research paper on the program published by Meta, Movie Gen was built using a combination of licensed and publicly available datasets.
OpenAI has been meeting with Hollywood executives and agencies this year to discuss possible Sora collaborations, but no deals have been reported as of yet. Anxiety about the company’s strategy grew in May, when actress Scarlett Johansson accused ChatGPT of utilizing her voice without permission for its chatbot.
Lions Gate Entertainment, the company behind The Hunger Games and Twilight, said in September that the AI firm Runway will have access to its film and television library to train an AI model. In exchange, it said the studio and its filmmakers could use the model to supplement their work.
How to created Animation video Using meta AI
how to make an amazing animation video, it used to take a lot of time to make such 2D animation videos, but now it’s not like that; the times have changed. Now we have full access to AI technology, which is free of cost.
Can you make money using ChatGPT ?
Yes, you can make money in various ways using ChatGPT. It can create Chrome extensions, HTML webpages, and other assets that you may later sell. Another common approach for generating money using ChatGPT is to have it write eBooks, which you can then publish on Amazon.
