In the early morning of February 16,OpenAIThe official website released the innovativeVincent video model——Sora.
Judging from the effects of Sora generated videos displayed by OpenAI on its official website, the quality of the generated videos, resolution, text semantic restoration, video motion consistency, controllability, details, colors, etc. are excellent!
In particular, it can generate videos up to 1 minute longIt is more powerful than mainstream products such as Gen-2, SVD-XT, and Pika.
On September 21, 2023, OpenAI released the text-based graph model DALL·E 3. Together with the current Sora and the previous voice model Whisper, ChatGPT already has four multi-modal functions: text, image, video, and audio. Is AGI still far away from us?
Sora Brief Introduction
At present, the field of Wensheng video has been unable to generate high-quality long videos due to reasons such as inter-frame dependency processing, training data, computing resources, and overfitting.
The biggest technical breakthrough of Sora is that it can generate a 1-minute video while maintaining quality, which is very rare in the industry. This also once again demonstrates OpenAI's strong technical research and development capabilities in the field of large models.
Sora is a diffusion model that generates videos by starting with a video of static noise and then gradually transforming the video by removing the noise in multiple steps.
Sora uses the same Transformer architecture as ChatGPT and uses the restatement technology in DALL-E 3. It is a method for generating highly accurate descriptive subtitles for visual training data.Therefore, Sora accurately restores the user's text prompt semantics during the video generation process.
In terms of functions, in addition to text-generated videos,Sora can also generate videos from images and accurately animate image content. It can also extract elements from videos and extend them or fill in missing frames., the functions are very comprehensive.
OpenAI will release the Sora paper later, and "1ai" will bring you a more in-depth technical interpretation.