Adobe announced that video generation capabilities powered by Adobe Firefly Video models will be available by the end of this year.Users will be able to experience this feature in the Premiere Pro beta app and on the standalone website at that time.
Adobe says it is currently testing three features internally: Generative Extend, Text to Video, and Image to Video, and will be opening them up for public beta testing in the near future.
The Generate Continuous Frames feature, which allows users to extend an existing video by two seconds, will be embedded in the Premiere Pro beta application later this year. The text-to-video and image-to-video models, which can generate five-second videos based on text prompts or input images, will also be available on the Firefly standalone site later this year, and Adobe has indicated that further extensions may be possible in the future.
In recent years, there has been a proliferation of generative AI models such as OpenAI's Sora and Runway's Gen-3 Alpha, which are capable of generating video clips in minutes, as opposed to hours for manual creation. However, these early tools were often considered less controllable for use in professional authoring environments.
In response, Ely Greenfield, Adobe's chief technology officer (CTO), said.Adobe believes controllability is a big advantage of its Firefly AI toolThere is "tremendous demand" for Firefly AI tools that complement or accelerate existing workflows. For example, Greenfield noted that the Firefly Generative Fill feature added to Adobe Photoshop last year is "one of the most used features we've introduced in the last decade.
In addition, Adobe says Firefly's text-to-video feature excels at spelling, a frequent challenge for AI video models.
Adobe took a more cautious approach in the early days due to security concerns. Greenfield said that Firefly's video model blocks the generation of content such as nudity, drugs and alcohol. He also added that Adobe'sVideo Generation ModelIt will not be trained on public figures (e.g. politicians and celebrities).
Adobe has not yet revealed pricing for these AI video features, but for the other Firefly tools, Adobe is offering Creative Cloud users a certain number of "generation points," one of which typically generates one result, with more points available for higher-end packages.