Domestic TeamHeavenly Planetreleased a universal tool for video audio called Sora Opera, which not only dubs AI-generated videos, but also re-dubs pre-existing videos.
On Saturday, video tool Pika announced that users can add soundtracks and sound effects to generated videos, as well as add sound effects to previously muted videos. The feature now removes "silent mode" from videos, but requires users to purchase a Pika membership to experience it.
In early March this year, it is reported that the domestic team has a similar audio generation tool, and in the internal trial for half a year, used for Vincent video mute screen to add sound effects or background music. Currently, this tool is about to be launched in March in cooperation with Huawei Cloud, the development team "Tiantu Wanjing" providesSora OperaThe project's experience site, which will be open to the public in a few days.
Sora Opera plans to offer two features: born sound effects and video soundtracks, but the cloud version will be available to partners first because of the cost of computing power. Users will be able to enter cues such as "sword strikes" or "crisp bird chirps" to get corresponding audio clips, or generate background music with specific melodies and rhythms. The open-source version of Sora Opera will be available in the cloud for a period of time, and users will be able to use video sound effects, BGM and text-generated sound effects at will.
Founder Tulagu showed several demo videos of Sora Opera that were originally muted and processed to add sound effects, including mammoth sounds, small animal calls, and more.
The pro version of Sora Opera is said to support up to 60 minutes of video dubbing, and users can also reimport footage they've shot into the tool for new sound effects and inspiration.
In addition, Sora Opera has a number of special features, including re-dubbing AI-generated videos, processing accelerated video content to match sound effects, recognizing image rhythms, and processing non-in-screen sounds. This new tool will provide more possibilities for video production and may also have an impact on traditional PPT presentations in the future.
Experience URL:https://soraopera.skymaper.com