today,ByteDanceBean bag large modelIt was officially released, announcing that the price of large models has entered the "centi era".
Tan Dai, president of ByteDance Volcano Engine, said: After a year of iteration and market verification, the Doubao model is becoming one of the largest models in China with the richest application scenarios. It currently processes 120 billion Tokens of text and generates 30 million images per day.
“Only with large usage can a good model be polished and the unit cost of model reasoning be greatly reduced. The price of Doubao’s main model in the enterprise market is only 0.0008 yuan/1,000 tokens. 0.8 cents can process more than 1,500 Chinese characters, which is 99.3% cheaper than the industry average.”
▲ Tan Dai, president of Volcano Engine, announced the pricing of the Doubao large model. Source: ByteDance
Doubao Big Model was originally named "Skylark" and is one of the first big models in China to pass algorithm registration. At present, ByteDance has built the AI conversation assistant "Doubao", the AI application development platform "Button", the interactive entertainment application "Mao Box", and AI creation tools such as Xinghui and Jimeng based on Doubao Big Model, and has connected the big model to more than 50 businesses such as Douyin, Tomato Novel, Feishu, and Massive Engine.
Zhu Jun, Vice President of Product and Strategy at ByteDance, said: Technology is evolving rapidly, but the core needs of users have not changed, including efficient access to information, work efficiency, self-expression, social entertainment, etc. ByteDance has done a lot of learning and exploration, hoping to find a suitable large-scale model application form to bring convenience to users' lives and work in a sufficiently natural interactive way.
ByteDance also emphasized that Doubao is a large-scale model application that ByteDance has focused on investing in. The Doubao App is currently ranked first in downloads in the Apple App Store and major Android app markets. AIGC According to Zhu Jun, more than 8 million intelligent entities have been created on Doubao, and the number of monthly active users has reached 26 million.
While Doubao Big Model serves ByteDance internally, it is also co-created with many corporate customers of Volcano Engine. Tan Dai believes that enterprises need models with different characteristics in different business scenarios to achieve the best results and cost-effectiveness. To this end, Doubao Big Model provides a model family with multimodal capabilities, which currently mainly includes nine models such as General Model Pro, General Model Lite, Speech Recognition Model, Speech Synthesis Model, and Wenshengtu Model.
Tan Dai believes that reducing costs is a key factor in driving large models to the "value creation stage". The pricing of Doubao's large models is significantly lower than the industry price: taking the Doubao general model pro-32k version as an example, the model inference input price is only 0.0008 yuan/thousand tokens, while the pricing of the same specification model on the market is generally 0.12 yuan/thousand tokens, which is 150 times the price of the Doubao model.
According to the price announced by Volcano Engine, one yuan can buy 1.25 million tokens of the Doubao main model, which is about 2 million Chinese characters, equivalent to three volumes of "Romance of the Three Kingdoms".
Tan Dai said that to reduce the price of large models, it is not possible to only provide low-priced lightweight versions. The main models and the most advanced models must also be cheap enough to truly meet the needs of enterprises' complex business scenarios, fully verify the application value of large models, and thus catalyze innovations that go beyond existing products and organizational models.
In addition, ByteDance Volcano Engine also announced that it will join forces with the China Electric Vehicle 100 Forum to establish an automotive large-scale model ecological alliance with more than 20 manufacturers including Geely Auto, Great Wall Motor, Jetour Auto, SERES, and Zhiji Auto.
At the same time, Volcano Engine, OPPO, vivo, Honor, Xiaomi, Samsung, and ASUS announced the establishment of a smart terminal big model alliance. OPPO Xiaobu Assistant, Honor Smart Office Smart Assistant, Xiaomi "Xiao Ai Tongxue", and ASUS laptop Douding AI Assistant and other applications have been connected to Volcano Engine's big model service.
ByteDance said that "Button Professional Edition" has been integrated into Volcano Engine's large model service platform "Volcano Ark", providing enterprise-level SLA and advanced features. It is used by companies including China Merchants Bank, Haidilao Hotpot, Super Monkey, Liepin, as well as famous universities such as Fudan University and Zhejiang University.