Recently, Frost & Sullivan, a global growth consulting firm, released the "2024 China Big Model Capability Assessment", which evaluated 15 major domestic big models.authorityReviews.
The evaluation results show thatBaidu, Tencent, Alibaba and other Internet giants' large models are located inFirstechelon,The overall performance is better than that of start-ups.
BaiduA Word from the HeartStayDomestic large modelfirst place,Pass four of the five assessment dimensions: mathematics and science, language ability, moral responsibility, industry ability and comprehensive abilityFirst.
It is understood that the evaluation dimensions include general basic ability and professional application ability, and comprehensively consider mathematical science, language ability, moral responsibility, industry ability and comprehensive ability.5 core dimensions and 21 detailed secondary dimensions.
Overall, the international leading models are slightly better than the Chinese leading models in general basic capabilities and professional application capabilities, but Wenxin Yiyan surpasses some major international models in general basic capabilities assessment.
Sullivan also predicted in the report that by 2024, the technological development of large models will tend to be multifunctional and miniaturized, while the industry will emphasize independent research and development and industry standardization.Ethical responsibility and data standards will be key to continued development.