Meta's grand finale of the year, the open source AI model Llama 3.3, is on the scene: 70 billion parameters, performance comparable to 405 billion.

Meta The grand finale of this year's AI models is here.Meta was released yesterday (December 6) Llama 3.3.There are 70 billion parameters, but performance is comparable to Llama 3.1 with 405 billion parameters.

Meta's grand finale of the year, the open source AI model Llama 3.3, is on the scene: 70 billion parameters, performance comparable to 405 billion.

Meta emphasizes that Llama 3.3 models are more efficient, less expensive, and can run on standard workstations, reducing operational costs while delivering high-quality text AI solutions.

The Llama 3.3 model focuses on optimizing multi-language support, with support for 8 languages: English, German, French, Italian, Portuguese, Hindi, Spanish and Thai.

In terms of architecture, Llama 3.3 is an autoregressive (autoregressive) language model that uses an optimized transformer architecture, and its fine-tuned version uses Supervised Fine-Tuning (SFT) and Reinforcement Learning Based on Human Feedback (RLHF) to align it with human preferences for usefulness and safety.

Llama 3.3 contexts are 128K in length, support multiple tool usage formats, and can be integrated with external tools and services to extend the functionality of the model.

In terms of security, Meta employs data filtering, model fine-tuning, and system-level security to reduce the risk of model misuse; in addition, Meta encourages developers to deploy Llama 3.3 with the necessary security measures, such as Llama Guard 3, Prompt Guard, and Code Shield, to ensure responsible use of the model.

1AI Attach reference address

statement:The content is collected from various media platforms such as public websites. If the included content infringes on your rights, please contact us by email and we will deal with it as soon as possible.
Information

Preparing for DALL・E 3: Imagen 3, Google's "Most Powerful Literary Graph Model," Goes Live!

2024-12-8 1:01:21

Information

China Unicom Achieves Breakthrough in AI Big Model Storage and Calculation Separation Technology, the First in the Industry

2024-12-8 3:03:54

Search