Technology outlet NeoWin (Oct. 21) published a blog post reporting that IBM at its annual TechXchange event.Released a brand new Granite 3.0 Series AI Models, which can equal or exceed models of equivalent size in academic and industry benchmarking.
The Granite 3.0 series contains a variety of new models, the relevant models are listed below:
Generic/Language Model:
- Granite 3.0 8B Instruct
- Granite 3.0 2B Instruct
- Granite 3.0 8B Base
- Granite 3.0 2B Base
Safety and Security:
- Granite Guardian 3.0 8B
- Granite Guardian 3.0 2B
Expert mixture modeling:
- Granite 3.0 3B-A800M Instruct
- Granite 3.0 1B-A400M Instruct
- Granite 3.0 3B-A800M Base
- Granite 3.0 1B-A400M Base
IBM says Granite 3.0's 8B and 2B models are the best choice for enterprise AI, with greater robustness and reliability to handle a wider range of tasks. These models excel in tasks such as retrieval augmentation generation (RAG), classification, summarization, entity extraction and tool usage.
The new models are now available for download on the HuggingFace platform under the Apache 2.0 license; the 8B and 2B models of Granite Guardian 3.0 are also commercially available through IBM's watsonx platform.
In addition, some Granite 3.0 models will go into Nvidia NIM microservices and Google Cloud's Vertex AI Model Garden.
For developers, Granite's code capabilities can be utilized through the Visual Studio Code extension IBM Granite.Code. Code. This extension supports a wide range of programming languages, including C, C++, Go, Java and Python, helping programmers accomplish their tasks more efficiently.
The Granite 3.0 family lays the groundwork for IBM's agentic AI efforts. granite 3.0 8B models feature advanced reasoning capabilities and highly structured chat templates for implementing tool-use workflows. ibm says it will roll out more on agentic AI next year, including pre-built agents for specific domains and use cases.
In short, IBM's Granite 3.0 series not only improves the performance and usability of AI models, but also paves the way for the future of AI for intelligentsia.