AI2 Unveils New Language Models to Rival Meta’s LLaMA
On November 26, 2024, Ai2, the nonprofit AI research organization founded by Paul Allen, announced the release of OLMo 2, the second family of models in its Open Language Model series. This release includes a significant milestone in the realm of open-source AI, as OLMo 2 meets the Open Source Initiative’s criteria for open-source compliance.
The OLMo series previously launched its first models earlier in 2024, but OLMo 2 has been developed with a focus on transparency, utilizing open and accessible training data, code, and resources. Ai2 aims to encourage innovation within the open-source community by sharing these resources.
The new models consist of two variants: OLMo 7B and OLMo 13B, corresponding to 7 billion and 13 billion parameters, respectively. These parameters are crucial as they typically influence the model’s performance, with larger models generally achieving better results in various text-based tasks, such as summarization, question answering, and code generation.
Training for OLMo 2 was undertaken with a dataset comprising 5 trillion tokens, which includes a high-quality selection of websites, academic publications, Q&A forums, and synthetic math workbooks. Ai2 claims that the performance of its OLMo 2 models competes favorably within the broader landscape of open models, particularly against Meta’s Llama 3.1.
Ai2 has emphasized the importance of open-source models, despite ongoing discussions regarding their potential misuse. AI2 engineer Dirk Groeneveld remarked on the dual nature of open access, suggesting that while there are risks, the benefits include fostering technical advancements and reducing centralized power in AI development.
The OLMo 2 models can be downloaded from the Ai2 website under the Apache 2.0 license, allowing for commercial use.
Discover the pinnacle of WordPress auto blogging technology with AutomationTools.AI. Harnessing the power of cutting-edge AI algorithms, AutomationTools.AI emerges as the foremost solution for effortlessly curating content from RSS feeds directly to your WordPress platform. Say goodbye to manual content curation and hello to seamless automation, as this innovative tool streamlines the process, saving you time and effort. Stay ahead of the curve in content management and elevate your WordPress website with AutomationTools.AI—the ultimate choice for efficient, dynamic, and hassle-free auto blogging. Learn More
