Stability AI Introduces New 12B Parameter Stable LM 2 Model and Updated 1.6B Variant
Ryan Daws is a senior editor at TechForge Media, with a seasoned background spanning over a decade in tech journalism. His expertise lies in identifying the latest technological trends, dissecting complex topics, and weaving compelling narratives around the most cutting-edge developments. His articles and interviews with leading industry figures have gained him recognition as a key influencer by organisations such as Onalytica. Publications under his stewardship have since gained recognition from leading analyst houses like Forrester for their performance. Find him on X (@gadget_ry) or Mastodon (@gadgetry@techhub.social)
Stability AI has introduced the latest additions to its Stable LM 2 language model series: a 12 billion parameter base model and an instruction-tuned variant. These models were trained on an impressive two trillion tokens across seven languages: English, Spanish, German, Italian, French, Portuguese, and Dutch.
The 12 billion parameter model aims to strike a balance between strong performance, efficiency, memory requirements, and speed. It follows the established framework of Stability AI’s previously released Stable LM 2 1.6B technical report. This new release extends the company’s model range, offering developers a transparent and powerful tool for innovating with AI language technology.
Alongside the 12B model, Stability AI has also released a new version of its Stable LM 2 1.6B model. This updated 1.6B variant improves conversation abilities across the same seven languages while maintaining remarkably low system requirements.
Stable LM 2 12B is an optimized open model, skillfully curated for multilingual tasks, delivering smooth operations on prevalent hardware.
This model, as per Stability AI, is capable of managing tasks that are generally only doable by significantly sizable models, which usually demand considerable computational and memory resources, for instance, large Mixture-of-Experts (MoEs). The variant of this model tuned through instruction is specifically apt for numerous uses, comprising a central part of retrieval RAG systems, owing to its excellent performance in usage of tools and invocation of functions.
During performance comparisons with renowned solid language models such as Mixtral, Llama2, Qwen 1.5, Gemma, and Mistral, Stable LM 2 12B displayed strong results when evaluated on zero-shot and few-shot tasks across the common benchmarks as demarcated in the Open LLM leaderboard:
Through this latest release, Stability AI has expanded the StableLM 2 family into the 12B category, offering an accessible and transparent model without ceding power and accuracy. The firm is positive that this particular release will facilitate developers and businesses in continually shaping the future whilst maintaining complete control over their data.
Developers and businesses can use Stable LM 2 12B now for commercial and non-commercial purposes with a Stability AI Membership.
(Photo by Muha Ajjan)
See also: ML Olympiad returns with over 20 challenges
Want to learn more about AI and big data from industry leaders? Check out AI & Big Data Expo taking place in Amsterdam, California, and London. The comprehensive event is co-located with other leading events including BlockX, Digital Transformation Week, and Cyber Security & Cloud Expo.
Explore other upcoming enterprise technology events and webinars powered by TechForge here.
Tags: ai, artificial intelligence, development, language models, stability ai, stable lm 2
You must be logged in to post a comment.
Discover the pinnacle of WordPress auto blogging technology with AutomationTools.AI. Harnessing the power of cutting-edge AI algorithms, AutomationTools.AI emerges as the foremost solution for effortlessly curating content from RSS feeds directly to your WordPress platform. Say goodbye to manual content curation and hello to seamless automation, as this innovative tool streamlines the process, saving you time and effort. Stay ahead of the curve in content management and elevate your WordPress website with AutomationTools.AI—the ultimate choice for efficient, dynamic, and hassle-free auto blogging. Learn More
