1. [Home](https://www.g2.com/)
2. ...
3. [Large Language Models (LLMs) Software](https://www.g2.com/categories/large-language-models-llms)
4. [Stable LM Discussions](https://www.g2.com/products/stable-lm/discuss)

[
 ![Product Avatar Image](https://images.g2crowd.com/uploads/product/image/large_detail/large_detail_a239c8e5a18326c756626195ab8d577d/stable-lm.jpeg "Product Avatar Image")
](/products/stable-lm/reviews)

[

Stable LM

](/products/stable-lm/reviews)

0 ratings

Stable LM 2 12B is a 12.1 billion parameter decoder-only language model developed by Stability AI. Pre-trained on 2 trillion tokens from diverse multilingual and code datasets over two epochs, it is designed to generate coherent and contextually relevant text across various applications. The model employs a transformer decoder architecture with 40 layers, a hidden size of 5120, and 32 attention heads, supporting a sequence length of up to 4096 tokens. Key features include the use of Rotary Position Embeddings for improved throughput, parallel attention and feed-forward residual layers with a single input LayerNorm, and the removal of bias terms from feed-forward networks and grouped-query self-attention layers. Additionally, it utilizes the Arcade100k tokenizer, a BPE tokenizer extended from OpenAI's tiktoken.cl100k\_base, with digits split into individual tokens to enhance numerical understanding. The primary value of Stable LM 2 12B lies in its ability to generate high-quality, contextually appropriate text, making it suitable for a wide range of natural language processing tasks, including content creation, code generation, and multilingual applications.

Show More

When users leave Stable LM reviews, G2 also collects common questions about the day-to-day use of Stable LM. These questions are then answered by our community of 850k professionals. Submit your question below and join in on the G2 Discussion.

* * *

### 0.0

Nps Score

### All Stable LM Discussions

Search

Most CommentedMost HelpfulPinned by G2Newest

All DiscussionsDiscussions with CommentsPinned by G2Discussions without Comments

FilterFilter

Filter byExpand/Collapse 

Sort by

Most Commented

Most Helpful

Pinned by G2

Newest

Filter by

All Discussions

Discussions with Comments

Pinned by G2

Discussions without Comments

Sorry...

There are no questions about Stable LM yet.

## Start a New Software Discussion

Have a software question?

Get answers from real users and experts

[Start A Discussion](/products/stable-lm/discussions/new)

* * *

 ![Product Avatar Image](https://images.g2crowd.com/uploads/product/image/thumb_square/thumb_square_a239c8e5a18326c756626195ab8d577d/stable-lm.jpeg "Product Avatar Image")

### Have you used Stable LM before?

Answer a few questions to help the Stable LM community

[
Yes
](javascript:void(0))[
Yes
](https://www.g2.com/authorize?form=signup&return_to=https%3A%2F%2Fwww.g2.com%2Fproducts%2Fstable-lm%2Fdiscuss%3Fsmall_ask%3Dstable-lm)
No