Hacker GitHub

← All repos

Stability-AI/StableLM

View on GitHub ↗ ★ 15,652 Jupyter Notebook

StableLM: Stability AI Language Models

11 mentions on Hacker News by 11 people: 1 story, 10 comments · first 2023-04-19 · latest 2024-10-08

Mentions per year 11 mentions · busiest year 2023 (9)
20082026
  1. …oyMjU4?accessToken=u3zujipenkx5g7rtcj9qojjgxpconyjktjkli2po09nffrffdhhchq045vp0wyfo [2.1] The config: https://github.com/Stability-AI/StableLM/blob/main/configs/stablelm-3b-4e1t.yml
    comment by godelski · 2024-10-08 · in Differential Transformer
  2. …the paper. You can find them in the official StableLM git and compare to the results in the paper https://github.com/Stability-AI/StableLM?tab=readme-ov-file#...
  3. https://mistral.ai/news/announcing-mistral-7b/ looking at the 3b results (here https://github.com/Stability-AI/StableLM#stablelm-alpha-v2 ?), it looks like Mistral (which outperforms Llama-2 13b) is far more powerful
  4. …updated since April, and a question asking for an update has been ignored for at least a month: https://github.com/Stability-AI/StableLM/issues/83
  5. …shows CC-by-NC https://huggingface.co/stabilityai/stablelm-tuned-alpha-7b * Github is Apache 2.0 https://github.com/Stability-AI/StableLM/blob/main/LICENSE
    comment by brianjking · 2023-04-19 · in StableLM: A new open-source language model
  6. https://github.com/Stability-AI/StableLM#stablelm-alpha shows that the 3b and 7B had 800b training tokens.
    comment by nickthegreek · 2023-04-19 · in StableLM: A new open-source language model
  7. https://github.com/Stability-AI/StableLM
  8. >- No [...] details about the model You can see the model architecture here https://github.com/Stability-AI/StableLM/blob/main/configs/s...
    comment by sebzim4500 · 2023-04-19 · in StableLM: A new open-source language model
  9. …trained to 1.5T tokens. The details of how many tokens each model saw in training are on Github - https://github.com/stability-AI/stableLM/ . But only for the ones that have been released.
  10. …on 800B tokens "These models will be trained on up to 1.5 trillion tokens." on the Github repo. https://github.com/stability-AI/stableLM/#stablelm-alpha