state-spaces/mamba
View on GitHub ↗ ★ 18,968 Python
Mamba SSM architecture
13 mentions on Hacker News by 13 people: 3 stories, 10 comments · first 2023-12-04 · latest 2025-04-29
20082026
-
It's just a mamba ( https://github.com/state-spaces/mamba ) but with a transformer. Idk where the B comes from.
comment by alex7o · 2025-04-29 · in Bamba: An open-source LLM that crosses a transformer with an SSM -
…inference. C reflects the fixed size of the SSM (State Space Model) latent state in Mamba Per: https://github.com/state-spaces/mamba/issues/196
comment by kla-s · 2025-02-26 · in The FFT Strikes Back: An Efficient Alternative to Self-Attention -
…https://tridao.me/assets/img/2024-05-31-mamba-2/pile_8k_mamb... Here's the code implementing Mamba-2: https://github.com/state-spaces/mamba/blob/main/mamba_ssm/mo... Great work by Tri Dao (of FlashAttention fame) and Albert Gu, as usual.…
comment by cs702 · 2024-06-03 · in Mamba-2 – State Space Duality -
…but I would not be surprised if they did something similar: https://arxiv.org/abs/2312.00752 https://github.com/state-spaces/mamba
comment by fancyfredbot · 2024-03-04 · in Claude 3 model family -
…stuff as a computer engineer, you can read the code here [0]. I find the math quite helpful. [0]: https://github.com/state-spaces/mamba
comment by whimsicalism · 2024-02-23 · in Mamba: The Easy Way -
…Mamba: Linear-Time Sequence Modeling with Selective State Spaces https://arxiv.org/abs/2312.00752 https://github.com/state-spaces/mamba Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model…
comment by MAXPOOL · 2024-01-24 · in Introduction to State Space Models (SSM) -
…that can be used instead of a transformer in LLMs. See also the original repo from the paper: https://github.com/state-spaces/mamba
comment by andy99 · 2023-12-18 · in Show HN: Fortran inference code for the Mamba state space language model -
…https://nitter.net/_albertgu/status/1731727672286294400 [1] - https://arxiv.org/abs/2312.00752 [2] - https://github.com/state-spaces/mamba Out of curiosity, does anyone feel as though there's any benefit to linking to reddit when we can…
comment by squigz · 2023-12-12 · in Mamba outperforms transformers "everywhere we tried" -
▲ 3
mamba: Linear-Time Sequence Modeling with Selective State Spacesstory by Anon84 · 2023-12-09 · 0 comments
-
▲ 9
Show HN: Mamba-Chat – A Chat LLM Based on State Space Modelsstory by justusmattern · 2023-12-07 · 0 comments
-
Implementation of selective_scan_cuda: https://github.com/state-spaces/mamba/blob/6dbfc4553a98c81e1...
comment by telotortium · 2023-12-05 · in Mamba: Linear-Time Sequence Modeling with Selective State Spaces -
…old JS soup code. It makes me hesitant to leave Typescript and even Rust (for web tooling). [1] https://github.com/state-spaces/mamba/blob/main/mamba_ssm/op...
comment by triyambakam · 2023-12-04 · in Mamba: Linear-Time Sequence Modeling with Selective State Spaces -
▲ 6
Mamba: New SSM arch with linear-time scaling that outperforms Transformersstory by xenova · 2023-12-04 · 2 comments