PrismML-Eng/Bonsai-demo
View on GitHub ↗ ★ 3,478 Shell
Bonsai Demo
8 mentions on Hacker News by 8 people: 1 story, 7 comments · first 2026-04-01 · latest 2026-09-24
20082026
-
…Bonsai. Even on the original one, the authors have replied to such issues with working solutions: https://github.com/PrismML-Eng/Bonsai-demo/issues/131
comment by ranger_danger · 2026-09-24 · in Best LLM for every budget, updated daily -
…) and in the file "scripts/download_models.sh" of the demo repository ( https://github.com/PrismML-Eng/Bonsai-demo/blob/main/scripts... ) I see this remark: if [ "$_family" = "bonsai2" ]; then the projector ships in the same repo;
comment by zepearl · 2026-09-18 · in Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint -
Where did you get these instructions? They have a demo repo with a setup.sh script: https://github.com/PrismML-Eng/Bonsai-demo The release tag and weight file you suggest doesn’t match what they wrote.
comment by refibrillator · 2026-09-17 · in Bonsai 2 27B: Near-Lossless Compression in a 9x Smaller Footprint -
Depending on which model you're running, you might need to use the custom forks. Details are here -> https://github.com/PrismML-Eng/Bonsai-demo/blob/main/README....
comment by bansaltushar · 2026-07-14 · in Bonsai 27B: A 27B-Class model that runs on a phone -
…like this without thorough benchmarking + model comparison is even more of a red flag to me. [0] https://github.com/PrismML-Eng/Bonsai-demo/blob/main/1-bit-b...
comment by fxwin · 2026-04-01 · in Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs -
See page 10: https://github.com/PrismML-Eng/Bonsai-demo/blob/main/1-bit-b...
comment by cubefox · 2026-04-01 · in Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs -
If you look at their whitepaper ( https://github.com/PrismML-Eng/Bonsai-demo/blob/main/1-bit-b... ) you'll notice that it does have some tradeoffs due to model intelligence being reduced (page 10) The average of MMLU Redux,MuSR,GSM8K,Human…
comment by adityashankar · 2026-04-01 · in Show HN: 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs