Hacker GitHub

← All repos

unslothai/unsloth

View on GitHub ↗ ★ 78,950 Python

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

34 mentions on Hacker News by 22 people: 12 stories, 22 comments · first 2023-11-30 · latest 2026-08-11

Mentions per year 34 mentions · busiest year 2024 (14)
20082026
AllStoriesComments NewestTopOldest
  1. …local models as the field moves fast. [0] https://sleepingrobots.com/dreams/stop-using-ollama/ [1] https://github.com/unslothai/unsloth/discussions/4921
    comment by satvikpendem · 2026-06-30 · in Qwen 3.6 27B is the sweet spot for local development
  2. From the README at https://github.com/unslothai/unsloth : "Unsloth uses a dual-licensing model of Apache 2.0 and AGPL-3.0. The core Unsloth package remains licensed under Apache 2.0, while certain optional components, such as the Unsloth…
    comment by mkl · 2026-03-18 · in Unsloth Studio
  3. …with one command 'uv sync'. This will require a big pile of shell script if doing another way. https://github.com/unslothai/unsloth/issues/4280#issuecommen...
    comment by mmis1000 · 2026-03-18 · in Unsloth Studio
  4. …https://github.com/gpu-mode/triton-index https://github.com/AlibabaPAI/FLASHNN https://github.com/unslothai/unsloth the number of people commenting on this stuff that don't know what they're actually talking about grows by leaps and boun
    comment by almostgotcaught · 2025-09-05 · in ML needs a new programming language – Interview with Chris Lattner
  5. https://github.com/unslothai/unsloth I'm not sure if it contains exactly what you're looking for, but it includes several resources and notebooks related to fine-tuning LLMs (including LoRA) that I found useful.
    comment by notpublic · 2025-07-29 · in My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)
  6. Oh for finetuning - we do have some code for MoE finetuning for Qwen at https://github.com/unslothai/unsloth , but we haven't yet announced it yet!
    comment by danielhanchen · 2025-07-25 · in Qwen3-235B-A22B-Thinking-2507
  7. If you guys need help on GGUFs + Unsloth dynamic quants + finetuning support via Unsloth https://github.com/unslothai/unsloth on day 0 / 1, more than happy to help :)
    comment by danielhanchen · 2025-07-12 · in ETH Zurich and EPFL to release a LLM developed on public infrastructure
  8. …small. You can also fine-tune them. There are lot of frameworks like unsloth that make this easier. https://github.com/unslothai/unsloth . Fine-tuning can be pretty tricky to get right, you need to be aware of things like learning rates,…
    comment by joshhart · 2024-12-06 · in Llama-3.3-70B-Instruct
  9. …and who ship features and ideas quickly - if stuff breaks, that's fine with us! Read more at https://github.com/unslothai/unsloth/wiki#-we-are-hiring
    comment by danielhanchen · 2024-11-01 · in Ask HN: Who is hiring? (November 2024)
  10. …cuBLAS! If anyone is interested on other kernels like swiglu, geglu, RMS layernorm, I coded some at https://github.com/unslothai/unsloth/tree/main/unsloth/kerne...
    comment by danielhanchen · 2024-10-30 · in ThunderKittens: Simple, fast, and adorable AI kernels
  11. Unsloth have a bunch of notebooks that actually tune LLMs on the free Colab tier. https://github.com/unslothai/unsloth
    comment by imjonse · 2024-09-17 · in Finetune, Eval, Deploy 60 LLMs in a single Colab notebook
  12. I'm pretty sure anyone finetuning Lllama now on a regular basis is using https://github.com/unslothai/unsloth so comparisons should be against that. The open source version is ~2x faster than default implementations. NVidia only, although…
    comment by nl · 2024-09-12 · in Show HN: Tune LLaMa3.1 on Google Cloud TPUs
  13. …b.com/trholding/llama2.c/blob/master/runq.c#L65... needs to be scaled with some weird formula like in https://github.com/unslothai/unsloth/blob/main/unsloth/model...
    comment by danielhanchen · 2024-07-24 · in Llama 3.1 in C
  14. …MLX [1] on macOS, Unsloth [2] on Windows and Linux [1] https://github.com/ml-explore/mlx [2] https://github.com/unslothai/unsloth
    comment by jmorgan · 2024-06-16 · in Ollama v0.1.45
  15. …is 2x faster than HuggingFace + Flash Attention 2. Gemma 7b is 2.4x faster than HF + FA2. Check out https://github.com/unslothai/unsloth for full benchmarks!
    comment by danielhanchen · 2024-04-10 · in Ask HN: Most efficient way to fine-tune an LLM in 2024?
  16. …axolotl to efficiently finetune models on cloud GPUs. [1] https://github.com/stanfordnlp/dspy [2] https://github.com/unslothai/unsloth [3] https://github.com/OpenAccess-AI-Collective/axolotl [4] https://github.com/skypilot-org/skypilot [5]…
    comment by stanbiryukov · 2024-04-04 · in Ask HN: Most efficient way to fine-tune an LLM in 2024?
  17. …from Google: https://ai.google.dev/gemma * Unsloth is a tool for training models faster (IIUC): https://github.com/unslothai/unsloth
    comment by remram · 2024-03-11 · in Fixing Gemma Bugs
  18. …in building the software side of things and want to foster those who can focus on that side. https://github.com/unslothai/unsloth/issues/160 https://github.com/search?q=repo%3Apredibase%2Florax+rocm&ty...…
    comment by latchkey · 2024-02-24 · in AMD ROCm Software Blogs
  19. …for fine-tuning Mistral-7B are super easy to use and run fine in just about any colab instance: https://github.com/unslothai/unsloth It’s my default now for experimenting and basic training. If I want to get into the weeds, I use axolotl,…
    comment by bugglebeetle · 2024-02-08 · in How we got fine-tuning Mistral-7B to not suck
  20. …Mistral 7b model 2.2x faster and use 62% less memory - give our open source package Unsloth a try! https://github.com/unslothai/unsloth thanks! :)
    comment by danielhanchen · 2023-12-21 · in Mistral 7B Fine-Tune Optimized
  21. M1 support is probably coming in the future if there is enough support - could you make an Issue at https://github.com/unslothai/unsloth - that would be much appreciated! I think there are a few Redditors from /r/localllama who also…
    comment by danielhanchen · 2023-12-02 · in Show HN: 80% faster, 50% less memory, 0% loss of accuracy Llama finetuning
  22. …which in turn is the free version of Unsloth Pro/Max[1]. Maybe the link should be changed? [0]: https://github.com/unslothai/unsloth [1]: https://unsloth.ai/
    comment by blopker · 2023-12-02 · in Unsloth: 80% faster, 50% less memory, 0% accuracy loss Llama finetuning