Hacker GitHub

← All repos

huggingface/transformers

View on GitHub ↗ ★ 168,440 Python

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

94 mentions on Hacker News by 80 people: 20 stories, 74 comments · first 2018-11-07 · latest 2026-08-06

Mentions per year 94 mentions · busiest year 2023 (20)
20082026
AllStoriesComments NewestTopOldest
  1. …library) Issues: • Ollama: https://github.com/ollama/ollama/issues/15931 • HuggingFace: https://github.com/huggingface/transformers/issues/29279 (labeled as feature request) https://github.com/huggingface/transformers/issues/47822 (with a…
    comment by pavelai · 2026-08-06 · in Prompt Injection Vulnerability in Ollama, Gemma4 and HuggingFace's Transformers
  2. …they'll feed back into their LLM and it will tell them why you're wrong and they're right. https://github.com/huggingface/transformers/issues/45246
    comment by tencentshill · 2026-04-30 · in The Zig project's rationale for their anti-AI contribution policy
  3. …open weights on the planet" — @RyanMullins Google folks do something really cool! Gemma4 source: https://github.com/huggingface/transformers/pull/45192
    comment by gslepak · 2026-04-03 · in Google releases Gemma 4 open models
  4. It is a tokenizer artifact most likely ( https://github.com/huggingface/transformers/issues/4786 ). So the output is not properly decoded in this case, it should just be a space.
    comment by frwickst · 2026-03-22 · in Flash-MoE: Running a 397B Parameter Model on a Laptop
  5. …than GGUF. Nowadays I think it's better to train lora over GGUF base model, see the discussion at https://github.com/huggingface/transformers/issues/40070 I'll find some time to do this and I hope someone can do this earlier than me.
    comment by woctordho · 2026-03-05 · in Qwen3.5 Fine-Tuning Guide
  6. …dense versions of this model will most likely be released at some point. Hopefully, soon. [1]: https://github.com/huggingface/transformers/tree/main/src/tr...
    comment by woadwarrior01 · 2026-02-16 · in Qwen3.5: Towards Native Multimodal Agents
  7. ▲ 5
    Adding Support for Qwen3.5
    story by limoce · 2026-02-09 · 0 comments
  8. here's the release notes: https://github.com/huggingface/transformers/releases/tag/v5....
    comment by unofficialmerve · 2026-01-26 · in Transformers v5 GA is out
  9. ▲ 10
    Transformers V5 is out!
    story by kashifr · 2026-01-26 · 0 comments
  10. …out. As a first comment, I had to install the latest transformer==4.56.0dev (e.g. pip install git+ https://github.com/huggingface/transformers ) for it to work properly. 4.55.2 and earlier was failing with a missing image type in the…
    comment by llm_nerd · 2025-08-14 · in DINOv3
  11. The new transformers release describes the model: https://github.com/huggingface/transformers/releases/tag/v4.... > GPT OSS is a hugely anticipated open-weights release by OpenAI, designed for powerful reasoning, agentic tasks, and…
    comment by minimaxir · 2025-08-05 · in Harmony: OpenAI's response format for its open-weight model series
  12. ▲ 2
    Transformers 4.55 New OpenAI GPT OSS
    story by kashifr · 2025-08-05 · 1 comment
  13. Reference implementations are unmaintained and buggy. For example https://github.com/huggingface/transformers/issues/27961 OpenAI's tokenizer for CLIP is buggy, it's a reference implementation, it isn't the one they used for training, and…
    comment by doctorpangloss · 2025-06-14 · in I have reimplemented Stable Diffusion 3.5 from scratch in pure PyTorch
  14. ▲ 1
    Deprecate TF + JAX
    story by lairv · 2025-06-13 · 1 comment
  15. …uses a seed or psuedo random number generator. Though this would depend on the implementation. https://github.com/huggingface/transformers/blob/d538293f62f...
    comment by aeonik · 2025-04-30 · in Can LLMs do randomness?
  16. …general inference - I helped fix some of them. 1. RMS norm eps was 1e-6, but should be 1e-5 - see https://github.com/huggingface/transformers/pull/37418 2. Llama 4 Scout changed RoPE settings after release - conversion script for llama.cpp…
    comment by danielhanchen · 2025-04-24 · in Llama 4 Smells Bad
  17. …but extremely excited to see how Qwen3 performs. https://news.ycombinator.com/item?id=43455084 https://github.com/huggingface/transformers/pull/36878 Qwen2.5-VL looks like an incredibly fantastically useful system, that I don't see any…
    comment by jauntywundrkind · 2025-03-25 · in Qwen2.5-VL-32B: Smarter and Lighter
  18. Qwen 3 is coming imminently as well https://github.com/huggingface/transformers/pull/36878 and it feels like Llama 4 should be coming in the next month or so. That said none of the recent string of releases has done much yet to "smash a…
    comment by zamadatix · 2025-03-24 · in Qwen2.5-VL-32B: Smarter and Lighter
  19. ▲ 5
    Qwen3 Is Dropping Soon
    story by diwank · 2025-03-23 · 0 comments
  20. …length, and until that length is reached, the end of sequence token has no chance of being output. https://github.com/huggingface/transformers/blob/51ed61e2f05... S1 does something similar to put a lower limit on its reasoning output. End…
    comment by rahimnathwani · 2025-03-07 · in QwQ-32B: Embracing the Power of Reinforcement Learning
  21. Transformers like Llama use rotary embeddings which are applied in every single attention layer https://github.com/huggingface/transformers/blob/222505c7e4d...
    comment by topwalktown · 2025-02-28 · in The FFT Strikes Back: An Efficient Alternative to Self-Attention
  22. …What are the best tools we have available for tackling this kind of large scale copy-paste change? https://github.com/huggingface/transformers/pull/34191/commi... This feels too complex to tackle with PyCharm structural find and replace,…
    comment by CraigJPerry · 2024-10-18 · in Bugs in LLM Training – Gradient Accumulation Fix
  23. …A100, V100, A10, H100, etc. [1] https://ai.meta.com/blog/large-language-model-llama-meta-ai/ [2] https://github.com/huggingface/transformers [3] https://github.com/ggerganov/llama.cpp [4] https://github.com/bitsandbytes-foundation/bitsandby…
    comment by nabakin · 2024-07-16 · in Codestral Mamba
  24. ▲ 59
    HuggingFace releases support for tool-use and RAG models
    story by xkgt · 2024-07-03 · 0 comments
  25. …highest number of commits on HuggingFace/transformers. He is clearly competent & deeply technical https://github.com/huggingface/transformers/
    comment by LatticeAnimal · 2024-05-19 · in Reading list to join AI field from Hugging Face cofounder
  26. …own optimal way. But if you just want to learn how the model works, Meta's code base is great. [1]: https://github.com/huggingface/transformers/blob/main/src/tr...
    comment by ffriend · 2024-05-16 · in Llama 3 implemented in pure NumPy
  27. …Can you summarise how the model in your paper differs from this implementation of xLSTM ? https://github.com/huggingface/transformers/issues/27011
    comment by deepnet · 2024-05-08 · in xLSTM: Extended Long Short-Term Memory
  28. It seems Sepp Hochreiter has talked already about this model since Oct 2023: https://github.com/huggingface/transformers/issues/27011 In the scaling law comparison, I wonder if it is reasonable to compare number of parameters between…
    comment by albertzeyer · 2024-05-08 · in xLSTM: Extended Long Short-Term Memory
  29. …in the Jax AI field Perhaps the “trax” repo? https://github.com/google/trax Some HF examples https://github.com/huggingface/transformers/tree/main/exampl... Sadly it seems much of the work is proprietary these days, but one example could…
    comment by bionhoward · 2024-04-24 · in Maxtext: A simple, performant and scalable Jax LLM
  30. …method called prompt lookup decoding that uses the existing context to generate an ngram model: https://github.com/huggingface/transformers/issues/27722 I don't think it would be that hard to switch it out for a pretrained ngram model.
    comment by tripplyons · 2024-04-22 · in Lossless Acceleration of LLM via Adaptive N-Gram Parallel Decoding
  31. …code snippet in the HF transformers implementation is very readable IMO, and only about 40 lines. https://github.com/huggingface/transformers/blob/main/src/tr...
    comment by woadwarrior01 · 2024-04-17 · in Mixtral 8x22B
  32. …finder sadi 1e-3 was the best, whilst 1e-5 was better. However, the 1 cycle learning rate stuck. https://github.com/huggingface/transformers/issues/16013 * A huge issue is this needs tuning??! But how about a well tuned AdamW? Eg see…
    comment by danielhanchen · 2024-04-07 · in Schedule-Free Learning – A New Way to Train
  33. …the Gemma team to resolve all the issues :) The RoPE fix should already be in transformers 4.38.2: https://github.com/huggingface/transformers/pull/29285 My main PR for transformers which fixes most of the issues (some still left):…
    comment by danielhanchen · 2024-03-11 · in Fixing Gemma Bugs
  34. ▲ 1
    HuggingFace Transformers: Qwen2
    story by tosh · 2024-01-11 · 0 comments
  35. ▲ 5
    HuggingFace Transformers Release v4.36: Mixtral, Llava/BakLlava, SeamlessM4T v2
    story by tosh · 2023-12-13 · 0 comments
  36. ▲ 4
    HuggingFace: Support for the Mixtral Moe
    story by tosh · 2023-12-11 · 0 comments
  37. If you want to tinker with the architecture Hugging Face has a FOSS implementation in transformers: https://github.com/huggingface/transformers/blob/main/src/tr... If you want to reproduce the training pipeline , you couldn't do that even…
    comment by minimaxir · 2023-12-10 · in Mistral AI Valued at $2B
  38. …https://arxiv.org/abs/2306.03081 ), or on actual negative prompting/CFG in LLMs (i.e. like this https://github.com/huggingface/transformers/issues/24536 ) are doing far FAR more to advance the state of AI than dozens of VC backed LLM…
    comment by Der_Einzige · 2023-10-31 · in Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context
  39. …PaLI-3 the tokens are the hidden states output by the layer norm after the ViT encoder blocks. [1] https://github.com/huggingface/transformers/blob/main/src/tr...
    comment by kolja005 · 2023-10-16 · in PaLI-3 Vision Language Models
  40. Here's the model code https://github.com/huggingface/transformers/blob/main/src/tr...
    comment by zwaps · 2023-09-28 · in Mistral 7B
  41. …https://github.com/ggerganov/llama.cpp/blob/master/llama.cpp... Here's the one from transformers: https://github.com/huggingface/transformers/blob/0a55d9f7376... To summarize how they work: you keep some number of previously generated…
    comment by dchest · 2023-09-17 · in Apple’s new Transformer-powered predictive text model
  42. …memorization to be the likely reason. It's nice to see someone else reach the same conclusion. https://github.com/huggingface/transformers/issues/18730
    comment by n9Mtq4 · 2023-09-06 · in Can LLMs learn from a single example?
  43. ▲ 15
    Ask HN: Are you training and running custom LLMs and how are you doing it?
    story by kordlessagain · 2023-08-14 · 2 comments
  44. …A PR to add scaled rotary embeddings to huggingface transformers is currently in progress: https://github.com/huggingface/transformers/pull/24653 The model was trained for ~1 billion tokens on togethercompute's Red Pajama dataset. The…
    comment by EnricoShippole · 2023-07-07
  45. …paper has already shared their implementation and are willing to contribute it to hf-transformers: https://github.com/huggingface/transformers/issues/24536
    comment by a2128 · 2023-07-04 · in Classifier Free Guidance works on LLMs with a significant boost in performance
  46. …- [tfjs benchmarks] - huggingface/transformers:src/transformers/benchmark https://github.com/huggingface/transformers/tree/main/src/tr...
    comment by westurner · 2023-05-20 · in PyTorch for WebGPU
  47. ▲ 3
    Why is GitHub search so terrible?
    story by d23 · 2023-04-28 · 2 comments
  48. …very worrying on its own.) [1] https://huggingface.co/stabilityai/stablelm-tuned-alpha-7b/b... [2] https://github.com/huggingface/transformers/blob/v4.28.1/src... [3] https://github.com/huggingface/transformers/commits/v4.28.1/...
    comment by GistNoesis · 2023-04-19 · in StableLM: A new open-source language model
  49. …pandas has a tendency to change return types based on the input, and that breaks quickly. [2] https://github.com/huggingface/transformers/pull/18485
    comment by maleldil · 2023-04-15 · in The different uses of Python type hints
  50. …According to the readme of the repo, you need to install transformers with: pip3 install git+ https://github.com/huggingface/transformers
    comment by zhwu · 2023-04-07 · in State-of-the-Art Chatbot, Vicuna-7B, now runs on MacBook with GPU acceleration