Hacker GitHub

← All repos

huggingface/transformers

View on GitHub ↗ ★ 168,440 Python

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

94 mentions on Hacker News by 80 people: 20 stories, 74 comments · first 2018-11-07 · latest 2026-08-06

Mentions per year 94 mentions · busiest year 2023 (20)
20082026
AllStoriesComments NewestTopOldest
  1. …library) Issues: • Ollama: https://github.com/ollama/ollama/issues/15931 • HuggingFace: https://github.com/huggingface/transformers/issues/29279 (labeled as feature request) https://github.com/huggingface/transformers/issues/47822 (with a…
    comment by pavelai · 2026-08-06 · in Prompt Injection Vulnerability in Ollama, Gemma4 and HuggingFace's Transformers
  2. …they'll feed back into their LLM and it will tell them why you're wrong and they're right. https://github.com/huggingface/transformers/issues/45246
    comment by tencentshill · 2026-04-30 · in The Zig project's rationale for their anti-AI contribution policy
  3. …open weights on the planet" — @RyanMullins Google folks do something really cool! Gemma4 source: https://github.com/huggingface/transformers/pull/45192
    comment by gslepak · 2026-04-03 · in Google releases Gemma 4 open models
  4. It is a tokenizer artifact most likely ( https://github.com/huggingface/transformers/issues/4786 ). So the output is not properly decoded in this case, it should just be a space.
    comment by frwickst · 2026-03-22 · in Flash-MoE: Running a 397B Parameter Model on a Laptop
  5. …than GGUF. Nowadays I think it's better to train lora over GGUF base model, see the discussion at https://github.com/huggingface/transformers/issues/40070 I'll find some time to do this and I hope someone can do this earlier than me.
    comment by woctordho · 2026-03-05 · in Qwen3.5 Fine-Tuning Guide
  6. …dense versions of this model will most likely be released at some point. Hopefully, soon. [1]: https://github.com/huggingface/transformers/tree/main/src/tr...
    comment by woadwarrior01 · 2026-02-16 · in Qwen3.5: Towards Native Multimodal Agents
  7. here's the release notes: https://github.com/huggingface/transformers/releases/tag/v5....
    comment by unofficialmerve · 2026-01-26 · in Transformers v5 GA is out
  8. …out. As a first comment, I had to install the latest transformer==4.56.0dev (e.g. pip install git+ https://github.com/huggingface/transformers ) for it to work properly. 4.55.2 and earlier was failing with a missing image type in the…
    comment by llm_nerd · 2025-08-14 · in DINOv3
  9. The new transformers release describes the model: https://github.com/huggingface/transformers/releases/tag/v4.... > GPT OSS is a hugely anticipated open-weights release by OpenAI, designed for powerful reasoning, agentic tasks, and…
    comment by minimaxir · 2025-08-05 · in Harmony: OpenAI's response format for its open-weight model series
  10. Reference implementations are unmaintained and buggy. For example https://github.com/huggingface/transformers/issues/27961 OpenAI's tokenizer for CLIP is buggy, it's a reference implementation, it isn't the one they used for training, and…
    comment by doctorpangloss · 2025-06-14 · in I have reimplemented Stable Diffusion 3.5 from scratch in pure PyTorch
  11. …uses a seed or psuedo random number generator. Though this would depend on the implementation. https://github.com/huggingface/transformers/blob/d538293f62f...
    comment by aeonik · 2025-04-30 · in Can LLMs do randomness?
  12. …general inference - I helped fix some of them. 1. RMS norm eps was 1e-6, but should be 1e-5 - see https://github.com/huggingface/transformers/pull/37418 2. Llama 4 Scout changed RoPE settings after release - conversion script for llama.cpp…
    comment by danielhanchen · 2025-04-24 · in Llama 4 Smells Bad
  13. …but extremely excited to see how Qwen3 performs. https://news.ycombinator.com/item?id=43455084 https://github.com/huggingface/transformers/pull/36878 Qwen2.5-VL looks like an incredibly fantastically useful system, that I don't see any…
    comment by jauntywundrkind · 2025-03-25 · in Qwen2.5-VL-32B: Smarter and Lighter
  14. Qwen 3 is coming imminently as well https://github.com/huggingface/transformers/pull/36878 and it feels like Llama 4 should be coming in the next month or so. That said none of the recent string of releases has done much yet to "smash a…
    comment by zamadatix · 2025-03-24 · in Qwen2.5-VL-32B: Smarter and Lighter
  15. …length, and until that length is reached, the end of sequence token has no chance of being output. https://github.com/huggingface/transformers/blob/51ed61e2f05... S1 does something similar to put a lower limit on its reasoning output. End…
    comment by rahimnathwani · 2025-03-07 · in QwQ-32B: Embracing the Power of Reinforcement Learning
  16. Transformers like Llama use rotary embeddings which are applied in every single attention layer https://github.com/huggingface/transformers/blob/222505c7e4d...
    comment by topwalktown · 2025-02-28 · in The FFT Strikes Back: An Efficient Alternative to Self-Attention
  17. …What are the best tools we have available for tackling this kind of large scale copy-paste change? https://github.com/huggingface/transformers/pull/34191/commi... This feels too complex to tackle with PyCharm structural find and replace,…
    comment by CraigJPerry · 2024-10-18 · in Bugs in LLM Training – Gradient Accumulation Fix
  18. …A100, V100, A10, H100, etc. [1] https://ai.meta.com/blog/large-language-model-llama-meta-ai/ [2] https://github.com/huggingface/transformers [3] https://github.com/ggerganov/llama.cpp [4] https://github.com/bitsandbytes-foundation/bitsandby…
    comment by nabakin · 2024-07-16 · in Codestral Mamba
  19. …highest number of commits on HuggingFace/transformers. He is clearly competent & deeply technical https://github.com/huggingface/transformers/
    comment by LatticeAnimal · 2024-05-19 · in Reading list to join AI field from Hugging Face cofounder
  20. …own optimal way. But if you just want to learn how the model works, Meta's code base is great. [1]: https://github.com/huggingface/transformers/blob/main/src/tr...
    comment by ffriend · 2024-05-16 · in Llama 3 implemented in pure NumPy
  21. …Can you summarise how the model in your paper differs from this implementation of xLSTM ? https://github.com/huggingface/transformers/issues/27011
    comment by deepnet · 2024-05-08 · in xLSTM: Extended Long Short-Term Memory
  22. It seems Sepp Hochreiter has talked already about this model since Oct 2023: https://github.com/huggingface/transformers/issues/27011 In the scaling law comparison, I wonder if it is reasonable to compare number of parameters between…
    comment by albertzeyer · 2024-05-08 · in xLSTM: Extended Long Short-Term Memory
  23. …in the Jax AI field Perhaps the “trax” repo? https://github.com/google/trax Some HF examples https://github.com/huggingface/transformers/tree/main/exampl... Sadly it seems much of the work is proprietary these days, but one example could…
    comment by bionhoward · 2024-04-24 · in Maxtext: A simple, performant and scalable Jax LLM
  24. …method called prompt lookup decoding that uses the existing context to generate an ngram model: https://github.com/huggingface/transformers/issues/27722 I don't think it would be that hard to switch it out for a pretrained ngram model.
    comment by tripplyons · 2024-04-22 · in Lossless Acceleration of LLM via Adaptive N-Gram Parallel Decoding
  25. …code snippet in the HF transformers implementation is very readable IMO, and only about 40 lines. https://github.com/huggingface/transformers/blob/main/src/tr...
    comment by woadwarrior01 · 2024-04-17 · in Mixtral 8x22B
  26. …finder sadi 1e-3 was the best, whilst 1e-5 was better. However, the 1 cycle learning rate stuck. https://github.com/huggingface/transformers/issues/16013 * A huge issue is this needs tuning??! But how about a well tuned AdamW? Eg see…
    comment by danielhanchen · 2024-04-07 · in Schedule-Free Learning – A New Way to Train
  27. …the Gemma team to resolve all the issues :) The RoPE fix should already be in transformers 4.38.2: https://github.com/huggingface/transformers/pull/29285 My main PR for transformers which fixes most of the issues (some still left):…
    comment by danielhanchen · 2024-03-11 · in Fixing Gemma Bugs
  28. If you want to tinker with the architecture Hugging Face has a FOSS implementation in transformers: https://github.com/huggingface/transformers/blob/main/src/tr... If you want to reproduce the training pipeline , you couldn't do that even…
    comment by minimaxir · 2023-12-10 · in Mistral AI Valued at $2B
  29. …https://arxiv.org/abs/2306.03081 ), or on actual negative prompting/CFG in LLMs (i.e. like this https://github.com/huggingface/transformers/issues/24536 ) are doing far FAR more to advance the state of AI than dozens of VC backed LLM…
    comment by Der_Einzige · 2023-10-31 · in Phind Model beats GPT-4 at coding, with GPT-3.5 speed and 16k context
  30. …PaLI-3 the tokens are the hidden states output by the layer norm after the ViT encoder blocks. [1] https://github.com/huggingface/transformers/blob/main/src/tr...
    comment by kolja005 · 2023-10-16 · in PaLI-3 Vision Language Models
  31. Here's the model code https://github.com/huggingface/transformers/blob/main/src/tr...
    comment by zwaps · 2023-09-28 · in Mistral 7B
  32. …https://github.com/ggerganov/llama.cpp/blob/master/llama.cpp... Here's the one from transformers: https://github.com/huggingface/transformers/blob/0a55d9f7376... To summarize how they work: you keep some number of previously generated…
    comment by dchest · 2023-09-17 · in Apple’s new Transformer-powered predictive text model
  33. …memorization to be the likely reason. It's nice to see someone else reach the same conclusion. https://github.com/huggingface/transformers/issues/18730
    comment by n9Mtq4 · 2023-09-06 · in Can LLMs learn from a single example?
  34. …A PR to add scaled rotary embeddings to huggingface transformers is currently in progress: https://github.com/huggingface/transformers/pull/24653 The model was trained for ~1 billion tokens on togethercompute's Red Pajama dataset. The…
    comment by EnricoShippole · 2023-07-07
  35. …paper has already shared their implementation and are willing to contribute it to hf-transformers: https://github.com/huggingface/transformers/issues/24536
    comment by a2128 · 2023-07-04 · in Classifier Free Guidance works on LLMs with a significant boost in performance
  36. …- [tfjs benchmarks] - huggingface/transformers:src/transformers/benchmark https://github.com/huggingface/transformers/tree/main/src/tr...
    comment by westurner · 2023-05-20 · in PyTorch for WebGPU
  37. …very worrying on its own.) [1] https://huggingface.co/stabilityai/stablelm-tuned-alpha-7b/b... [2] https://github.com/huggingface/transformers/blob/v4.28.1/src... [3] https://github.com/huggingface/transformers/commits/v4.28.1/...
    comment by GistNoesis · 2023-04-19 · in StableLM: A new open-source language model
  38. …pandas has a tendency to change return types based on the input, and that breaks quickly. [2] https://github.com/huggingface/transformers/pull/18485
    comment by maleldil · 2023-04-15 · in The different uses of Python type hints
  39. …According to the readme of the repo, you need to install transformers with: pip3 install git+ https://github.com/huggingface/transformers
    comment by zhwu · 2023-04-07 · in State-of-the-Art Chatbot, Vicuna-7B, now runs on MacBook with GPU acceleration
  40. …), did not see any an obvious change to make it parallel, and given the huggingface patch ( https://github.com/huggingface/transformers/pull/21955 ) once it gets in is suppose to allow streaming from RAM to the GPU. So, for me it was not…
    comment by downvotetruth · 2023-03-08 · in Fork of Facebook’s LLaMa model to run on CPU
  41. …meaning we can already access a large chunk of its potential (from what I understand). [1] https://github.com/huggingface/transformers/pull/21955 [2] https://github.com/oobabooga/text-generation-webui/commit/90...
    comment by loufe · 2023-03-05 · in Show HN: Llama-dl – high-speed download of LLaMA, Facebook's 65B GPT model
  42. https://github.com/huggingface/datasets https://github.com/huggingface/transformers
    comment by swyx · 2023-02-12 · in How to train large models on many GPUs? (2021)
  43. …hugging face.co, if you read this link you should be well on your way to building something today https://github.com/huggingface/transformers#quick-tour
    comment by amrb · 2023-02-04 · in Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries
  44. you can fine-tune in 8bits weights for use in collab or similarly more restrained environments https://github.com/huggingface/transformers/issues/14839 https://huggingface.co/hivemind/gpt-j-6B-8bit by fine-tuning you should be able to…
    comment by tough · 2022-12-12 · in Ask HN: Self-hosted/open-source ChatGPT alternative? Like Stable Diffusion
  45. I know nothing, but have heard Hugging Face is in that direction. https://github.com/huggingface/transformers >Transformers provides thousands of pretrained models to perform tasks on different modalities such as text, vision, and audio. >…
    comment by lioeters · 2022-12-12 · in Ask HN: Self-hosted/open-source ChatGPT alternative? Like Stable Diffusion
  46. …projects its handling, the only issue I encountered was the Pi choking while migrating a large project (github.com/huggingface/transformers): I suspect it was hitting an internal timeout when importing large LFS files (ML models).…
    comment by sangnoir · 2022-10-18 · in Codeberg: A GitHub alternative from Europe
  47. …bit value (and lose precision). Apparently it doesn't affect the results significantly. More info: https://github.com/huggingface/transformers/pull/17901
    comment by acapybara · 2022-08-30 · in 1 week of Stable Diffusion
  48. …command, but got a CUDA out of memory error. The ds_config I used was the one from huggingface ( https://github.com/huggingface/transformers/blob/main/tests/... ).
    comment by bp89 · 2022-08-06 · in FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
  49. …--fp16 --overwrite_output_dir --deepspeed ds_config.json Where run_clm.py is this script: https://github.com/huggingface/transformers/blob/main/exampl... It might be doable to set this up on an AWS machine with a beefy GPU or two. I…
    comment by moyix · 2022-08-03 · in FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
  50. …the boilerplate that writing in pure TF, PyTorch, Jax requires. See: https://huggingface.co/spaces https://github.com/huggingface/transformers
    comment by ZeroCool2u · 2022-03-11 · in Launch HN: Tensil (YC S19) – Open-Source ML Accelerators