Hacker GitHub

← All repos

huggingface/transformers

View on GitHub ↗ ★ 168,440 Python

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

94 mentions on Hacker News by 80 people: 20 stories, 74 comments · first 2018-11-07 · latest 2026-08-06

Mentions per year 94 mentions · busiest year 2023 (20)
20082026
AllStoriesComments NewestTopOldest
  1. …), did not see any an obvious change to make it parallel, and given the huggingface patch ( https://github.com/huggingface/transformers/pull/21955 ) once it gets in is suppose to allow streaming from RAM to the GPU. So, for me it was not…
    comment by downvotetruth · 2023-03-08 · in Fork of Facebook’s LLaMa model to run on CPU
  2. …meaning we can already access a large chunk of its potential (from what I understand). [1] https://github.com/huggingface/transformers/pull/21955 [2] https://github.com/oobabooga/text-generation-webui/commit/90...
    comment by loufe · 2023-03-05 · in Show HN: Llama-dl – high-speed download of LLaMA, Facebook's 65B GPT model
  3. https://github.com/huggingface/datasets https://github.com/huggingface/transformers
    comment by swyx · 2023-02-12 · in How to train large models on many GPUs? (2021)
  4. …hugging face.co, if you read this link you should be well on your way to building something today https://github.com/huggingface/transformers#quick-tour
    comment by amrb · 2023-02-04 · in Show HN: DocsGPT, open-source documentation assistant, fully aware of libraries
  5. you can fine-tune in 8bits weights for use in collab or similarly more restrained environments https://github.com/huggingface/transformers/issues/14839 https://huggingface.co/hivemind/gpt-j-6B-8bit by fine-tuning you should be able to…
    comment by tough · 2022-12-12 · in Ask HN: Self-hosted/open-source ChatGPT alternative? Like Stable Diffusion
  6. I know nothing, but have heard Hugging Face is in that direction. https://github.com/huggingface/transformers >Transformers provides thousands of pretrained models to perform tasks on different modalities such as text, vision, and audio. >…
    comment by lioeters · 2022-12-12 · in Ask HN: Self-hosted/open-source ChatGPT alternative? Like Stable Diffusion
  7. …projects its handling, the only issue I encountered was the Pi choking while migrating a large project (github.com/huggingface/transformers): I suspect it was hitting an internal timeout when importing large LFS files (ML models).…
    comment by sangnoir · 2022-10-18 · in Codeberg: A GitHub alternative from Europe
  8. …bit value (and lose precision). Apparently it doesn't affect the results significantly. More info: https://github.com/huggingface/transformers/pull/17901
    comment by acapybara · 2022-08-30 · in 1 week of Stable Diffusion
  9. …command, but got a CUDA out of memory error. The ds_config I used was the one from huggingface ( https://github.com/huggingface/transformers/blob/main/tests/... ).
    comment by bp89 · 2022-08-06 · in FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
  10. …--fp16 --overwrite_output_dir --deepspeed ds_config.json Where run_clm.py is this script: https://github.com/huggingface/transformers/blob/main/exampl... It might be doable to set this up on an AWS machine with a beefy GPU or two. I…
    comment by moyix · 2022-08-03 · in FauxPilot – an attempt to build a locally hosted version of GitHub Copilot
  11. ▲ 2
    Hugging Face Transformers – Big Model Inference, Bloom, GPT Neo-X, LongT5 etc.
    story by jedwhite · 2022-06-16 · 0 comments
  12. …the boilerplate that writing in pure TF, PyTorch, Jax requires. See: https://huggingface.co/spaces https://github.com/huggingface/transformers
    comment by ZeroCool2u · 2022-03-11 · in Launch HN: Tensil (YC S19) – Open-Source ML Accelerators
  13. …Also, all code is open source, free to use, and available here: https://github.com/huggingface/transformers/tree/master/exam... If you are interested in more details about the design considerations when setting up a large
    comment by lvwerra · 2021-12-10 · in CodeParrot: Train and evaluate your own CoPilot model
  14. …(big) GPU with enough CPU to run inference for T5-11B (which is the size we use) with offloading -> https://github.com/huggingface/transformers/issues/9996#issu...
    comment by VictorSh · 2021-10-18 · in T0* – Series of encoder-decoder models trained on a large set of different tasks
  15. …example, and they seem to suggest that it's perfectly OK to fine-tune and use commercially ( https://github.com/huggingface/transformers/issues/3357#issu... ), but I'm not certain that their lawyers would put it the same way.
    comment by avatar042 · 2021-09-15 · in Show HN: Tingy – search videos with natural language queries
  16. …GPT-3 via OpenAI's API). That said, Hugging Face is adding support for GPT-Neo to Transformers ( https://github.com/huggingface/transformers/pull/10848 ) which will help make playing with the model easier, and I'll add support to aitextgen…
    comment by minimaxir · 2021-03-29 · in The makers of Eleuther hope it will be an open source alternative to GPT-3
  17. ▲ 1
    Transformers: Natural Language Processing for Pytorch and TensorFlow 2.0
    story by netgusto · 2021-02-05 · 0 comments
  18. …small enough that the synchronization cost is negligible, though. I wrote up some benchmarks here: https://github.com/huggingface/transformers/issues/9371
    comment by moyix · 2021-01-24 · in Replicating GPT-2 at Home
  19. …performed worse on multiple GPUs than on two 3090s with NVLink (I opened an issue track it here https://github.com/huggingface/transformers/issues/9371 ). Currently I'm working on getting DeepSpeed running so that I can hopefully get…
    comment by moyix · 2021-01-23 · in Replicating GPT-2 at Home
  20. …) Nowadays, the easiest way to interact with GPT-2 is to use the transformers library ( https://github.com/huggingface/transformers ), of which I've created a much better library for GPT-2 that leverages it. (…
    comment by minimaxir · 2020-12-27 · in Does GPT-2 Know Your Phone Number?
  21. Just a random example I encountered the other day, take a look at this: https://github.com/huggingface/transformers/blob/master/note... It’s a tutorial on how to use some NLP ML library. It’s a pretty excellent example of where this format…
    comment by stingraycharles · 2020-12-23 · in Interactive C++ for Data Science
  22. ▲ 2
    Hugging Face Transformers v4.0.0 rc-1 released
    story by pizza · 2020-11-19 · 0 comments
  23. Try spacy alpha 3.0 it integrate the https://github.com/huggingface/transformers library You should almost always use XLnet large in order to achieve the best accuracy
    comment by The_rationalist · 2020-10-26 · in Rethinking Attention with Performers
  24. …of following studies and BERT variants. Code https://github.com/google-research/bert (TensorFlow) https://github.com/huggingface/transformers (PyTorch)
    comment by deeplstm · 2020-10-19 · in Deep Bidirectional Transformers for Language Understanding [video]
  25. …Hugging Face's Transformers: An open source library for using popular language models, like GPT-2. https://github.com/huggingface/transformers This project uses a vanilla pre-trained GPT-2 and PyTorch. If you want to use TensorFlow/ONNX,…
    comment by calebkaiser · 2020-09-08 · in Show HN: Can't afford GPT-3 access? Self-host your own GPT-2 API
  26. …-huggingface Transformers (latest and greatest pretrained models, e.g. BERT): https://github.com/huggingface/transformers - ...or a barebones “from scratch” solution in less than an hour with a Colab notebook and scikit-learn (preproces
    comment by jointpdf · 2020-07-07 · in Classifying 200k articles in 7 hours using NLP
  27. …and add your own tweak. [1] https://github.com/OpenNMT/OpenNMT-py/blob/master/onmt/bin/p... [2] https://github.com/huggingface/transformers/tree/master/src/...
    comment by theblackcat1002 · 2020-07-03 · in OpenNMT: Open-Source Neural Machine Translation with Torch Mathematical Toolkit
  28. ▲ 2
    Transformers 3.0.0
    story by minimaxir · 2020-06-30 · 0 comments
  29. …generation), and then write a wrapper to extend it for the image rendering. (filed an issue here: https://github.com/huggingface/transformers/issues/5088 )
    comment by minimaxir · 2020-06-17 · in Image GPT
  30. Exciting! It's been asked to be integrated into the Hugging Face transformers library already: https://github.com/huggingface/transformers/issues/4658
    comment by clmnt · 2020-05-29 · in GPT-3: Language Models Are Few-Shot Learners
  31. ▲ 3
    Transformers Version 2.6 Released
    story by sshleifer · 2020-03-24 · 0 comments
  32. …[2] https://www.microsoft.com/en-us/research/blog/turing-nlg-a-1... [3] https://github.com/huggingface/transformers#model-architectu...
    comment by nl · 2020-02-17 · in Graph Neural Networks – An Overview
  33. …model to identify your utterances, and then you can use the plug-and-play language model (PPLM - https://github.com/huggingface/transformers/blob/master/exam... ) to generate utterances modeling a specific speaker without special tokens.…
    comment by perturbation · 2020-01-21 · in Show HN: Train a language model to talk like you
  34. …just 8 days later [2]. [1] https://github.com/google-research/google-research/commit/b5... [2] https://github.com/huggingface/transformers/commit/c0c208833...
    comment by aglionby · 2020-01-08 · in ALBERT: A Lite BERT for Self-Supervised Learning of Language Representations
  35. https://github.com/huggingface/transformers (was) based on PyTorch, so they originally had lot of the models like gpt2-small. Because of that influence, PyTorch was probably going to win there. The one con about TF Serve (TFX) is packaging…
    comment by jeffshek · 2019-10-13 · in Lessons Learned from Building an AI Writing App
  36. ▲ 103
    Transformers 2.0: Deep interoperability between TensorFlow 2.0 and PyTorch
    story by julien_c · 2019-09-27 · 3 comments
  37. …whole thing is being torn down between builds so every build and test has to fetch it again. [1] https://github.com/huggingface/pytorch-transformers/search?q...
    comment by rtkwe · 2019-09-17 · in Apple downloads ~45 TB of models per day from our S3 bucket
  38. …working on NLP uses one of hugginface's pretrained models at one point or another, sooner or later: https://github.com/huggingface/pytorch-transformers It's so damn convenient, and so nicely done. And they keep doing neat things like this…
    comment by cs702 · 2019-09-17 · in Apple downloads ~45 TB of models per day from our S3 bucket
  39. huggingface offers a whole family of pretrained transformers. https://github.com/huggingface/pytorch-transformers
    comment by visarga · 2019-09-01 · in Simple Python Package to Extract Deep Learning Features
  40. ▲ 5
    Show HN: Pytorch library of NLP models has a new model: Facebook's RoBERTa
    story by lysandre · 2019-08-16 · 0 comments
  41. ▲ 4
    Library of state-of-the-art pretrained models for Natural Language Processing
    story by Thomjazz · 2019-07-17 · 0 comments
  42. …And PyTorch implementations of Transformer models can be found here: https://github.com/huggingface/pytorch-pretrained-BERT/blob/... LMK if anyone wants more, I have a learning resource hoarding problem.
    comment by jointpdf · 2019-07-09 · in New Fast.ai Course: A Code-First Introduction to Natural Language Processing
  43. …The architecture is a derivation of PyTorch BERT [0], with an MTL loss function on top. [0] https://github.com/huggingface/pytorch-pretrained-BERT
    comment by pacala · 2019-02-16 · in Microsoft’s New MT-DNN Outperforms Google BERT
  44. ▲ 2
    PyTorch version of Google AI's BERT and its pre-trained models
    story by ghosthamlet · 2018-11-07 · 0 comments