Hacker GitHub

← All repos

huggingface/transformers

View on GitHub ↗ ★ 168,440 Python

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

94 mentions on Hacker News by 80 people: 20 stories, 74 comments · first 2018-11-07 · latest 2026-08-06

Mentions per year 94 mentions · busiest year 2023 (20)
20082026
AllStoriesComments NewestTopOldest
  1. …Also, all code is open source, free to use, and available here: https://github.com/huggingface/transformers/tree/master/exam... If you are interested in more details about the design considerations when setting up a large
    comment by lvwerra · 2021-12-10 · in CodeParrot: Train and evaluate your own CoPilot model
  2. …(big) GPU with enough CPU to run inference for T5-11B (which is the size we use) with offloading -> https://github.com/huggingface/transformers/issues/9996#issu...
    comment by VictorSh · 2021-10-18 · in T0* – Series of encoder-decoder models trained on a large set of different tasks
  3. …example, and they seem to suggest that it's perfectly OK to fine-tune and use commercially ( https://github.com/huggingface/transformers/issues/3357#issu... ), but I'm not certain that their lawyers would put it the same way.
    comment by avatar042 · 2021-09-15 · in Show HN: Tingy – search videos with natural language queries
  4. …GPT-3 via OpenAI's API). That said, Hugging Face is adding support for GPT-Neo to Transformers ( https://github.com/huggingface/transformers/pull/10848 ) which will help make playing with the model easier, and I'll add support to aitextgen…
    comment by minimaxir · 2021-03-29 · in The makers of Eleuther hope it will be an open source alternative to GPT-3
  5. …small enough that the synchronization cost is negligible, though. I wrote up some benchmarks here: https://github.com/huggingface/transformers/issues/9371
    comment by moyix · 2021-01-24 · in Replicating GPT-2 at Home
  6. …performed worse on multiple GPUs than on two 3090s with NVLink (I opened an issue track it here https://github.com/huggingface/transformers/issues/9371 ). Currently I'm working on getting DeepSpeed running so that I can hopefully get…
    comment by moyix · 2021-01-23 · in Replicating GPT-2 at Home
  7. …) Nowadays, the easiest way to interact with GPT-2 is to use the transformers library ( https://github.com/huggingface/transformers ), of which I've created a much better library for GPT-2 that leverages it. (…
    comment by minimaxir · 2020-12-27 · in Does GPT-2 Know Your Phone Number?
  8. Just a random example I encountered the other day, take a look at this: https://github.com/huggingface/transformers/blob/master/note... It’s a tutorial on how to use some NLP ML library. It’s a pretty excellent example of where this format…
    comment by stingraycharles · 2020-12-23 · in Interactive C++ for Data Science
  9. Try spacy alpha 3.0 it integrate the https://github.com/huggingface/transformers library You should almost always use XLnet large in order to achieve the best accuracy
    comment by The_rationalist · 2020-10-26 · in Rethinking Attention with Performers
  10. …of following studies and BERT variants. Code https://github.com/google-research/bert (TensorFlow) https://github.com/huggingface/transformers (PyTorch)
    comment by deeplstm · 2020-10-19 · in Deep Bidirectional Transformers for Language Understanding [video]
  11. …Hugging Face's Transformers: An open source library for using popular language models, like GPT-2. https://github.com/huggingface/transformers This project uses a vanilla pre-trained GPT-2 and PyTorch. If you want to use TensorFlow/ONNX,…
    comment by calebkaiser · 2020-09-08 · in Show HN: Can't afford GPT-3 access? Self-host your own GPT-2 API
  12. …-huggingface Transformers (latest and greatest pretrained models, e.g. BERT): https://github.com/huggingface/transformers - ...or a barebones “from scratch” solution in less than an hour with a Colab notebook and scikit-learn (preproces
    comment by jointpdf · 2020-07-07 · in Classifying 200k articles in 7 hours using NLP
  13. …and add your own tweak. [1] https://github.com/OpenNMT/OpenNMT-py/blob/master/onmt/bin/p... [2] https://github.com/huggingface/transformers/tree/master/src/...
    comment by theblackcat1002 · 2020-07-03 · in OpenNMT: Open-Source Neural Machine Translation with Torch Mathematical Toolkit
  14. …generation), and then write a wrapper to extend it for the image rendering. (filed an issue here: https://github.com/huggingface/transformers/issues/5088 )
    comment by minimaxir · 2020-06-17 · in Image GPT
  15. Exciting! It's been asked to be integrated into the Hugging Face transformers library already: https://github.com/huggingface/transformers/issues/4658
    comment by clmnt · 2020-05-29 · in GPT-3: Language Models Are Few-Shot Learners
  16. …[2] https://www.microsoft.com/en-us/research/blog/turing-nlg-a-1... [3] https://github.com/huggingface/transformers#model-architectu...
    comment by nl · 2020-02-17 · in Graph Neural Networks – An Overview
  17. …model to identify your utterances, and then you can use the plug-and-play language model (PPLM - https://github.com/huggingface/transformers/blob/master/exam... ) to generate utterances modeling a specific speaker without special tokens.…
    comment by perturbation · 2020-01-21 · in Show HN: Train a language model to talk like you
  18. …just 8 days later [2]. [1] https://github.com/google-research/google-research/commit/b5... [2] https://github.com/huggingface/transformers/commit/c0c208833...
    comment by aglionby · 2020-01-08 · in ALBERT: A Lite BERT for Self-Supervised Learning of Language Representations
  19. https://github.com/huggingface/transformers (was) based on PyTorch, so they originally had lot of the models like gpt2-small. Because of that influence, PyTorch was probably going to win there. The one con about TF Serve (TFX) is packaging…
    comment by jeffshek · 2019-10-13 · in Lessons Learned from Building an AI Writing App
  20. …whole thing is being torn down between builds so every build and test has to fetch it again. [1] https://github.com/huggingface/pytorch-transformers/search?q...
    comment by rtkwe · 2019-09-17 · in Apple downloads ~45 TB of models per day from our S3 bucket
  21. …working on NLP uses one of hugginface's pretrained models at one point or another, sooner or later: https://github.com/huggingface/pytorch-transformers It's so damn convenient, and so nicely done. And they keep doing neat things like this…
    comment by cs702 · 2019-09-17 · in Apple downloads ~45 TB of models per day from our S3 bucket
  22. huggingface offers a whole family of pretrained transformers. https://github.com/huggingface/pytorch-transformers
    comment by visarga · 2019-09-01 · in Simple Python Package to Extract Deep Learning Features
  23. …And PyTorch implementations of Transformer models can be found here: https://github.com/huggingface/pytorch-pretrained-BERT/blob/... LMK if anyone wants more, I have a learning resource hoarding problem.
    comment by jointpdf · 2019-07-09 · in New Fast.ai Course: A Code-First Introduction to Natural Language Processing
  24. …The architecture is a derivation of PyTorch BERT [0], with an MTL loss function on top. [0] https://github.com/huggingface/pytorch-pretrained-BERT
    comment by pacala · 2019-02-16 · in Microsoft’s New MT-DNN Outperforms Google BERT