google-research/bert
View on GitHub ↗ ★ 40,037 Python archived
TensorFlow code and pre-trained models for BERT
14 mentions on Hacker News by 13 people: 1 story, 13 comments · first 2018-10-31 · latest 2026-08-10
20082026
-
…here) all prior to 2023 and the big Chatgpt moment. https://github.com/EleutherAI/gpt-neo/releases https://github.com/google-research/bert https://github.com/google-research/t5x If you're learning about AI models it's still worthwhile to…
comment by canyon289 · 2026-08-10 · in Mark Zuckerberg attacks 'closed' AI rivals as Meta returns to open models -
Apple is behind. People forget that Google was shipping mobile-scale transformer-based LLMs in 2019 : https://github.com/google-research/bert By the time Apple has an AI-native product ready, people will already associate it with…
comment by bigyabai · 2025-07-18 · in Apple Intelligence Foundation Language Models Tech Report 2025 -
…been doing sentiment analysis with LLMs using text classifiers for more than 7 years at this point: https://github.com/google-research/bert It's definitely a neat solution, but a pretty old one at this point. Those AWS Mechanical Turk…
comment by bigyabai · 2025-04-06 · in Creative AIML Datasets -
OpenAI was most certainly not the first organization to develop (or distribute) an LLM model: https://github.com/google-research/bert https://arxiv.org/abs/1810.04805 Failing that, Seq2seq predates OpenAI's incorporation:…
comment by smoldesu · 2023-10-30 · in Ask HN: Why is OpenAI still called OpenAI? -
…like search currently on the front page on HN)? 1. https://arxiv.org/abs/1810.04805 code+models: https://github.com/google-research/bert 2. https://arxiv.org/abs/2112.04426 3. https://arxiv.org/abs/1910.10683 code+models:…
comment by lossolo · 2022-12-08 · in AlphaCode Attention Visualization -
…fast parsing/querying", but now I haven't, so I do think the title is a bit misleading. [0] https://github.com/google-research/bert
comment by davidatbu · 2022-04-13 · in The fastest tool for querying large JSON files is written in Python (benchmark) -
…methods because it is the first unsupervised, deeply bidirectional system for pre-training NLP." https://github.com/google-research/bert
comment by mobilio · 2020-11-10 · in A Primer in BERTology: What We Know About How Bert Works -
…on how people approach NLP problems and inspires a lot of following studies and BERT variants. Code https://github.com/google-research/bert (TensorFlow) https://github.com/huggingface/transformers (PyTorch)
comment by deeplstm · 2020-10-19 · in Deep Bidirectional Transformers for Language Understanding [video] -
…(GPT-2 docker image needs a version tweak to get it working) and BERT: https://github.com/google-research/bert
comment by dana321 · 2020-02-23 · in Ask HN: I'm away from the software industry since 2017; what has happened since? -
…here. During pretraining last layer is loggits for one hot vocab vector, the same as in GPT: https://github.com/google-research/bert/blob/master/run_pret...
comment by riku_iki · 2020-02-11 · in Turing-NLG: A 17B-parameter language model -
…representation of your input sequence, but I think that is a little past the original question. [1] https://github.com/google-research/bert/blob/master/modeling... [2] https://github.com/openai/gpt-2/blob/master/src/model.py#L17...
comment by Voloskaya · 2020-02-11 · in Turing-NLG: A 17B-parameter language model -
The project mentioned (BERT) in the article is really interesting, you should look into it. https://github.com/google-research/bert
comment by kick · 2019-10-25 · in Google brings in BERT to improve its search results -
…as a starting point, their research departments release things pretty frequently. For example, https://github.com/google-research/bert (the multilingual model) might be a pretty good starting point for a translator. It will probably still…
comment by mlucy · 2019-02-14 · in The Unreasonable Effectiveness of Deep Feature Extraction