tensorflow/tensor2tensor
View on GitHub ↗ ★ 17,472 Python archived
Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.
16 mentions on Hacker News by 16 people: 3 stories, 13 comments · first 2017-06-19 · latest 2026-06-18
20082026
-
…code. I was had to implement a TC MoE kernel, and stumbled upon his code from [tensor2tensor]( https://github.com/tensorflow/tensor2tensor/blob/master/tens... ) and i think "alchemy" is justified. Dude writes some beautiful kernels. He…
comment by ahmadyan · 2026-06-18 · in Noam Shazeer Joins OpenAI -
…wavelengths form a geometric progression from 2π to 10000 · 2π That led me to this chain of PRs - https://github.com/tensorflow/tensor2tensor/pull/177 - turns out the original code was actually quite different to that stated in the paper.…
comment by sam16180 · 2024-01-04 · in Understand how transformers work by demystifying the math behind them -
This is the commit that changed it: https://github.com/tensorflow/tensor2tensor/commit/d5bdfcc85...
comment by YetAnotherNick · 2023-05-24 · in Why the original transformer figure is wrong, and some other tidbits about LLMs -
The visualisation here may be helpful. https://github.com/tensorflow/tensor2tensor/issues/1591
comment by isaacfung · 2023-04-15 · in What are transformer models and how do they work? -
…Tensor2tensor library he mentions that replaced the old deprecated layer is now also deprecated. https://github.com/tensorflow/tensor2tensor > It is now in maintenance mode — we keep it running and welcome bug-fixes, but encourage users to…
comment by chillee · 2019-12-07 · in Tensorflow User Experience -
The paper references the code for the project which can be found here: https://github.com/tensorflow/tensor2tensor/blob/master/tens...
comment by jonnydubowsky · 2019-03-07 · in VideoFlow: A Flow-Based Generative Model for Video -
…Transformer models are very strong (and can be trained on TPUs, which is cheap(er) and fast): https://github.com/tensorflow/tensor2tensor/#translation
comment by nl · 2018-08-02 · in OpenNMT: Open Source Neural Machine Translation in Torch -
…/ https://github.com/salesforce/awd-lstm-lm [b] https://arxiv.org/abs/1706.03762 / https://github.com/tensorflow/tensor2tensor
comment by cs702 · 2018-05-04 · in Extracting Structured Data from Recipes Using Conditional Random Fields (2015) -
…the paper Attention is all you need, https://arxiv.org/abs/1706.03762 , including TensorFlow code, https://github.com/tensorflow/tensor2tensor . Note that the new thing here is that they neither use recurrence nor convolution but rely…
comment by albertzeyer · 2017-09-01 · in Transformer: A Novel Neural Network Architecture for Language Understanding -
Not that I know of, but the source code is available to train a Transformer model in a single day. https://github.com/tensorflow/tensor2tensor#walkthrough
comment by ma2rten · 2017-08-29 · in DeepL Translator – AI Assistance for Language -
…some strong recent results in that direction. Related paper: "One Model To Learn Them All"[1]. [0]: https://github.com/tensorflow/tensor2tensor [1]: https://arxiv.org/pdf/1706.05137.pdf
comment by espadrine · 2017-07-18 · in The future of deep learning -
https://github.com/tensorflow/tensor2tensor
comment by based2 · 2017-06-27 · in MultiModel: Multi-Task Machine Learning Across Domains -
…on large tasks degrades only slightly if at all. https://arxiv.org/abs/1706.05137 EDIT: And code: https://github.com/tensorflow/tensor2tensor
comment by bdcs · 2017-06-19 · in Google advances AI with ‘one model to learn them all’