jax-ml/jax on Hacker News

…models. And as a point of advice: you want stuff to work on TPUs? Do what Googlers do: use Jax ( https://github.com/jax-ml/jax ), oh, and look at the commit logs of that repository to get your mind blown btw. In other words, Google rents…

comment by spwa4 · 2025-12-09 · in After the Bubble

…got batch variance explained to me before: https://github.com/google-deepmind/penzai/issues/82 and https://github.com/jax-ml/jax/issues/20047#issuecomment-1975...

comment by daralthus · 2025-09-10 · in Defeating Nondeterminism in LLM Inference

There's a JAX for AI/LM too https://github.com/jax-ml/jax but yeah no idea which the OP meant

comment by tough · 2025-05-19 · in Comparing Parallel Functional Array Languages: Programming and Performance

…use? Is it less fixed-size-array-oriented? Is it worth locking yourself into one brand of GPU? [1] https://github.com/jax-ml/jax

comment by crazygringo · 2025-04-04 · in Nvidia adds native Python support to CUDA

…of semantic restrictions. [0]: https://www.scattered-thoughts.net/writing/unexplanations-sq... [1]: https://github.com/jax-ml/jax

comment by one-more-minute · 2025-03-27 · in Zest: a programming language for malleable and legible systems

https://github.com/jax-ml/jax

comment by vgatherps · 2025-03-22 · in I want a good parallel computer

…at JAX. It's very suitable for general numeric computing (not just ML) and a very mature ecosystem. https://github.com/jax-ml/jax

comment by cl3misch · 2024-12-02 · in KlongPy: High-Performance Array Programming in Python

…some specialized kernel in that case. 1. https://jax.readthedocs.io/en/latest/pallas/index.html 2. https://github.com/jax-ml/jax/blob/main/jax/experimental/pal...

comment by jdeaton · 2024-09-24 · in We fine-tuned Llama 405B on AMD GPUs

Nope, changing graph shape requires recompilation: https://github.com/google/jax/discussions/17191

comment by logicchains · 2024-08-17 · in The future of Deep Learning frameworks

…difficult to take a numerical computing framework seriously if one cannot invert a matrix. [1]: https://github.com/google/jax/issues/16321 [2]: https://github.com/google/jax/issues/17490

comment by mvanaltvorst · 2024-06-03 · in cuDF – GPU DataFrame Library

…JAX implements them and uses them exactly as stated in this thread. https://github.com/google/jax/discussions/10157#discussionco... Many other frameworks use them also, for many reasons. As you so eloquently stated, "you shoul

comment by SideQuark · 2024-03-23 · in The Elements of Differentiable Programming

…matter whether or not you have inner jitted functions. The end result should be the same. Source: https://github.com/google/jax/discussions/5199#discussioncom...

comment by ubj · 2023-12-24 · in Translation and accelerated solving of differential equations on GPU platforms

…mean fixed point 4bit integer types? Looks like that has had at least some work done in Jax: https://github.com/google/jax/issues/8566

comment by sdenton4 · 2023-11-14 · in MLPerf training tests put Nvidia ahead, Intel close, and Google well behind

…compare MatX running on same CPU like NumPy and for GPU comparison focus to compare vs CuPy. [1] https://github.com/google/jax

comment by elashri · 2023-10-04 · in MatX: Efficient C++17 GPU numerical computing library with Python-like syntax

…The README has always had an example of differentiating through native Python control flow: https://github.com/google/jax/commit/948a8db0adf233f333f3e5f... The constraints on control flow expressions come from jax.jit (because Python…

comment by mattjjatgoogle · 2023-10-02 · in JAX – NumPy on the CPU, GPU, and TPU

You're right! Maybe we should revise that... I made https://github.com/google/jax/pull/17851 , comments welcome!

comment by mattjjatgoogle · 2023-09-29 · in JAX – NumPy on the CPU, GPU, and TPU

Development seems not to have dropped at all from the contributions page: https://github.com/google/jax/graphs/contributors Don’t know about usage and uptake though.

comment by maegul · 2023-09-29 · in JAX – NumPy on the CPU, GPU, and TPU

For a similar "benchmark" (also Mandelbrot) but took place in Jax repo discussion: https://github.com/google/jax/discussions/11078#discussionco...

comment by moelf · 2023-09-09 · in Julia and Mojo Mandelbrot Benchmark

…https://jax.readthedocs.io/en/latest/jax.tree_util.html and also their curry implementation is funny: https://github.com/google/jax/blob/4ac2bdc2b1d71ec0010412a32... Anyway don’t put FP on a pedestal, main thing is to focus on the core…

comment by bionhoward · 2023-08-16 · in Functional Programming 1

…be excited by your enthusiasm, it feels like Jax could be the ultimate programming language. [1] https://github.com/google/jax#transformations

comment by credit_guy · 2023-02-25 · in Training Deep Networks with Data Parallelism in Jax

…been a bit, but I think the most frustrating errors were around mapping pytrees (like this issue https://github.com/google/jax/issues/9928 ). We've improved some of these pytree error messages but it seems that vmap one is still not great.…

comment by mattjjatgoogle · 2023-02-24 · in Training Deep Networks with Data Parallelism in Jax

…been a bit, but I think the most frustrating errors were around mapping pytrees (like this issue https://github.com/google/jax/issues/9928 ). I'm not sure the exact solution, but the axis juggling and specifications were where I remember a…

comment by 6gvONxR4sf7o · 2023-02-24 · in Training Deep Networks with Data Parallelism in Jax

…updated to show how to do this with sharding and the new jax.Array type introduced not too long ago https://github.com/google/jax/pull/11233/files

comment by qmatch · 2023-02-24 · in Training Deep Networks with Data Parallelism in Jax

If you have any particular examples in mind, and time to share them on https://github.com/google/jax/issues , we'd love to try to improve them. Improving error messages is a priority. About introspection tools, at least for runtime value…

comment by mattjjatgoogle · 2023-02-24 · in Training Deep Networks with Data Parallelism in Jax

…support for JAX which makes Python have automatic differentiation which is a key feature of Julia. https://github.com/google/jax

comment by zitterbewegung · 2023-02-14 · in The C++ Killers (Not You, Rust)

> I love their JAX For those out of loop: https://github.com/google/jax See also: https://news.ycombinator.com/item?id=29682507

comment by ignoramous · 2023-01-22 · in Google calls in help from Larry Page and Sergey Brin for A.I. fight

…on the JAX framework, you're frequently working with both the JAX and TensorFlow code repositories: https://github.com/google/jax/blob/main/WORKSPACE#L17

comment by grepLeigh · 2023-01-16 · in TensorFlow for Python is dying?

…popular these days. Not PyTorch-popular, but the progress and investment seem promissing. [1] https://github.com/google/jax

comment by flakiness · 2023-01-16 · in TensorFlow for Python is dying?

You should give JAX a go. https://github.com/google/jax

comment by nerpderp82 · 2022-10-26 · in Python 3.11 is faster than 3.8

The thread now has a fix. As for the GPU, it's possible to get it working with some extra steps https://github.com/google/jax/issues/8074 Macbook Pro M1 Pro numbers (CPU): python3 image_from_text.py --text='court sketch of godzilla on…

comment by klohto · 2022-06-28 · in Show HN: I stripped DALL·E Mini to its bare essentials and converted it to Torch

…(which is likely far more accessible), but then I found out that Colabs simply don't support pjit ( https://github.com/google/jax/issues/8300 ). Other than that, really like TRC!

comment by jasonphang · 2022-05-10 · in Cloud TPU VMs are generally available

…Google Jax is another option, jitting and vectorizing code for TPU, GPU or CPU. https://github.com/google/jax

comment by erwincoumans · 2022-04-04 · in Cython is 20

The approach JAX takes regarding PRNG for numerical computing is worth a look: https://github.com/google/jax/blob/main/docs/design_notes/pr...

comment by rogue7 · 2022-03-10 · in It is high time we let go of the Mersenne Twister (2019)

…it depends what kind of stuff you're working on. I do a lot of work with jax for my research ( https://github.com/google/jax ) and use functools.partial a lot.

comment by cgrimm1994 · 2022-02-21 · in More intuitive partial function application in Python

…used in the [autograd library]( https://github.com/HIPS/autograd ), which is a precursor to [Jax]( https://github.com/google/jax ), a competitor to Tensorflow and pytorch that's starting to gain traction.

comment by slewis · 2022-02-10 · in Tracing Functions in Python

…& GPU computations without getting into the details, check out JAX by our corporate overlords™ ( https://github.com/google/jax ), it has a NumPy like syntax and super fast to get started

comment by 4gotunameagain · 2022-01-28 · in Simulation of a 2B-atom cell that metabolizes and grows like a living cell

…with AMD GPUs. Here is the relevant issue for JAX (support seem to be in alpha but viable): https://github.com/google/jax/issues/2012

comment by nestorD · 2021-12-14 · in PyTorch vs. TensorFlow in 2022

…researcher in RL & ML in a big industry lab, I would say most of my colleagues are moving to JAX [ https://github.com/google/jax ], which this article kind of ignores. JAX is XLA-accelerated NumPy, it's cool beyond just machine learning,…

comment by tehf0x · 2021-12-14 · in PyTorch vs. TensorFlow in 2022

…the most experience with. [0] http://coconut-lang.org/ [1] https://docs.hylang.org/en/alpha/ [2] https://github.com/google/jax [3] https://github.com/pytorch/functorch

comment by jszymborski · 2021-11-26 · in PyTorch: Where we are headed and why it looks a lot like Julia (but not exactly)

…of jax works. Delightfully, I found a secret branch where autodidax also implements host callbacks: https://github.com/google/jax/blob/effect-types/docs/autodid... If you scroll to the very bottom of that file, you'll see an example of…

comment by sillysaurusx · 2021-11-06 · in Show HN: How does JAX allocate memory on a TPU? An interactive C++ walkthrough

…of this paradigm. look up pyro ( http://pyro.ai/examples/intro_part_i.html ) for ppl and jax ( https://github.com/google/jax ) for differential programming

comment by medo-bear · 2021-10-22 · in An Introduction to Probabilistic Programming

…opportunity to be a developer advocate for high-performance computing in such an interesting way? https://github.com/google/jax/issues/2108#issuecomment-86623... Definitely looking for more examples of "Github Larping," if you know of…

comment by sillysaurusx · 2021-06-24 · in Alias-Free GAN

…either. So how about this: you seem like a capable XLA TPU hacker. I’d like to pretend I submitted https://github.com/google/jax/issues/2108#issuecomment-86623... solely for an audience of you. What do you think of it? Critical feedback…

comment by sillysaurusx · 2021-06-23 · in How to Tame Your Jax: Navigating TPU VMs with TFRC in 2021

…submitting my announcement tweet. I think that’s lame; just submit the story, which in this case is https://github.com/google/jax/issues/2108#issuecomment-86623... . But I couldn’t figure out any possible way to submit that url to HN…

comment by sillysaurusx · 2021-06-23 · in How to Tame Your Jax: Navigating TPU VMs with TFRC in 2021

…https://news.ycombinator.com/item?id=27601986 ) Oh. Right. Umm, so the goal here is for me to submit https://github.com/google/jax/issues/2108#issuecomment-86623... to HN. But there is no possible way to submit that url to HN, because HN…

comment by sillysaurusx · 2021-06-23 · in How to Tame Your Jax: Navigating TPU VMs with TFRC in 2021

…hashtag anchors. The goal is to submit to HN one of the replies in that thread, not the main page: https://github.com/google/jax/issues/2108#issuecomment-86623... Without that anchor, I see no possible way to submit it to HN, because the…

comment by sillysaurusx · 2021-06-23 · in How to Tame Your Jax: Navigating TPU VMs with TFRC in 2021

…). Then the gradient calculations don't mix well with GPUs, at least for ODEs ( https://github.com/google/jax/issues/5006 ). That lack of composability compared to Julia is the main issue that then creeps up in the bigger problems.

comment by ChrisRackauckas · 2021-06-21 · in Julia: Faster than Fortran, cleaner than Numpy

…Or this person just happened to pick it up for some reason (for, say, better TPU support)? [1] https://github.com/google/jax

comment by flakiness · 2021-06-09 · in GPT-J-6B: 6B JAX-Based Transformer

…shoyer on Oct 26, 2019 [–] The practical counterpoint to Dex is Jax, by many of the same authors: https://github.com/google/jax I’m optimistic that we’ll eventually be able to figure out how to build practical tools [..] The biggest…

comment by kelas · 2021-03-13 · in Dex: A research language for typed, functional array processing

…do well) Currently Jax has an in-progress stiff ODE solver that's about 200x slower than SciPy https://github.com/google/jax/issues/3686#issuecomment-65709... and SciPy (with JIT) is about 50x-100x slower than the pure Julia methods…

comment by ChrisRackauckas · 2020-09-09 · in Fast.ai and why Python is not the future of ML with Jeremy Howard