Hacker GitHub

← All repos

beehive-lab/jitllm

View on GitHub ↗ ★ 292 Java

Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs

9 mentions on Hacker News by 2 people: 4 stories, 5 comments · first 2025-05-30 · latest 2026-04-10

Mentions per year 9 mentions · busiest year 2025 (7)
20082026
AllStoriesComments NewestTopOldest
  1. …https://github.com/mukel/gemma4.java - [Jlama] https://github.com/tjake/Jlama - [GPULlama3.java https://github.com/beehive-lab/GPULlama3.java - [Qxotic] https://github.com/qxoticai/qxotic - [TornadoVM]…
    comment by mikepapadim · 2026-04-10 · in 5 Open-Source Projects Running Transformers on CPUs to GPUs in Pure-Modern Java
  2. …) - [Jlama]( https://github.com/tjake/Jlama ) - [GPULlama3.java]( https://github.com/beehive-lab/GPULlama3.java ) - [Qxotic]( https://github.com/qxoticai/qxotic ) - [TornadoVM]( https://github.com/beehive-lab/TornadoVM )
    comment by mikepapadim · 2026-04-10 · in 5 Open-Source Projects Running Transformers on CPUs to GPUs in Pure-Modern Java
  3. …has also implementation for flash attention. You can also write your own kernels, have a look here: https://github.com/beehive-lab/GPULlama3.java/blob/main/src/... https://github.com/beehive-lab/GPULlama3.java/blob/main/src/...
    comment by mikepapadim · 2025-12-12 · in Show HN: GPULlama3.java Llama Compilied to PTX/OpenCL Now Integrated in Quarkus
  4. https://github.com/beehive-lab/GPULlama3.java
    comment by mikepapadim · 2025-12-11 · in Show HN: GPULlama3.java Llama Compilied to PTX/OpenCL Now Integrated in Quarkus
  5. https://github.com/beehive-lab/GPULlama3.java We took Llama3.java and we ported TornadoVM to enable GPU code generation. Apparrently, the first beta version runs on Nnvidia GPUs, while getting a bit more than 100 toks/sec for 3B model on…
    comment by mikepapadim · 2025-06-13