Hacker GitHub

← All repos

beehive-lab/jitllm

View on GitHub ↗ ★ 292 Java

Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs

9 mentions on Hacker News by 2 people: 4 stories, 5 comments · first 2025-05-30 · latest 2026-04-10

Mentions per year 9 mentions · busiest year 2025 (7)
20082026
AllStoriesComments NewestTopOldest
  1. …https://github.com/mukel/gemma4.java - [Jlama] https://github.com/tjake/Jlama - [GPULlama3.java https://github.com/beehive-lab/GPULlama3.java - [Qxotic] https://github.com/qxoticai/qxotic - [TornadoVM]…
    comment by mikepapadim · 2026-04-10 · in 5 Open-Source Projects Running Transformers on CPUs to GPUs in Pure-Modern Java
  2. …) - [Jlama]( https://github.com/tjake/Jlama ) - [GPULlama3.java]( https://github.com/beehive-lab/GPULlama3.java ) - [Qxotic]( https://github.com/qxoticai/qxotic ) - [TornadoVM]( https://github.com/beehive-lab/TornadoVM )
    comment by mikepapadim · 2026-04-10 · in 5 Open-Source Projects Running Transformers on CPUs to GPUs in Pure-Modern Java
  3. …has also implementation for flash attention. You can also write your own kernels, have a look here: https://github.com/beehive-lab/GPULlama3.java/blob/main/src/... https://github.com/beehive-lab/GPULlama3.java/blob/main/src/...
    comment by mikepapadim · 2025-12-12 · in Show HN: GPULlama3.java Llama Compilied to PTX/OpenCL Now Integrated in Quarkus
  4. https://github.com/beehive-lab/GPULlama3.java
    comment by mikepapadim · 2025-12-11 · in Show HN: GPULlama3.java Llama Compilied to PTX/OpenCL Now Integrated in Quarkus
  5. ▲ 48
    GPU-accelerated Llama3.java inference in pure Java using TornadoVM
    story by pjmlp · 2025-06-13 · 0 comments
  6. https://github.com/beehive-lab/GPULlama3.java We took Llama3.java and we ported TornadoVM to enable GPU code generation. Apparrently, the first beta version runs on Nnvidia GPUs, while getting a bit more than 100 toks/sec for 3B model on…
    comment by mikepapadim · 2025-06-13
  7. ▲ 3
    LLM Inference in pure Java with a GPU acceleration enabled
    story by mikepapadim · 2025-06-11 · 0 comments
  8. ▲ 2
    GPU-enabled Llama 3 inference in Java from scratch
    story by mikepapadim · 2025-06-02 · 0 comments
  9. ▲ 10
    GPULlama3.java – Llama3.java on Steroids
    story by mikepapadim · 2025-05-30 · 1 comment