Hacker GitHub

← All repos

AI-Hypercomputer/JetStream

View on GitHub ↗ ★ 473 Python

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

3 mentions on Hacker News by 3 people: 2 stories, 1 comment · first 2024-04-09 · latest 2024-09-01

Mentions per year 3 mentions · busiest year 2024 (3)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 2
    JetStream: Throughput+memory optimized engine for LLM inference on XLA devices
    story by lnyan · 2024-09-01 · 0 comments
  2. ▲ 4
    Jetstream: New LLM Inference Engine
    story by gfortaine · 2024-04-09 · 0 comments