AI-Hypercomputer/JetStream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

3 mentions on Hacker News by 3 people: 2 stories, 1 comment · first 2024-04-09 · latest 2024-09-01

Mentions per year 3 mentions · busiest year 2024 (3)

20082026

All Stories Comments Newest Top Oldest

…Google Next 2024 session going into detail: https://www.youtube.com/watch?v=5QsM1K9ahtw https://github.com/google/JetStream https://github.com/google/maxtext
comment by kiratp · 2024-06-14 · in Cost of self hosting Llama-3 8B-Instruct