Hacker GitHub

← All repos

google-ai-edge/LiteRT-LM

View on GitHub ↗ ★ 6,853 C++

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

4 mentions on Hacker News by 4 people: 3 stories, 1 comment · first 2025-06-11 · latest 2026-04-05

Mentions per year 4 mentions · busiest year 2025 (2)
20082026
  1. …for building an amazing model and also an inference engine that's focused for edge devices [0] [0] https://github.com/google-ai-edge/LiteRT-LM
    comment by karimf · 2026-04-05 · in Gemma 4 on iPhone