google-ai-edge/LiteRT-LM
View on GitHub ↗ ★ 6,853 C++
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
4 mentions on Hacker News by 4 people: 3 stories, 1 comment · first 2025-06-11 · latest 2026-04-05
20082026
-
…for building an amazing model and also an inference engine that's focused for edge devices [0] [0] https://github.com/google-ai-edge/LiteRT-LM
comment by karimf · 2026-04-05 · in Gemma 4 on iPhone -
▲ 2
Add NPU support for AICore for Gemma4 modelstory by limoce · 2026-03-09 · 0 comments
-
▲ 2
A C++ library to efficiently run language models across edge platformsstory by srameshc · 2025-09-25 · 0 comments
-
▲ 5
A C++ library to efficiently run Gemma-3N across various platformstory by BUFU · 2025-06-11 · 0 comments