Lightning-AI/LitServe
View on GitHub ↗ ★ 3,993 Python
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
5 mentions on Hacker News by 4 people: 5 stories, 0 comments · first 2024-08-22 · latest 2025-10-31
20082026
-
▲ 1
LitServe: Build custom AI inference enginesstory by wfalcon · 2025-10-31 · 0 comments
-
▲ 1
Build your own AI model inference enginesstory by wfalcon · 2025-10-05 · 0 comments
-
▲ 8
A full-stack Python model serving librarystory by theaniketmaurya · 2024-08-28 · 0 comments
-
▲ 1
LitServe: Lightning-fast serving engine for AI models.story by bhimrazy · 2024-08-27 · 1 comment
-
▲ 11
LitServe: Easily serve AI models faststory by andymcsherry · 2024-08-22 · 1 comment