← All repos

Lightning-AI/LitServe

View on GitHub ↗ ★ 3,993 Python

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

5 mentions on Hacker News by 4 people: 5 stories, 0 comments · first 2024-08-22 · latest 2025-10-31