BerriAI/litellm
View on GitHub ↗ ★ 62,544 Python
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
53 mentions on Hacker News by 39 people: 10 stories, 43 comments · first 2023-07-27 · latest 2026-10-21
20082026
-
▲ 3
Litellm 1.107.0 on PYPI Compromisedstory by kykeonaut · 2026-10-21 · 0 comments
-
▲ 1
New LiteLLM Vulnerability: Privilege Escalation to Proxy Admin and RCEstory by ajackfox · 2026-09-30 · 0 comments
-
▲ 2
Code shouldn't know which LLM provider you're usingstory by yyyysa · 2026-09-24 · 0 comments
-
▲ 739
Malicious litellm_init.pth in litellm 1.82.8 PyPI package – credential stealerstory by theanonymousone · 2026-03-24 · 1 comment
-
▲ 938
Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromisedstory by dot_treo · 2026-03-24 · 500 comments
-
▲ 5
LiteLLM Python SDK Proxy Server LLM Gateway Call 100 LLM APIs in OpenAI Formatstory by Bluestein · 2025-07-24 · 0 comments
-
▲ 56
Show HN: A modern C++20 AI SDK (GPT‑4o, Claude 3.5, tool‑calling)story by cauchyk · 2025-06-29 · 6 comments
-
▲ 1
Llama2 on Replicate faster than ChatGPT?story by ij23 · 2023-08-16 · 2 comments
-
▲ 140
Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Cachingstory by ij23 · 2023-08-12 · 34 comments
-
▲ 62
Show HN: Litellm – Simple library to standardize OpenAI, Cohere, Azure LLM I/Ostory by ij23 · 2023-07-27 · 17 comments