BerriAI/litellm
View on GitHub ↗ ★ 62,544 Python
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
53 mentions on Hacker News by 39 people: 10 stories, 43 comments · first 2023-07-27 · latest 2026-10-21
20082026
-
…yes it does! Exactly the same way as the openai-python sdk. Here's our code tutorial for it https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL...
comment by detente18 · 2023-08-12 · in Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching -
▲ 140
Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Cachingstory by ij23 · 2023-08-12 · 34 comments
-
▲ 62
Show HN: Litellm – Simple library to standardize OpenAI, Cohere, Azure LLM I/Ostory by ij23 · 2023-07-27 · 17 comments