Hacker GitHub

← All repos

BerriAI/litellm

View on GitHub ↗ ★ 62,544 Python

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

53 mentions on Hacker News by 39 people: 10 stories, 43 comments · first 2023-07-27 · latest 2026-10-21

Mentions per year 53 mentions · busiest year 2026 (20)
20082026
AllStoriesComments NewestTopOldest
  1. …https://news.ycombinator.com/item?id=50180838 | 0 comments 1792590232 | Litellm 1.107.0 Compromised | https://github.com/BerriAI/litellm/issues/47826 | https://news.ycombinator.com/item?id=50180845 | 0 comments
    comment by 1vuio0pswjnm7 · 2026-10-21 · in Compromised LiteLLM 1.107.0 on PyPI Installs a Credential Stealer and Backdoor
  2. https://github.com/BerriAI/litellm/issues/47826#issuecomment... > OSS Users > For the time being, please pin your version to 1.106.2 or any explicit version published prior to now. > Enterprise Customers > There currently exists a private…
    comment by hmokiguess · 2026-10-21 · in Compromised LiteLLM 1.107.0 on PyPI Installs a Credential Stealer and Backdoor
  3. …release that remediates a vulnerability whose disclosure date is scheduled for October 27. https://github.com/BerriAI/litellm/issues/47826 oh boy. Announcing that there's a private enterprise repo you should be paying for if you don't want…
    comment by petesergeant · 2026-10-21 · in Compromised LiteLLM 1.107.0 on PyPI Installs a Credential Stealer and Backdoor
  4. ▲ 3
    Litellm 1.107.0 on PYPI Compromised
    story by kykeonaut · 2026-10-21 · 0 comments
  5. ▲ 1
    New LiteLLM Vulnerability: Privilege Escalation to Proxy Admin and RCE
    story by ajackfox · 2026-09-30 · 0 comments
  6. ▲ 2
    Code shouldn't know which LLM provider you're using
    story by yyyysa · 2026-09-24 · 0 comments
  7. hey - litellm will migrate its core to Rust soon. please follow this issue if you're interested! https://github.com/BerriAI/litellm/issues/31263
    comment by yujonglee · 2026-09-11 · in Litelm: LiteLLM Without the Bloat
  8. …you have to offer: - https://github.com/ENTERPILOT/GoModel - https://github.com/maximhq/bifrost - https://github.com/BerriAI/litellm Would you care to share what makes experiential different?
    comment by mongrelion · 2026-08-28 · in Show HN: We built open OpenRouter that turns usage into a better model
  9. I'm glad I used litellm in my last project https://github.com/BerriAI/litellm/
    comment by SamDc73 · 2026-06-13 · in AI OSS tool repo goes archived over night after raising $7.3M Seed
  10. …vulnerability the attacker left hundreds of bot comments under the issue to bury the conversation: https://github.com/BerriAI/litellm/issues/24512
    comment by ildari · 2026-04-17 · in Let's talk about AI slop in open source
  11. …your message to the developer on github and they have changed the version to 0.35.0 ,so thanks. https://github.com/BerriAI/litellm/issues/24518#issuecomment...
    comment by Imustaskforhelp · 2026-03-24 · in Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised
  12. …mandiant.security team to understand scope of impact Reviewing / rotating any leaked credentials https://github.com/BerriAI/litellm/issues/24518#issuecomment...
    comment by Imustaskforhelp · 2026-03-24 · in Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised
  13. …this thread as they mention that: "I will be updating this thread, as we have more to share." https://github.com/BerriAI/litellm/issues/24518
    comment by Imustaskforhelp · 2026-03-24 · in Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised
  14. LiteLLM has like a 1000 dependencies this is expected https://github.com/BerriAI/litellm/blob/main/requirements.tx...
    comment by segalord · 2026-03-24 · in Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised
  15. …threat actor is stifling genuine comments in github by spamming that thread with 100's of accounts https://github.com/BerriAI/litellm/issues/24512#issuecomment...
    comment by Imustaskforhelp · 2026-03-24 · in Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised
  16. ▲ 739
    Malicious litellm_init.pth in litellm 1.82.8 PyPI package – credential stealer
    story by theanonymousone · 2026-03-24 · 1 comment
  17. It's also been reported to their GitHub: https://github.com/BerriAI/litellm/issues/24512
    comment by rgambee · 2026-03-24 · in LiteLLM PyPI has been compromised an hour ago, do not update
  18. ▲ 938
    Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised
    story by dot_treo · 2026-03-24 · 500 comments
  19. …And now I can! This site is built every night from the open source pricing data from LiteLLM - https://github.com/BerriAI/litellm - which was the most comprehensive data I could find. I think the main weakness is lack of fuzzy searching,…
    comment by tomd · 2026-01-20 · in API for Current LLM Pricing
  20. Interesting, any plans to add LiteLLM ( https://github.com/BerriAI/litellm ) and Kilocode ( https://github.com/Kilo-Org/kilocode )?
    comment by sschueller · 2026-01-15 · in Bubblewrap: A nimble way to prevent agents from accessing your .env files
  21. ▲ 5
    LiteLLM Python SDK Proxy Server LLM Gateway Call 100 LLM APIs in OpenAI Format
    story by Bluestein · 2025-07-24 · 0 comments
  22. …much browsing through the 7000+ line `utils.py` to see where using it could become problematic ( https://github.com/BerriAI/litellm/blob/main/litellm/utils.p... )
    comment by tom_usher · 2025-07-22 · in Show HN: Any-LLM – Lightweight router to access any LLM Provider
  23. …open source projects that do a good job as proxys (no affiliation I just used them in the past): - https://github.com/BerriAI/litellm - https://github.com/KenyonY/openai-forward/tree/main but they still lack other abuse protection…
    comment by brahyam · 2025-07-02 · in Exploiting the IKKO Activebuds “AI powered” earbuds (2024)
  24. ▲ 56
    Show HN: A modern C++20 AI SDK (GPT‑4o, Claude 3.5, tool‑calling)
    story by cauchyk · 2025-06-29 · 6 comments
  25. Confession time: litellm still doesn't support parallel tool calls with Gemini models [ https://github.com/BerriAI/litellm/issues/9686 ] so we wrote our own "parallel tool calls" on top of Structured Output. It did take a few iterations on…
    comment by jbellis · 2025-05-15 · in The unreasonable effectiveness of an LLM agent loop with tool use
  26. …with LiteLLM's approach is that every model provider needs to be added to the core library - in https://github.com/BerriAI/litellm/tree/main/litellm/llms - and then shipped as a new release. LLM uses plugins because then there's no need to…
    comment by simonw · 2025-04-10 · in Smartfunc: Turn Docstrings into LLM-Functions
  27. …to stick with em. You can also use tools like litellm and openrouter to abstract away choice of API https://github.com/BerriAI/litellm https://openrouter.ai/
    comment by 0xDEAFBEAD · 2025-02-16 · in Perplexity Deep Research
  28. We're excited about this version which add support for LiteLLM https://github.com/BerriAI/litellm . With LiteLLM the application can easily switch between different models to pick to most optimized model for Knowledge Graph generation and…
    comment by gkorland · 2024-12-23 · in Show HN: GraphRAG SDK 0.4.0: Simplify RAG with Graph Databases
  29. …you want hosted-search: Doc: https://getcanary.dev/docs/cloud/integrations/docusaurus Example PR: https://github.com/BerriAI/litellm/pull/6160/files
    comment by yujonglee · 2024-10-12 · in Show HN: Self-Hostable Algolia DocSearch Replacement
  30. …may not be able to match large queries but, testing will help you transition to other services. [1] https://github.com/BerriAI/litellm [2] https://langtrace.ai/
    comment by zitterbewegung · 2024-09-26 · in Llama 3.2: Revolutionizing edge AI and vision with open, customizable models
  31. Sounds like https://github.com/BerriAI/litellm
    comment by bofadeez · 2024-09-06 · in Launch HN: Maitai (YC S24) – Self-Optimizing LLM Platform
  32. Litellm maintains list of model infos here: https://github.com/BerriAI/litellm/blob/main/model_prices_an... Simple UI to search: https://models.litellm.ai/?q=llama3
    comment by yujonglee · 2024-08-14 · in Show HN: Open-source LLM provider price comparison
  33. Very cool! Is this cost directory you're using the best source for historical cost per 1M tokens? https://github.com/BerriAI/litellm/blob/main/model_prices_an...
    comment by zackfield · 2024-06-17 · in Show HN: Token price calculator for 400+ LLMs
  34. Hey, are you just looking for litellm - https://github.com/BerriAI/litellm context - i'm the repo maintainer
    comment by detente18 · 2024-03-07 · in Ask HN: Python Meta-Client for OpenAI, Anthropic, Gemini and other LLM API-s?
  35. …allow changing the OpenAI endpoint to a custom one, you can support lots of options through LiteLlm https://github.com/BerriAI/litellm
    comment by viraptor · 2024-01-27 · in What LLM to add next to my GPT client, after Gemini and Open AI?
  36. It should be possible using LiteLLM and a patch or a proxy. https://github.com/BerriAI/litellm
    comment by speedgoose · 2024-01-19 · in Show HN: Voxos.ai – An Open-Source Desktop Voice Assistant
  37. Probably with https://github.com/BerriAI/litellm
    comment by chpatrick · 2023-12-21 · in Show HN: Talk to any ArXiv paper just by changing the URL
  38. …We are currently evaluating replacing our homegrown version of an LLM proxy with this project: https://github.com/BerriAI/litellm Any comparison or contrast you would point out?
    comment by aaronharnly · 2023-12-12 · in Show HN: I built an OSS alternative to Azure OpenAI services
  39. Another abstraction layer library is: https://github.com/BerriAI/litellm For me the killer feature of a library like this would be if it implemented function calling. Even if it was for a very restricted grammar - like the traditional…
    comment by zby · 2023-12-06 · in Swap OpenAI with any open-source model
  40. …via LiteLLM proxy. Related issue: https://github.com/danny-avila/LibreChat/issues/1131 LiteLLM: https://github.com/BerriAI/litellm Guide: https://github.com/danny-avila/LibreChat/blob/main/docs/inst...
    comment by cloudking · 2023-12-02 · in LibreChat – Enhanced ChatGPT Clone
  41. …shouldn't be too difficult to build this with python. I wonder why none of the popular routers like https://github.com/BerriAI/litellm have this feature. > Problem is running so many LLMs in parallel means you need quite a bunch of…
    comment by fintechie · 2023-12-01 · in Are Open-Source Large Language Models Catching Up?
  42. …API that can query ollama.. eg [1] [0] https://github.com/ivanfioravanti/chatbot-ollama [1] https://github.com/BerriAI/litellm
    comment by fintechie · 2023-11-22 · in LM Studio – Discover, download, and run local LLMs
  43. …the OpenAI API as the canonical interface? Do you think there could be changes in the future? [0] https://github.com/BerriAI/litellm
    comment by kiwicopple · 2023-11-20 · in Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral
  44. Here's the template I'm using - https://github.com/BerriAI/litellm/blob/5ca8b23e22139a4f49bd... Anything I'm doing incorrectly?
    comment by detente18 · 2023-09-09 · in Asking 60 LLMs a set of 20 questions
  45. Ran some testing and discovered llama2 on replicate is faster than chatgpt! Code - https://github.com/BerriAI/litellm/blob/main/cookbook/Evalua... Are others seeing similar results?
    comment by ij23 · 2023-08-16 · in Llama2 on Replicate faster than ChatGPT?
  46. ▲ 1
    Llama2 on Replicate faster than ChatGPT?
    story by ij23 · 2023-08-16 · 2 comments
  47. …asking how to run self-hosted llama2, we just added the ollama integration. Here's the tutorial - https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL...
    comment by detente18 · 2023-08-12 · in Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching
  48. If you'd like to add any of these ideas as notebooks to our cookbook - https://github.com/BerriAI/litellm/tree/main/cookbook , we'd love the contribution!
    comment by detente18 · 2023-08-12 · in Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching
  49. …edit: Found the cache notebook[1] and the calls to the cache and distance eval in the code[2] [1] https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL... [2] https://github.com/BerriAI/litellm/blob/80d77fed7123af222011...
    comment by danielbln · 2023-08-12 · in Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching
  50. …@deet - Yes it is! This automatically stores the cost per query to the Supabase table - here's how: https://github.com/BerriAI/litellm/blob/80d77fed7123af222011... If you have ideas for improvement - we'd love a ticket/PR!
    comment by detente18 · 2023-08-12 · in Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching