BerriAI/litellm on Hacker News

comment by 1vuio0pswjnm7 · 2026-10-21 · in Compromised LiteLLM 1.107.0 on PyPI Installs a Credential Stealer and Backdoor

https://github.com/BerriAI/litellm/issues/47826#issuecomment... > OSS Users > For the time being, please pin your version to 1.106.2 or any explicit version published prior to now. > Enterprise Customers > There currently exists a private…

comment by hmokiguess · 2026-10-21 · in Compromised LiteLLM 1.107.0 on PyPI Installs a Credential Stealer and Backdoor

…release that remediates a vulnerability whose disclosure date is scheduled for October 27. https://github.com/BerriAI/litellm/issues/47826 oh boy. Announcing that there's a private enterprise repo you should be paying for if you don't want…

comment by petesergeant · 2026-10-21 · in Compromised LiteLLM 1.107.0 on PyPI Installs a Credential Stealer and Backdoor

hey - litellm will migrate its core to Rust soon. please follow this issue if you're interested! https://github.com/BerriAI/litellm/issues/31263

comment by yujonglee · 2026-09-11 · in Litelm: LiteLLM Without the Bloat

…you have to offer: - https://github.com/ENTERPILOT/GoModel - https://github.com/maximhq/bifrost - https://github.com/BerriAI/litellm Would you care to share what makes experiential different?

comment by mongrelion · 2026-08-28 · in Show HN: We built open OpenRouter that turns usage into a better model

I'm glad I used litellm in my last project https://github.com/BerriAI/litellm/

comment by SamDc73 · 2026-06-13 · in AI OSS tool repo goes archived over night after raising $7.3M Seed

…vulnerability the attacker left hundreds of bot comments under the issue to bury the conversation: https://github.com/BerriAI/litellm/issues/24512

comment by ildari · 2026-04-17 · in Let's talk about AI slop in open source

…your message to the developer on github and they have changed the version to 0.35.0 ,so thanks. https://github.com/BerriAI/litellm/issues/24518#issuecomment...

comment by Imustaskforhelp · 2026-03-24 · in Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

…mandiant.security team to understand scope of impact Reviewing / rotating any leaked credentials https://github.com/BerriAI/litellm/issues/24518#issuecomment...

comment by Imustaskforhelp · 2026-03-24 · in Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

…this thread as they mention that: "I will be updating this thread, as we have more to share." https://github.com/BerriAI/litellm/issues/24518

comment by Imustaskforhelp · 2026-03-24 · in Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

LiteLLM has like a 1000 dependencies this is expected https://github.com/BerriAI/litellm/blob/main/requirements.tx...

comment by segalord · 2026-03-24 · in Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

…threat actor is stifling genuine comments in github by spamming that thread with 100's of accounts https://github.com/BerriAI/litellm/issues/24512#issuecomment...

comment by Imustaskforhelp · 2026-03-24 · in Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised

It's also been reported to their GitHub: https://github.com/BerriAI/litellm/issues/24512

comment by rgambee · 2026-03-24 · in LiteLLM PyPI has been compromised an hour ago, do not update

…And now I can! This site is built every night from the open source pricing data from LiteLLM - https://github.com/BerriAI/litellm - which was the most comprehensive data I could find. I think the main weakness is lack of fuzzy searching,…

comment by tomd · 2026-01-20 · in API for Current LLM Pricing

Interesting, any plans to add LiteLLM ( https://github.com/BerriAI/litellm ) and Kilocode ( https://github.com/Kilo-Org/kilocode )?

comment by sschueller · 2026-01-15 · in Bubblewrap: A nimble way to prevent agents from accessing your .env files

…much browsing through the 7000+ line `utils.py` to see where using it could become problematic ( https://github.com/BerriAI/litellm/blob/main/litellm/utils.p... )

comment by tom_usher · 2025-07-22 · in Show HN: Any-LLM – Lightweight router to access any LLM Provider

…open source projects that do a good job as proxys (no affiliation I just used them in the past): - https://github.com/BerriAI/litellm - https://github.com/KenyonY/openai-forward/tree/main but they still lack other abuse protection…

comment by brahyam · 2025-07-02 · in Exploiting the IKKO Activebuds “AI powered” earbuds (2024)

Confession time: litellm still doesn't support parallel tool calls with Gemini models [ https://github.com/BerriAI/litellm/issues/9686 ] so we wrote our own "parallel tool calls" on top of Structured Output. It did take a few iterations on…

comment by jbellis · 2025-05-15 · in The unreasonable effectiveness of an LLM agent loop with tool use

…with LiteLLM's approach is that every model provider needs to be added to the core library - in https://github.com/BerriAI/litellm/tree/main/litellm/llms - and then shipped as a new release. LLM uses plugins because then there's no need to…

comment by simonw · 2025-04-10 · in Smartfunc: Turn Docstrings into LLM-Functions

…to stick with em. You can also use tools like litellm and openrouter to abstract away choice of API https://github.com/BerriAI/litellm https://openrouter.ai/

comment by 0xDEAFBEAD · 2025-02-16 · in Perplexity Deep Research

We're excited about this version which add support for LiteLLM https://github.com/BerriAI/litellm . With LiteLLM the application can easily switch between different models to pick to most optimized model for Knowledge Graph generation and…

comment by gkorland · 2024-12-23 · in Show HN: GraphRAG SDK 0.4.0: Simplify RAG with Graph Databases

…you want hosted-search: Doc: https://getcanary.dev/docs/cloud/integrations/docusaurus Example PR: https://github.com/BerriAI/litellm/pull/6160/files

comment by yujonglee · 2024-10-12 · in Show HN: Self-Hostable Algolia DocSearch Replacement

…may not be able to match large queries but, testing will help you transition to other services. [1] https://github.com/BerriAI/litellm [2] https://langtrace.ai/

comment by zitterbewegung · 2024-09-26 · in Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

Sounds like https://github.com/BerriAI/litellm

comment by bofadeez · 2024-09-06 · in Launch HN: Maitai (YC S24) – Self-Optimizing LLM Platform

Litellm maintains list of model infos here: https://github.com/BerriAI/litellm/blob/main/model_prices_an... Simple UI to search: https://models.litellm.ai/?q=llama3

comment by yujonglee · 2024-08-14 · in Show HN: Open-source LLM provider price comparison

Very cool! Is this cost directory you're using the best source for historical cost per 1M tokens? https://github.com/BerriAI/litellm/blob/main/model_prices_an...

comment by zackfield · 2024-06-17 · in Show HN: Token price calculator for 400+ LLMs

Hey, are you just looking for litellm - https://github.com/BerriAI/litellm context - i'm the repo maintainer

comment by detente18 · 2024-03-07 · in Ask HN: Python Meta-Client for OpenAI, Anthropic, Gemini and other LLM API-s?

…allow changing the OpenAI endpoint to a custom one, you can support lots of options through LiteLlm https://github.com/BerriAI/litellm

comment by viraptor · 2024-01-27 · in What LLM to add next to my GPT client, after Gemini and Open AI?

It should be possible using LiteLLM and a patch or a proxy. https://github.com/BerriAI/litellm

comment by speedgoose · 2024-01-19 · in Show HN: Voxos.ai – An Open-Source Desktop Voice Assistant

Probably with https://github.com/BerriAI/litellm

comment by chpatrick · 2023-12-21 · in Show HN: Talk to any ArXiv paper just by changing the URL

…We are currently evaluating replacing our homegrown version of an LLM proxy with this project: https://github.com/BerriAI/litellm Any comparison or contrast you would point out?

comment by aaronharnly · 2023-12-12 · in Show HN: I built an OSS alternative to Azure OpenAI services

Another abstraction layer library is: https://github.com/BerriAI/litellm For me the killer feature of a library like this would be if it implemented function calling. Even if it was for a very restricted grammar - like the traditional…

comment by zby · 2023-12-06 · in Swap OpenAI with any open-source model

…via LiteLLM proxy. Related issue: https://github.com/danny-avila/LibreChat/issues/1131 LiteLLM: https://github.com/BerriAI/litellm Guide: https://github.com/danny-avila/LibreChat/blob/main/docs/inst...

comment by cloudking · 2023-12-02 · in LibreChat – Enhanced ChatGPT Clone

…shouldn't be too difficult to build this with python. I wonder why none of the popular routers like https://github.com/BerriAI/litellm have this feature. > Problem is running so many LLMs in parallel means you need quite a bunch of…

comment by fintechie · 2023-12-01 · in Are Open-Source Large Language Models Catching Up?

…API that can query ollama.. eg [1] [0] https://github.com/ivanfioravanti/chatbot-ollama [1] https://github.com/BerriAI/litellm

comment by fintechie · 2023-11-22 · in LM Studio – Discover, download, and run local LLMs

…the OpenAI API as the canonical interface? Do you think there could be changes in the future? [0] https://github.com/BerriAI/litellm

comment by kiwicopple · 2023-11-20 · in Show HN: AI Proxy with Support for OpenAI, Anthropic, LLaMa2, Mistral

Here's the template I'm using - https://github.com/BerriAI/litellm/blob/5ca8b23e22139a4f49bd... Anything I'm doing incorrectly?

comment by detente18 · 2023-09-09 · in Asking 60 LLMs a set of 20 questions

Ran some testing and discovered llama2 on replicate is faster than chatgpt! Code - https://github.com/BerriAI/litellm/blob/main/cookbook/Evalua... Are others seeing similar results?

comment by ij23 · 2023-08-16 · in Llama2 on Replicate faster than ChatGPT?

…asking how to run self-hosted llama2, we just added the ollama integration. Here's the tutorial - https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL...

comment by detente18 · 2023-08-12 · in Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching

If you'd like to add any of these ideas as notebooks to our cookbook - https://github.com/BerriAI/litellm/tree/main/cookbook , we'd love the contribution!

comment by detente18 · 2023-08-12 · in Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching

…edit: Found the cache notebook[1] and the calls to the cache and distance eval in the code[2] [1] https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL... [2] https://github.com/BerriAI/litellm/blob/80d77fed7123af222011...

comment by danielbln · 2023-08-12 · in Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching

…@deet - Yes it is! This automatically stores the cost per query to the Supabase table - here's how: https://github.com/BerriAI/litellm/blob/80d77fed7123af222011... If you have ideas for improvement - we'd love a ticket/PR!

comment by detente18 · 2023-08-12 · in Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching

…yes it does! Exactly the same way as the openai-python sdk. Here's our code tutorial for it https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL...

comment by detente18 · 2023-08-12 · in Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching