bricks-cloud/BricksLLM
View on GitHub ↗ ★ 1,232 Go
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
7 mentions on Hacker News by 4 people: 4 stories, 3 comments · first 2023-09-13 · latest 2024-04-08
20082026
-
Clickable: https://github.com/bricks-cloud/bricksllm https://trybricks.ai
comment by throwaway888abc · 2024-04-08 · in Show HN: OSS tool that let you create OpenAI DX with any LLMs -
▲ 3
Show HN: OSS tool that let you create OpenAI DX with any LLMsstory by luyuanxin1995 · 2024-04-08 · 2 comments
-
▲ 3
How we built a highly scalable LLM gateway with gostory by donovan-so · 2024-04-01 · 0 comments
-
…support self-hosted models, as long as they're exposed as an API. Would this endpoint work for you? https://github.com/bricks-cloud/BricksLLM?tab=readme-ov-file...
comment by donovan-so · 2023-12-12 · in Show HN: I built an OSS alternative to Azure OpenAI services -
…encryption, it is hashing. Not sure where or how it is used but it is worth a rename at least: https://github.com/bricks-cloud/BricksLLM/blob/main/internal...
comment by mdeeks · 2023-12-11 · in Show HN: I built an OSS alternative to Azure OpenAI services -
▲ 200
Show HN: I built an OSS alternative to Azure OpenAI servicesstory by luyuanxin1995 · 2023-12-11 · 61 comments
-
▲ 4
Show HN: Create OpenAI keys with permission controlsstory by donovan-so · 2023-09-13 · 0 comments