Hacker GitHub

← All repos

zilliztech/GPTCache

View on GitHub ↗ ★ 8,219 Python

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

24 mentions on Hacker News by 12 people: 20 stories, 4 comments · first 2023-04-05 · latest 2024-03-15

Mentions per year 24 mentions · busiest year 2023 (23)
20082026
AllStoriesComments NewestTopOldest
  1. Just found this: https://github.com/zilliztech/GPTCache which seems to address this idea/issue.
    comment by XCSme · 2024-03-15 · in Ask HN: What are the drawbacks of caching LLM responses?
  2. …this out. Built on a vector database ( https://github.com/milvus-io/milvus ) and a semantic cache ( https://github.com/zilliztech/GPTCache ) https://osschat.io/
    comment by ChrisPzilla · 2023-07-10 · in Show HN: Danswer – Open-source question answering across all your docs
  3. Maybe [GPTCache]( https://github.com/zilliztech/GPTCache ) can make it more attractive, because similar problems can be less expensive, and can also be responded to faster. Of course, the specific configuration needs to be based on real…
    comment by SimFG · 2023-06-30 · in Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 APIs
  4. Maybe GPTCache can reduce the count of llm request for lower cost. detail: https://github.com/zilliztech/GPTCache
    comment by SimFG · 2023-05-23 · in Show HN: DB-GPT, an LLM tool for database