Hacker GitHub

← All repos

zilliztech/GPTCache

View on GitHub ↗ ★ 8,219 Python

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

24 mentions on Hacker News by 12 people: 20 stories, 4 comments · first 2023-04-05 · latest 2024-03-15

Mentions per year 24 mentions · busiest year 2023 (23)
20082026
AllStoriesComments NewestTopOldest
  1. Just found this: https://github.com/zilliztech/GPTCache which seems to address this idea/issue.
    comment by XCSme · 2024-03-15 · in Ask HN: What are the drawbacks of caching LLM responses?
  2. ▲ 1
    Semantic Cache
    story by fzliu · 2023-07-16 · 0 comments
  3. …this out. Built on a vector database ( https://github.com/milvus-io/milvus ) and a semantic cache ( https://github.com/zilliztech/GPTCache ) https://osschat.io/
    comment by ChrisPzilla · 2023-07-10 · in Show HN: Danswer – Open-source question answering across all your docs
  4. ▲ 2
    GPTCache
    story by tikkun · 2023-07-09 · 0 comments
  5. ▲ 3
    Ask HN: Is LLM caching necessary?
    story by SimFG · 2023-07-08 · 1 comment
  6. ▲ 2
    GPTCache
    story by fzliu · 2023-07-05 · 0 comments
  7. Maybe [GPTCache]( https://github.com/zilliztech/GPTCache ) can make it more attractive, because similar problems can be less expensive, and can also be responded to faster. Of course, the specific configuration needs to be based on real…
    comment by SimFG · 2023-06-30 · in Gorilla-CLI: LLMs for CLI including K8s/AWS/GCP/Azure/sed and 1500 APIs
  8. ▲ 2
    GPTCache
    story by wseqyrku · 2023-06-07 · 0 comments
  9. ▲ 2
    Limited budget or machine resources, how to achieve a decent LLM experience?
    story by SimFG · 2023-05-26 · 1 comment
  10. Maybe GPTCache can reduce the count of llm request for lower cost. detail: https://github.com/zilliztech/GPTCache
    comment by SimFG · 2023-05-23 · in Show HN: DB-GPT, an LLM tool for database
  11. ▲ 5
    How GPTCache works with llama index
    story by SimFG · 2023-05-22 · 1 comment
  12. ▲ 1
    GPTCache
    story by nunodonato · 2023-04-22 · 0 comments
  13. ▲ 2
    Redis for ChatGPT
    story by yujian · 2023-04-20 · 0 comments
  14. ▲ 1
    Show HN: Reduce your GPT bill via semantic caching
    story by fzliu · 2023-04-19 · 0 comments
  15. ▲ 3
    Reduce your GPT bill via semantic caching
    story by fzliu · 2023-04-19 · 0 comments
  16. ▲ 3
    Show HN: GPT4 New Cache Component for App Developers
    story by rt_guo · 2023-04-18 · 0 comments
  17. ▲ 3
    Reduce your GPT bill via semantic caching
    story by fzliu · 2023-04-17 · 0 comments
  18. ▲ 4
    Reduce your GPT bill via semantic caching
    story by fzliu · 2023-04-15 · 2 comments
  19. ▲ 1
    GPTCache – High-Performance Cache for Language Models
    story by fhaltmayer · 2023-04-14 · 0 comments
  20. ▲ 7
    Show HN: GPTCache – Redis for LLMs
    story by fzliu · 2023-04-12 · 5 comments
  21. ▲ 2
    GPTCache: Semantic Cache for LLMs
    story by fzliu · 2023-04-10 · 0 comments
  22. ▲ 3
    GPTCache: Semantic Cache for LLM Queries
    story by opisthenar84 · 2023-04-08 · 0 comments
  23. ▲ 18
    GPTCache: Slash Your LLM API Costs by 10x
    story by fhaltmayer · 2023-04-06 · 6 comments
  24. ▲ 2
    Does ChatGPT Need a Cache?
    story by redskyluan · 2023-04-05 · 1 comment