Hacker GitHub

← All repos

Dicklesworthstone/swiss_army_llama

View on GitHub ↗ ★ 1,052 Python

A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.

10 mentions on Hacker News by 1 person: 4 stories, 6 comments · first 2023-08-09 · latest 2024-01-26

Mentions per year 10 mentions · busiest year 2023 (9)
20082026
AllStoriesComments NewestTopOldest
  1. …db as a service companies charge insane prices for this! It really does feel like snake oil to me. https://github.com/Dicklesworthstone/swiss_army_llama
    comment by eigenvalue · 2024-01-26 · in Command-line Tools can be 235x Faster than your Hadoop Cluster (2014)
  2. …completions/embeddings with some other nice features, you might want to check out my project here: https://github.com/Dicklesworthstone/swiss_army_llama Especially if you use Docker to set it up, you can go from a brand new box to a…
    comment by eigenvalue · 2023-11-28 · in Ask HN: Cheapest way to run local LLMs?
  3. …why I made my own FastAPI based one, Swiss Army Llama. I’m obviously biased, but I far prefer it: https://github.com/Dicklesworthstone/swiss_army_llama
    comment by eigenvalue · 2023-11-03 · in What's the difference between LangChain, llama indexand others like autollm?
  4. ▲ 1
    Show HN: Swiss Army Llama – A Versatile, FastAPI-Based Multitool for Local LLMs
    story by eigenvalue · 2023-10-10 · 2 comments
  5. …supply a pydantic data model description and it will generate the corresponding JSON BNF for you: https://github.com/Dicklesworthstone/swiss_army_llama/blob/m... And then you can add that grammar file and it will validate it with this:…
    comment by eigenvalue · 2023-10-03 · in Show HN: Swiss Army Llama
  6. ▲ 6
    Show HN: Swiss Army Llama
    story by eigenvalue · 2023-09-30 · 1 comment
  7. Cool, I also made a similar kind of tool recently that I also shared on HN a couple weeks ago. You might find it useful for generating and managing LLM embeddings locally: https://github.com/Dicklesworthstone/llama_embeddings_fastap...
    comment by eigenvalue · 2023-08-23 · in Show HN: Fast vector similarity using Rust and Python
  8. Thanks for pointing out those models. I see from a quick Huggingface search that the bge model is available in GGML format. You can trivially add new GGML format models to the code by simply adding the direct download link to this line:…
    comment by eigenvalue · 2023-08-15 · in Show HN: Llama2 Embeddings FastAPI Server
  9. ▲ 178
    Show HN: Llama2 Embeddings FastAPI Server
    story by eigenvalue · 2023-08-15 · 31 comments
  10. ▲ 4
    Show HN: Llama2 Embeddings FastAPI Service
    story by eigenvalue · 2023-08-09 · 0 comments