Hacker GitHub

← All repos

stillmatic/gollum

View on GitHub ↗ ★ 61 Go

Production grade LLM-ops in Golang

5 mentions on Hacker News by 1 person: 0 stories, 5 comments · first 2023-06-15 · latest 2024-10-30

Mentions per year 5 mentions · busiest year 2023 (3)
20082026
AllStoriesComments NewestTopOldest
  1. nice work! I wrote a similar library ( https://github.com/stillmatic/gollum/blob/main/packages/vect... ) and similarly found that exact search (w/the same simple heap + SIMD optimizations) is quite fast. with 100k objects, retrieval…
    comment by huac · 2024-10-30 · in Go library for in-process vector search and embeddings with llama.cpp
  2. …SIMD version. Some somewhat unscientific calculations showed a 10x improvement staying in float32: https://github.com/stillmatic/gollum/blob/07a9aa35d2517af8cf... (comparable to the 9x improvement in article using SIMD + int8) TBH my…
    comment by huac · 2024-01-24 · in From slow to SIMD: A Go optimization story
  3. …with OpenAI etc, it's 'just' API calls and Go is great at that. I've opensourced some bits here: https://github.com/stillmatic/gollum -- in particular, function dispatch (given a prompt, return an arbitrary Go struct) is really nice, as is…
    comment by huac · 2023-11-28 · in Agency: Pure Go LangChain Alternative
  4. I've written a version of this in Golang (tied to OpenAI API, mostly): https://github.com/stillmatic/gollum/blob/main/dispatch.go Define a struct and tag it with golang's json comments. Then, give it a prompt and ... type dinnerParty…
    comment by huac · 2023-07-21 · in TypeChat
  5. I have gotten 10x speedups with SIMD on modern hardware - goes from fast to blazing. https://github.com/stillmatic/gollum/blob/main/vectorstore.g... FWIW - Weaviate's pure Go implementation of cosine similarity is probably as fast as you…
    comment by huac · 2023-06-15 · in FANN: Vector Search in 200 Lines of Rust