Hacker GitHub

← All repos

gotzmann/llama.go

View on GitHub ↗ ★ 1,404 Go

llama.go is like llama.cpp in pure Golang!

7 mentions on Hacker News by 2 people: 1 story, 6 comments · first 2023-04-12 · latest 2023-06-11

Mentions per year 7 mentions · busiest year 2023 (7)
20082026
AllStoriesComments NewestTopOldest
  1. You might reuse simple LLaMA tokenizer right in your Go code, look there: https://github.com/gotzmann/llama.go/blob/8cc54ca81e6bfbce25...
    comment by Ambix · 2023-06-11 · in Understanding GPT tokenizers
  2. …14 threads available are of no use, there no memory bandwidth to load them with work :) [0] https://github.com/gotzmann/llama.go
    comment by Ambix · 2023-05-04 · in OpenLLaMA: An Open Reproduction of LLaMA
  3. …to finally build a solid piece which can handle some crazy CPU workloads of tensor math. [0] https://github.com/gotzmann/llama.go
    comment by Ambix · 2023-04-28 · in Ask HN: Most interesting tech you built for just yourself?
  4. Someone implemented llama on Go recently, https://github.com/gotzmann/llama.go Wouldn't discard a rust implementation of some LLM architecture at some point
    comment by tough · 2023-04-19 · in StableLM: A new open-source language model
  5. …It will cost like 0.1% of what I need to pay for GPU cluster with the same memory size :) [0] https://github.com/gotzmann/llama.go/
    comment by Ambix · 2023-04-18 · in OpenAI’s CEO says the age of giant AI models is already over
  6. …It successfully runs relatively big LLM right now, and diffusion models will be the next step [1] https://github.com/gotzmann/llama.go/
    comment by Ambix · 2023-04-17 · in MiniGPT-4
  7. ▲ 25
    Show HN: Llama.go – port of llama.cpp to pure Go
    story by Ambix · 2023-04-12 · 5 comments