Hacker GitHub

← All repos

Noeda/rllama

View on GitHub ↗ ★ 553 Rust

Rust+OpenCL+AVX2 implementation of LLaMA inference code

6 mentions on Hacker News by 2 people: 1 story, 5 comments · first 2023-03-14 · latest 2023-07-03

Mentions per year 6 mentions · busiest year 2023 (6)
20082026
AllStoriesComments NewestTopOldest
  1. …Rust programming, machine learning implementations (see e.g. this LLaMA language model thing I made https://github.com/Noeda/rllama/ , graphics programming or research-type work, uncommon programming languages. If you scroll through my…
    comment by adeon · 2023-07-03 · in Ask HN: Who wants to be hired? (July 2023)
  2. I work on an independent LLM implementation here: https://github.com/Noeda/rllama/ I only got it working at all yesterday and there's no nice UX at all. Not sure I recommend trying to use this as llama.cpp will probably have this in no…
    comment by adeon · 2023-04-05 · in Using mmap to make LLaMA load faster
  3. No, my project is called rllama. No relation to GGML. https://github.com/Noeda/rllama
    comment by adeon · 2023-04-04 · in State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
  4. …with a Ryzen 5950X. It's not fast, 4 seconds per token. But it's just about fits without swapping. https://github.com/Noeda/rllama/
    comment by adeon · 2023-03-16 · in Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style LLM on a MacBook
  5. I've counted three different Rust LLaMA implementations on r/rust subreddit this week: https://github.com/Noeda/rllama/ (pure Rust+OpenCL) https://github.com/setzer22/llama-rs/ (ggml based) https://github.com/philpax/ggllama (also ggml…
    comment by adeon · 2023-03-15 · in Llama.rs – Rust port of llama.cpp for fast LLaMA inference on CPU
  6. ▲ 6
    Rust+OpenCL+AVX2 implementation of LLaMA inference code
    story by myers · 2023-03-14 · 0 comments