Hacker GitHub

← All repos

recmo/cria

View on GitHub ↗ ★ 92 Python

Tiny inference-only implementation of LLaMA

3 mentions on Hacker News by 1 person: 0 stories, 3 comments · first 2023-05-02 · latest 2024-05-16

Mentions per year 3 mentions · busiest year 2024 (2)
20082026
AllStoriesComments NewestTopOldest
  1. Obligatory Recmo’s Llama1 implementation in numpy :) https://github.com/recmo/cria
    comment by kolinko · 2024-05-16 · in Llama 3 implemented in pure NumPy
  2. It originally started as a fork to Recmo’s cria pure numpy llama impl :) https://github.com/recmo/cria Took a whole night to compute a few tokens, but I used it to do the first tests. Also, my friend pasted the paper to claude and it…
    comment by kolinko · 2024-04-17 · in Show HN: Speeding up LLM inference 2x times (possibly)
  3. Not op, but I can share my approach - I went line by line by Recmo's Cria: https://github.com/recmo/cria - which is an implementation of Llama in Numpy - so very low level. Took me I think 3-4 days x 10 hours + 1-2 days of reading about…
    comment by kolinko · 2023-05-02 · in Jsonformer: Generate structured output from LLMs