Hacker GitHub

← All repos

karpathy/llama2.c

View on GitHub ↗ ★ 20,245 C

Inference Llama 2 in one file of pure C

19 mentions on Hacker News by 18 people: 2 stories, 17 comments · first 2023-07-23 · latest 2025-01-29

Mentions per year 19 mentions · busiest year 2023 (13)
20082026
AllStoriesComments NewestTopOldest
  1. Personal fave: https://github.com/karpathy/llama2.c
    comment by syassami · 2025-01-29 · in SmolGPT: A minimal PyTorch implementation for training a small LLM from scratch
  2. …usable for models beyond 100m params, but that's how much it takes to run the core algorithm. [1] https://github.com/karpathy/llama2.c
    comment by miki123211 · 2025-01-29 · in SmolGPT: A minimal PyTorch implementation for training a small LLM from scratch
  3. Links for llama2.c: https://github.com/karpathy/llama2.c https://news.ycombinator.com/item?id=36838051
    comment by evanjrowley · 2024-05-19 · in Llama3 implemented from scratch
  4. What's really cool, is that this was built on Karpathy's llama2.c repo https://github.com/karpathy/llama2.c A great example of the unexpected things that happen when put great code into the commons. I bet Andrej never expected anything…
    comment by kernelsanderz · 2024-05-10 · in Energy-Efficient Llama 2 Inference on FPGAs via High Level Synthesis
  5. …orders of magnitude when compared to a GPU cluster, but a lot better than naive, loopy Python. [1] https://github.com/karpathy/llama2.c [2] https://github.com/karpathy/micrograd
    comment by miki123211 · 2024-01-02 · in Stuff we figured out about AI in 2023
  6. …Speak Coherent English?" [3][4] [1]: https://huggingface.co/karpathy/tinyllamas/tree/main [2]: https://github.com/karpathy/llama2.c [3]: https://www.microsoft.com/en-us/research/publication/tinysto... [4]: https://arxiv.org/abs/2305.07759
    comment by ckcheng · 2024-01-01 · in Stuff we figured out about AI in 2023
  7. I didn't realise llama.c was from him too. https://github.com/karpathy/llama2.c
    comment by kristianp · 2023-11-23 · in Intro to Large Language Models [Video]
  8. …hardware, handwritten math is required for all the nonstandard formats, e.g. for quantized int-8 https://github.com/karpathy/llama2.c/blob/master/runq.c#L317 Integer quantization doesn't typically just round, it has scaling and other…
    comment by andy99 · 2023-10-18 · in Standardizing next-generation narrow precision data formats for AI
  9. Tiny Stories trained models and alternative implementation based on llama 2: https://github.com/karpathy/llama2.c
    comment by sheepscreek · 2023-10-08 · in Tiny Language Models Come of Age
  10. Related. I built karpathy’s llama2.c ( https://github.com/karpathy/llama2.c ) without modifications to WASM and run it in the browser. It was a fun exercise to directly compare native vs. Web perf. Getting 80% of native performance on my…
    comment by dmarcos · 2023-08-29 · in WebLLM: Llama2 in the Browser
  11. Would be cool for there to be a `llama2.f`, like https://github.com/karpathy/llama2.c , to demo its capabilities
    comment by csjh · 2023-08-28 · in Lfortran: Modern interactive LLVM-based Fortran compiler
  12. This is a fork of https://github.com/karpathy/llama2.c karpathy's llama2.c is like llama.cpp but it is written in C and the python training code is available in that same repo. llama2.c's goal is to be a elegant single file C…
    comment by AMICABoard · 2023-08-26 · in Llama2.c L2E LLM – Multi OS Binary and Unikernel Release
  13. …that comes in at non-zero temperature, otherwise its easy to see everything is deterministic: https://github.com/karpathy/llama2.c/blob/master/run.c Otoh, with MoE like GPT-4 has, it can still vary at zero temperature.
    comment by version_five · 2023-08-16 · in How Is LLaMa.cpp Possible?
  14. I really enjoyed Anrej Kaparthy's llama2.c project ( https://github.com/karpathy/llama2.c ), which runs through creating and running a miniature Llama2 architecture model from scratch.
    comment by jmorgan · 2023-08-12 · in Beginner's Guide to Llama Models
  15. …recent work at TinyStories: - https://arxiv.org/abs/2305.07759 It got some nice attention here: - https://github.com/karpathy/llama2.c I think there may be some applications in this limited space that are worth looking into. You won’t…
    comment by blackkettle · 2023-07-27 · in How to scale LLMs better with an alternative to transformers
  16. It does now: https://github.com/karpathy/llama2.c#metas-llama-2-models
    comment by NateGenX · 2023-07-27 · in A simple guide to fine-tuning Llama 2
  17. …It shouldn't be too hard to port to python. Found the repo, couldn't easily find the HN thread. https://github.com/karpathy/llama2.c
    comment by pests · 2023-07-25 · in A simple guide to fine-tuning Llama 2