Hacker GitHub

← All repos

meta-llama/llama

View on GitHub ↗ ★ 59,634 Python

Inference code for Llama models

93 mentions on Hacker News by 78 people: 6 stories, 87 comments · first 2023-02-24 · latest 2025-06-17

Mentions per year 93 mentions · busiest year 2023 (79)
20082026
AllStoriesComments NewestTopOldest
  1. …things. Interestingly, the code FB provided doesn't seem to have any special handling for digits: https://github.com/facebookresearch/llama/blob/main/llama/to...
    comment by nl · 2023-03-29 · in Cerebras-GPT vs. LLaMA AI Model Performance Comparison
  2. The reference inference code is GPL. https://github.com/facebookresearch/llama/blob/main/LICENSE
    comment by charcircuit · 2023-03-29 · in Show HN: A fully open-source (Apache 2.0)implementation of llama
  3. > Apache 2 Isn't the original GPLv3[0]? [0]: https://github.com/facebookresearch/llama/blob/main/LICENSE
    comment by kristjansson · 2023-03-28 · in Show HN: A fully open-source (Apache 2.0)implementation of llama
  4. Comparing the 13B model here https://huggingface.co/cerebras/Cerebras-GPT-13B to LLaMA-13B https://github.com/facebookresearch/llama/blob/main/MODEL_CA... you can see that in all of the reasoning tasks Cerebras-GPT lags behind. Any reason…
    comment by amilios · 2023-03-28 · in Cerebras-GPT: A Family of Open, Compute-Efficient, Large Language Models
  5. …agreeing to the license by visiting facebook's repository and getting the magnet link yourself: https://github.com/facebookresearch/llama/pull/73/files
    comment by Zuiii · 2023-03-28 · in CodeAlpaca – Instruction following code generation model
  6. lol what are you talking about? The weights are being linked to on Meta's repo right now: https://github.com/facebookresearch/llama/pull/73/files The idea that Meta is frantically running around trying to "wipe" these weights is…
    comment by Zuiii · 2023-03-28 · in Cloudflare disables access to ‘pirated’ content on its IPFS gateway
  7. …and only based on the LLamA (not a derivative work afaik). That said : Also Meta's licensing here https://github.com/facebookresearch/llama/blob/main/LICENSE Can't be sure what that license actually reffers to, the language model or just…
    comment by bilekas · 2023-03-24 · in Hello Dolly: Democratizing the magic of ChatGPT with open models
  8. As well as the super-upvoted PR to change the model license to Apache 2.0: https://github.com/facebookresearch/llama/pull/184
    comment by practice9 · 2023-03-24 · in Facebook is going after LLaMA repos with DMCA's
  9. Meanwhile, the pull request on the official repo linking to a torrent of the weights is still up. https://github.com/facebookresearch/llama/pull/73/files
    comment by greyface- · 2023-03-24 · in Facebook is going after LLaMA repos with DMCA's
  10. …their results running on all sorts of hardware, though I don't see anything Android related: https://github.com/facebookresearch/llama/issues/79 Obviously the larger models won't run on such limited hardware (yet) but one of the next big…
    comment by glenneroo · 2023-03-15 · in GPT-4
  11. Check this out: https://github.com/facebookresearch/llama/issues/169 Also I'm working on a very hacky way to tune with the hf ecosystem as my very first attempt to do deepspeed/accelerate/transformers https://github.com/lxe/llama-tune
    comment by lxe · 2023-03-14 · in Alpaca: A strong open-source instruction-following model
  12. …2nd March: Someone posts a PR with a BitTorrent link to the models: https://github.com/facebookresearch/llama/pull/73 10th March: First commit to llama.cpp by Georgi Gerganov: https://github.com/ggerganov/llama.cpp/commit/26c0
    comment by simonw · 2023-03-13 · in Alpaca: A strong open-source instruction-following model
  13. ▲ 4
    LLaMA models licence change to Apache 2.0 approved
    story by matjet · 2023-03-13 · 1 comment
  14. It is, if you request and get approved. https://github.com/facebookresearch/llama
    comment by lgas · 2023-03-13 · in Dalai: Automatically install, run, and play with LLaMA on your computer
  15. ▲ 32
    PR to Change the LLaMA Models' Licence to Apache 2.0
    story by hzj5790 · 2023-03-12 · 6 comments
  16. …CPU only one implemented in C++. The python + GPU one can be found on the official facebook repo: https://github.com/facebookresearch/llama (Presumably GP thought this was already known to everyone so they pasted the other link)
    comment by hnfong · 2023-03-12 · in Large language models are having their Stable Diffusion moment
  17. There's a BitTorrent link in this PR: https://github.com/facebookresearch/llama/pull/73
    comment by simonw · 2023-03-12 · in Large language models are having their Stable Diffusion moment
  18. …lean on much older prompt engineering tricks - there are a few initial tips in the LLaMA FAQ here: https://github.com/facebookresearch/llama/blob/main/FAQ.md#2...
    comment by simonw · 2023-03-12 · in Using LLaMA with M1 Mac and Python 3.11
  19. There are a few initial tips here in the LLaMAA FAQ: https://github.com/facebookresearch/llama/blob/main/FAQ.md#2...
    comment by simonw · 2023-03-12 · in Large language models are having their Stable Diffusion moment
  20. https://github.com/facebookresearch/llama/pull/73/files
    comment by dTal · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  21. …combination: https://github.com/gmorenz/llama/tree/ssd Usage instructions in the commit message: https://github.com/facebookresearch/llama/commit/5be06e56056... At least with my hardware this runs at "[size of model]/[speed of SSD reads]"…
    comment by gpm · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  22. …the reference code by Facebook is one of the cleaner, easier to read ML code I've seen in a while. https://github.com/facebookresearch/llama/blob/main/llama/mo... It's about 200 lines long. You probably do need a bit of knowledge to…
    comment by adeon · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  23. Follow up: https://github.com/facebookresearch/llama/issues/79#issuecom... claims 65B was able to fit in 128 GB by unsharding & merging weights into a single file instead of the multiple pth with 172Gb max swap file usage & appears to…
    comment by downvotetruth · 2023-03-08 · in Fork of Facebook’s LLaMa model to run on CPU
  24. Reading the patch: https://github.com/facebookresearch/llama/compare/main...mar... Looks like this is just tweaking some defaults and commenting out some code that enables cuda. It also switches to something called gloo, which I'm not…
    comment by progman32 · 2023-03-08 · in Fork of Facebook’s LLaMa model to run on CPU
  25. …mentions this and gives tips for how to get out of the ChatGPT mindset and prompt llama better. [1] https://github.com/facebookresearch/llama/blob/main/FAQ.md#2
    comment by v64 · 2023-03-05 · in Show HN: Llama-dl – high-speed download of LLaMA, Facebook's 65B GPT model
  26. The code (including the model) is here: https://github.com/facebookresearch/llama I already got the 7B model to generate text using my GPU! The 1st example prompt generated this: [I believe the meaning of life is] to be happy, and it is…
    comment by WithinReason · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  27. Looks like you need multiple GPUs for anything >7B. https://github.com/facebookresearch/llama/issues/55#issuecom...
    comment by byteknight · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  28. …2nd, or is it really running on all 4 A40s? it's sharded across all 4 GPUs (as per the readme here: https://github.com/facebookresearch/llama ). I'd wait a few weeks to a month for people to settle on a solution for running the model,…
    comment by turmeric_root · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  29. …but the 7B parameter checkpoint is 13.5GB in size. Someone with 24GB VRAM struggled to run it: https://github.com/facebookresearch/llama/issues/55
    comment by TaylorAlexander · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  30. …overhead. Here someone struggles to fit the 7B parameter model (13.5GB checkpoint) on a 24GB card: https://github.com/facebookresearch/llama/issues/55 EDIT2: actually using the tip in that link I got it to run on a P5000 with 16GB of ram!…
    comment by TaylorAlexander · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  31. …overhead. Here someone struggles to fit the 7B parameter model (13.5GB checkpoint) on a 24GB card: https://github.com/facebookresearch/llama/issues/55 EDIT2: actually using the tip in that link I got it to run on a P5000 with 16GB of ram!…
    comment by TaylorAlexander · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  32. https://github.com/facebookresearch/llama/blob/main/FAQ.md#3 Looks like it needs 14gb for weights and it isn't clear what the minimum size for the decoding cache is, but it defaults to settings for 30gb GPUs.
    comment by eightysixfour · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  33. BitTorrent links: https://github.com/facebookresearch/llama/pull/73/files
    comment by lsb · 2023-03-03 · in Meta rolls out AI language model LLaMA
  34. clone this and point the script(s) to your downloaded model files: https://github.com/facebookresearch/llama/
    comment by turmeric_root · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  35. ▲ 909
    Facebook LLAMA is being openly distributed via torrents
    story by micro_charm · 2023-03-03 · 693 comments
  36. …when I can get hands on The architecture is available just fine, both in the paper[1] and in code: https://github.com/facebookresearch/llama/blob/main/llama/mo... It's the model weights that you can't get as easily. [1]…
    comment by nl · 2023-02-27 · in Open source implementation for LLaMA-based ChatGPT
  37. Again, I have to point you to the repo code. Here’s the licence: https://github.com/facebookresearch/llama/blob/main/LICENSE The model code is literally open source. Provided and licensed.
    comment by p1esk · 2023-02-25 · in Meta rolls out AI language model LLaMA
  38. Did you even look at the repo before commenting? The model code is literally open source: https://github.com/facebookresearch/llama/blob/main/llama/mo... Even the checkpoints are provided - for free! All you have to do is ask. Someone at…
    comment by p1esk · 2023-02-25 · in Meta rolls out AI language model LLaMA
  39. Because it is open source: https://github.com/facebookresearch/llama
    comment by p1esk · 2023-02-24 · in Meta rolls out AI language model LLaMA
  40. …can thus generate toxic or offensive content, incorrect information or generally unhelpful answers. https://github.com/facebookresearch/llama/blob/main/MODEL_CA...
    comment by stevenhuang · 2023-02-24 · in LLaMA: A foundational, 65B-parameter large language model
  41. https://github.com/facebookresearch/llama/blob/main/MODEL_CA... (linked in OP) has basic information about this model.
    comment by zozbot234 · 2023-02-24 · in LLaMA: A foundational, 65B-parameter large language model
  42. Full paper [1[ Github [2] [1] https://research.facebook.com/file/1574548786327032/LLaMA--O... [2] https://github.com/facebookresearch/llama
    comment by gardenfelder · 2023-02-24 · in Meta/FB Releases LLaMA: Open and Efficient Foundation Models
  43. …to the application in our research paper. The closest you are going to get to the source is here: https://github.com/facebookresearch/llama It is still unclear if you are even going to get access to the entire model as open source. Even if…
    comment by rvz · 2023-02-24 · in LLaMA: A foundational, 65B-parameter large language model