Hacker GitHub

← All repos

meta-llama/llama

View on GitHub ↗ ★ 59,634 Python

Inference code for Llama models

93 mentions on Hacker News by 78 people: 6 stories, 87 comments · first 2023-02-24 · latest 2025-06-17

Mentions per year 93 mentions · busiest year 2023 (79)
20082026
AllStoriesComments NewestTopOldest
  1. Comparing the 13B model here https://huggingface.co/cerebras/Cerebras-GPT-13B to LLaMA-13B https://github.com/facebookresearch/llama/blob/main/MODEL_CA... you can see that in all of the reasoning tasks Cerebras-GPT lags behind. Any reason…
    comment by amilios · 2023-03-28 · in Cerebras-GPT: A Family of Open, Compute-Efficient, Large Language Models
  2. …agreeing to the license by visiting facebook's repository and getting the magnet link yourself: https://github.com/facebookresearch/llama/pull/73/files
    comment by Zuiii · 2023-03-28 · in CodeAlpaca – Instruction following code generation model
  3. lol what are you talking about? The weights are being linked to on Meta's repo right now: https://github.com/facebookresearch/llama/pull/73/files The idea that Meta is frantically running around trying to "wipe" these weights is…
    comment by Zuiii · 2023-03-28 · in Cloudflare disables access to ‘pirated’ content on its IPFS gateway
  4. …and only based on the LLamA (not a derivative work afaik). That said : Also Meta's licensing here https://github.com/facebookresearch/llama/blob/main/LICENSE Can't be sure what that license actually reffers to, the language model or just…
    comment by bilekas · 2023-03-24 · in Hello Dolly: Democratizing the magic of ChatGPT with open models
  5. As well as the super-upvoted PR to change the model license to Apache 2.0: https://github.com/facebookresearch/llama/pull/184
    comment by practice9 · 2023-03-24 · in Facebook is going after LLaMA repos with DMCA's
  6. Meanwhile, the pull request on the official repo linking to a torrent of the weights is still up. https://github.com/facebookresearch/llama/pull/73/files
    comment by greyface- · 2023-03-24 · in Facebook is going after LLaMA repos with DMCA's
  7. …their results running on all sorts of hardware, though I don't see anything Android related: https://github.com/facebookresearch/llama/issues/79 Obviously the larger models won't run on such limited hardware (yet) but one of the next big…
    comment by glenneroo · 2023-03-15 · in GPT-4
  8. Check this out: https://github.com/facebookresearch/llama/issues/169 Also I'm working on a very hacky way to tune with the hf ecosystem as my very first attempt to do deepspeed/accelerate/transformers https://github.com/lxe/llama-tune
    comment by lxe · 2023-03-14 · in Alpaca: A strong open-source instruction-following model
  9. …2nd March: Someone posts a PR with a BitTorrent link to the models: https://github.com/facebookresearch/llama/pull/73 10th March: First commit to llama.cpp by Georgi Gerganov: https://github.com/ggerganov/llama.cpp/commit/26c0
    comment by simonw · 2023-03-13 · in Alpaca: A strong open-source instruction-following model
  10. It is, if you request and get approved. https://github.com/facebookresearch/llama
    comment by lgas · 2023-03-13 · in Dalai: Automatically install, run, and play with LLaMA on your computer
  11. …CPU only one implemented in C++. The python + GPU one can be found on the official facebook repo: https://github.com/facebookresearch/llama (Presumably GP thought this was already known to everyone so they pasted the other link)
    comment by hnfong · 2023-03-12 · in Large language models are having their Stable Diffusion moment
  12. There's a BitTorrent link in this PR: https://github.com/facebookresearch/llama/pull/73
    comment by simonw · 2023-03-12 · in Large language models are having their Stable Diffusion moment
  13. …lean on much older prompt engineering tricks - there are a few initial tips in the LLaMA FAQ here: https://github.com/facebookresearch/llama/blob/main/FAQ.md#2...
    comment by simonw · 2023-03-12 · in Using LLaMA with M1 Mac and Python 3.11
  14. There are a few initial tips here in the LLaMAA FAQ: https://github.com/facebookresearch/llama/blob/main/FAQ.md#2...
    comment by simonw · 2023-03-12 · in Large language models are having their Stable Diffusion moment
  15. https://github.com/facebookresearch/llama/pull/73/files
    comment by dTal · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  16. …combination: https://github.com/gmorenz/llama/tree/ssd Usage instructions in the commit message: https://github.com/facebookresearch/llama/commit/5be06e56056... At least with my hardware this runs at "[size of model]/[speed of SSD reads]"…
    comment by gpm · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  17. …the reference code by Facebook is one of the cleaner, easier to read ML code I've seen in a while. https://github.com/facebookresearch/llama/blob/main/llama/mo... It's about 200 lines long. You probably do need a bit of knowledge to…
    comment by adeon · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  18. Follow up: https://github.com/facebookresearch/llama/issues/79#issuecom... claims 65B was able to fit in 128 GB by unsharding & merging weights into a single file instead of the multiple pth with 172Gb max swap file usage & appears to…
    comment by downvotetruth · 2023-03-08 · in Fork of Facebook’s LLaMa model to run on CPU
  19. Reading the patch: https://github.com/facebookresearch/llama/compare/main...mar... Looks like this is just tweaking some defaults and commenting out some code that enables cuda. It also switches to something called gloo, which I'm not…
    comment by progman32 · 2023-03-08 · in Fork of Facebook’s LLaMa model to run on CPU
  20. …mentions this and gives tips for how to get out of the ChatGPT mindset and prompt llama better. [1] https://github.com/facebookresearch/llama/blob/main/FAQ.md#2
    comment by v64 · 2023-03-05 · in Show HN: Llama-dl – high-speed download of LLaMA, Facebook's 65B GPT model
  21. The code (including the model) is here: https://github.com/facebookresearch/llama I already got the 7B model to generate text using my GPU! The 1st example prompt generated this: [I believe the meaning of life is] to be happy, and it is…
    comment by WithinReason · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  22. Looks like you need multiple GPUs for anything >7B. https://github.com/facebookresearch/llama/issues/55#issuecom...
    comment by byteknight · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  23. …2nd, or is it really running on all 4 A40s? it's sharded across all 4 GPUs (as per the readme here: https://github.com/facebookresearch/llama ). I'd wait a few weeks to a month for people to settle on a solution for running the model,…
    comment by turmeric_root · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  24. …but the 7B parameter checkpoint is 13.5GB in size. Someone with 24GB VRAM struggled to run it: https://github.com/facebookresearch/llama/issues/55
    comment by TaylorAlexander · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  25. …overhead. Here someone struggles to fit the 7B parameter model (13.5GB checkpoint) on a 24GB card: https://github.com/facebookresearch/llama/issues/55 EDIT2: actually using the tip in that link I got it to run on a P5000 with 16GB of ram!…
    comment by TaylorAlexander · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  26. …overhead. Here someone struggles to fit the 7B parameter model (13.5GB checkpoint) on a 24GB card: https://github.com/facebookresearch/llama/issues/55 EDIT2: actually using the tip in that link I got it to run on a P5000 with 16GB of ram!…
    comment by TaylorAlexander · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  27. https://github.com/facebookresearch/llama/blob/main/FAQ.md#3 Looks like it needs 14gb for weights and it isn't clear what the minimum size for the decoding cache is, but it defaults to settings for 30gb GPUs.
    comment by eightysixfour · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  28. BitTorrent links: https://github.com/facebookresearch/llama/pull/73/files
    comment by lsb · 2023-03-03 · in Meta rolls out AI language model LLaMA
  29. clone this and point the script(s) to your downloaded model files: https://github.com/facebookresearch/llama/
    comment by turmeric_root · 2023-03-03 · in Facebook LLAMA is being openly distributed via torrents
  30. …when I can get hands on The architecture is available just fine, both in the paper[1] and in code: https://github.com/facebookresearch/llama/blob/main/llama/mo... It's the model weights that you can't get as easily. [1]…
    comment by nl · 2023-02-27 · in Open source implementation for LLaMA-based ChatGPT
  31. Again, I have to point you to the repo code. Here’s the licence: https://github.com/facebookresearch/llama/blob/main/LICENSE The model code is literally open source. Provided and licensed.
    comment by p1esk · 2023-02-25 · in Meta rolls out AI language model LLaMA
  32. Did you even look at the repo before commenting? The model code is literally open source: https://github.com/facebookresearch/llama/blob/main/llama/mo... Even the checkpoints are provided - for free! All you have to do is ask. Someone at…
    comment by p1esk · 2023-02-25 · in Meta rolls out AI language model LLaMA
  33. Because it is open source: https://github.com/facebookresearch/llama
    comment by p1esk · 2023-02-24 · in Meta rolls out AI language model LLaMA
  34. …can thus generate toxic or offensive content, incorrect information or generally unhelpful answers. https://github.com/facebookresearch/llama/blob/main/MODEL_CA...
    comment by stevenhuang · 2023-02-24 · in LLaMA: A foundational, 65B-parameter large language model
  35. https://github.com/facebookresearch/llama/blob/main/MODEL_CA... (linked in OP) has basic information about this model.
    comment by zozbot234 · 2023-02-24 · in LLaMA: A foundational, 65B-parameter large language model
  36. Full paper [1[ Github [2] [1] https://research.facebook.com/file/1574548786327032/LLaMA--O... [2] https://github.com/facebookresearch/llama
    comment by gardenfelder · 2023-02-24 · in Meta/FB Releases LLaMA: Open and Efficient Foundation Models
  37. …to the application in our research paper. The closest you are going to get to the source is here: https://github.com/facebookresearch/llama It is still unclear if you are even going to get access to the entire model as open source. Even if…
    comment by rvz · 2023-02-24 · in LLaMA: A foundational, 65B-parameter large language model