Hacker GitHub

← All repos

meta-llama/llama

View on GitHub ↗ ★ 59,634 Python

Inference code for Llama models

93 mentions on Hacker News by 78 people: 6 stories, 87 comments · first 2023-02-24 · latest 2025-06-17

Mentions per year 93 mentions · busiest year 2023 (79)
20082026
AllStoriesComments NewestTopOldest
  1. …://en.wikipedia.org/wiki/Llama_(language_model)#Leak https://archived.moe/g/thread/91848262#p91850335 https://github.com/meta-llama/llama/pull/73/files
    comment by aspenmayer · 2025-06-17 · in Meta's Llama 3.1 can recall 42 percent of the first Harry Potter book
  2. …monthly active users in the preceding calendar month, you must request a license from Meta... ref: https://github.com/meta-llama/llama/blob/main/LICENSE But again, not open source...
    comment by nathabonfim59 · 2025-04-21 · in Getting forked by Microsoft
  3. …to the model. Even models have licenses for example LLAMA is release under this license [1] [1] https://github.com/meta-llama/llama/blob/main/LICENSE
    comment by zitterbewegung · 2025-01-05 · in Extracting AI models from mobile apps
  4. …a team of 6!). I had the initial idea to build LM Studio after seeing the OG LLaMa weights ‘leak’ ( https://github.com/meta-llama/llama/pull/73/files ) and then later trying to run some TheBloke quants during the heady early days of…
    comment by yags · 2024-08-24 · in LM Studio 0.3 – Discover, download, and run local LLMs
  5. …to improve any other large language model (excluding Llama 2 or derivative works thereof).” https://github.com/meta-llama/llama/blob/b8348da38fde8644ef0... Also even if you did use Llama for something, they could unilaterally pull the rug…
    comment by bionhoward · 2024-04-19 · in Mark Zuckerberg: Llama 3, $10B Models, Caesar Augustus, Bioweapons [video]
  6. …as they change their AUP, you may be further restricted in the future. Meta’s Llama is similar ( https://github.com/meta-llama/llama/blob/main/LICENSE ). I’m not sure who can depend on these models given this flaw.
    comment by blackeyeblitzar · 2024-04-09 · in Hello OLMo: A truly open LLM
  7. …identically with their hardware setup, it'd cost a little bit less than twice their MoE model. [1] https://github.com/meta-llama/llama/blob/main/MODEL_CARD.md#... [2] https://blog.ori.co/choosing-between-nvidia-h100-vs-a100-per...
    comment by antimatter15 · 2024-04-04 · in JetMoE: Reaching LLaMA2 performance with 0.1M dollars
  8. …of magnitude, and it's likely that Facebook wasn't paying the full price AWS is charging today. [0] https://github.com/meta-llama/llama/blob/main/MODEL_CARD.md#... [1] https://aws.amazon.com/ec2/instance-types/p4/
    comment by lolinder · 2024-04-04 · in JetMoE: Reaching LLaMA2 performance with 0.1M dollars
  9. …[2] and doesn't grant you the permission to copy it or make changes like s/meta/dbrx/g lol. [1] https://github.com/meta-llama/llama/blob/main/LICENSE#L65 [2] https://opensource.stackexchange.com/q/4543
    comment by adtac · 2024-03-27 · in DBRX: A new open LLM
  10. …doing more, there is some research that represents circumstantial evidence they are doing more. [1] https://github.com/meta-llama/llama/blob/54c22c0d63a3f3c9e77...
    comment by benreesman · 2024-03-22 · in How Chain-of-Thought Reasoning Helps Neural Networks Compute
  11. ▲ 6
    Asking Meta to stop using the term "open source" for Llama
    story by patrick-fitz · 2024-02-28 · 0 comments
  12. …of very cool engineering that’s a real feat, but at its core it’s argmax(P(token|token,corpus)): https://github.com/facebookresearch/llama/blob/main/llama/ge... The engineering feats are up there with anything, but it’s a next token…
    comment by benreesman · 2024-02-01 · in Markov Chains are the Original Language Models
  13. …I just ran it out of the box but I had to modify the source code to run for Mac. Instructions here: https://github.com/facebookresearch/llama/pull/947/
    comment by kungfupawnda · 2024-01-29 · in Meta AI releases Code Llama 70B
  14. …to train a basic version! actually its not just a basic version. Llama 1/2's model.py is 500 lines: https://github.com/facebookresearch/llama/blob/main/llama/mo... Mistral (is rumored to have) forked llama and is 369 lines:…
    comment by swyx · 2024-01-01 · in Stuff we figured out about AI in 2023
  15. ▲ 3
    Ask HN: Why the LLaMA code base is so short
    story by kureikain · 2023-11-22 · 2 comments
  16. Is it possible to execute a light weight language model, perhaps this https://github.com/facebookresearch/llama using ExecuTorch to run on smartphone in real time for a chatbot app ? Please share some guidance.
    comment by suyash · 2023-10-18 · in ExecuTorch: Run PyTorch programs on mobile and edge devices
  17. …is clear from its wording, and also matches the interpretation of our flock of lawyers. [1] https://github.com/facebookresearch/llama/issues/266 [2] https://levelup.gitconnected.com/metas-chatgpt-is-now-illega...
    comment by nomel · 2023-09-22 · in Outperforming larger language models with less training data and smaller models
  18. …expressly grants you such rights. https://github.com/facebookresearch/codellama/blob/main/LICE... https://github.com/facebookresearch/llama/blob/main/LICENSE
    comment by iFire · 2023-08-28 · in Meta just released its answer to GitHub Copilot, and it’s free
  19. …( https://www.youtube.com/playlist?list=PLAqhIrjkxbuWI23v9cThs... ) meta llama 2 - is open source https://github.com/facebookresearch/llama/tree/main Tools: ai - hosting Banana - Machine Learning Model Deployment on Serverless GPUs…
    comment by GoldenMonkey · 2023-08-25 · in Ask HN: In 2023 which is the best path to get good at machine and deep learning?
  20. …don't have as high a CO2 output, but even so it seems like it's the same order of magnitude. 1: https://github.com/facebookresearch/llama/blob/main/MODEL_CA...
    comment by garblegarble · 2023-08-25 · in AI isn’t good enough
  21. > How is that defined, is it part of the non-existing license? What do you mean? https://github.com/facebookresearch/llama/blob/main/LICENSE
    comment by yreg · 2023-08-24 · in Open source LLM with 32k Context Length
  22. …to write you no poem, if you follow me. Your AI, it just might. But it ain’t no way human.” [2] [0] https://github.com/facebookresearch/llama/blob/main/llama/ge... [1] https://github.com/facebookresearch/llama/blob/main/llama/to... [2]…
    comment by benreesman · 2023-08-09 · in GPT-4 can't reason
  23. …(Eq 6.) In official llama implementation : the constant beta has been removed https://github.com/facebookresearch/llama/blob/main/llama/mo... In the blog log we observe various lines " feedforward.1.beta', 0.0 " which mean that during t
    comment by GistNoesis · 2023-08-09 · in Llama from scratch, or how to implement a paper without crying
  24. …restrictive than the morality clause bearing OpenRAIL license that Stability likes to use[2]. [0] https://github.com/facebookresearch/llama/blob/main/MODEL_CA... [1] https://github.com/facebookresearch/audiocraft/blob/main/LIC... [2] These…
    comment by kmeisthax · 2023-08-02 · in Open-sourcing AudioCraft: Generative AI for audio
  25. I have a question: Last week I downloaded llama-7b-chat from meta's github directly ( https://github.com/facebookresearch/llama ) using the URL they sent via e-mail. As a result, I now have the model as consolidated.00.pth. Your commands…
    comment by bed147373429 · 2023-07-26 · in Guide to running Llama 2 locally
  26. …in specific tags (<<SYS>>{system prompt}<</SYS>> and [INST]{user prompt}[/INST]) respectively): https://github.com/facebookresearch/llama/blob/main/llama/ge... . Worth noting that customizing prompt templates can be fun – you don't have to…
    comment by jmorgan · 2023-07-26 · in Guide to running Llama 2 locally
  27. …without a license, you may be open to subsequent legal action in uncharted case-law territory. 1. https://github.com/facebookresearch/llama/blob/main/CODE_OF_...
    comment by sangnoir · 2023-07-24 · in LeCun: Qualcomm working with Meta to run Llama-2 on mobile devices
  28. …Llama 2 license allows users to train derivative models, which is what people really care about. https://github.com/facebookresearch/llama/blob/main/LICENSE
    comment by concinds · 2023-07-21 · in In the LLM space, "open source" is being used to mean "downloadable weights"
  29. …on the quantized versions of Llama 2 appears to be incorrect relative to the official Meta one ( https://github.com/facebookresearch/llama/blob/main/llama/ge... ). I took Meta's generation.py and modified the code to output the raw prompt…
    comment by tikkun · 2023-07-19 · in Llama 2 Prompt Template
  30. …monthly active users in the preceding calendar month, you must request a license from Meta [0] https://github.com/facebookresearch/llama/blob/main/LICENSE
    comment by pedrosorio · 2023-07-19 · in How is ChatGPT's behavior changing over time?
  31. Checkout: https://github.com/facebookresearch/llama/blob/4d92db8a1db6c...
    comment by sunshadow · 2023-07-19 · in Llama 2
  32. it's not really open source https://github.com/facebookresearch/llama/blob/main/LICENSE
    comment by charbull · 2023-07-19 · in Llama 2
  33. https://github.com/facebookresearch/llama/blob/main/LICENSE#...
    comment by bouteille · 2023-07-18 · in Llama 2
  34. …(use the same email): https://huggingface.co/meta-llama/Llama-2-70b-chat-hf Direct link to repo: https://github.com/facebookresearch/llama Once you get a link to download on email make sure to copy it without spaces, an option is to open…
    comment by ingenieroariel · 2023-07-18 · in Llama 2
  35. Probaly Llama, it was too hard to get right before :) https://github.com/facebookresearch/llama/commit/6d4c0c290ae...
    comment by imjonse · 2023-07-18 · in Llama 2
  36. …to improve any other large language model (excluding Llama 2 or derivative works thereof). https://github.com/facebookresearch/llama/blob/main/LICENSE Just like Google scrapes the internet to improve their models, it might make sense to…
    comment by lacker · 2023-07-18 · in Llama 2
  37. The llama source code in the original repo has been updated for llama 2: https://github.com/facebookresearch/llama
    comment by ezyang · 2023-07-18 · in Llama 2
  38. …were uploaded to HuggingFace, this PR was the primary source for most people downloading the model. https://github.com/facebookresearch/llama/pull/73/files Two months later, Facebook hasn't merged the change, but they also haven't deleted…
    comment by int_19h · 2023-05-04 · in Google “We have no moat, and neither does OpenAI”
  39. …if they can open source their model, it would transform their reputation at least among techies. https://github.com/facebookresearch/llama/pull/184
    comment by hospitalJail · 2023-05-04 · in Google “We have no moat, and neither does OpenAI”
  40. …this is done transparently using RowParallelLinear, ColumnParallelLinear, ParallelEmbedding see https://github.com/facebookresearch/llama/blob/main/llama/mo... Transformer have multiple attention heads, that can be computed independently…
    comment by GistNoesis · 2023-05-03 · in OpenLLaMA: An Open Reproduction of LLaMA
  41. I think local models SOTA is llama which has 2048 context[1]. [1] https://github.com/facebookresearch/llama/issues/16
    comment by newswasboring · 2023-04-27 · in DeepDoctection: Document extraction and analysis using deep learning models
  42. ▲ 3
    Suddenly 403 Forbidden (LLaMA)
    story by grae_QED · 2023-04-22 · 0 comments
  43. …weights for LLAMA which is currently the only officially supported way of getting those weights ( https://github.com/facebookresearch/llama/tree/main#llama ) ?
    comment by jupp0r · 2023-04-17 · in RedPajama: Reproduction of LLaMA with friendly license
  44. What do you mean, it's not clear? https://github.com/facebookresearch/llama links to https://forms.gle/jk851eBVbX1m5TAv5 which contains LLaMA license agreement below the form.
    comment by Tepix · 2023-04-16 · in Web LLM – WebGPU Powered Inference of Large Language Models
  45. …standardize on that. It'd be nice to have a larger context window (Flash Attention?) as well. [1] https://github.com/facebookresearch/llama/blob/main/MODEL_CA... [2] https://github.com/ZrrSkywalker/LLaMA-Adapter
    comment by lhl · 2023-04-10 · in The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
  46. …is Apache 2.0 licensed so it can be copied and modified freely, including for commercial purpoes. https://github.com/facebookresearch/llama
    comment by MacsHeadroom · 2023-04-10 · in The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
  47. …like catching up on the last few years of LLM advancements: https://sharegpt.com/c/JFexqvm [1] https://github.com/facebookresearch/llama/blob/main/MODEL_CA... [2] https://github.com/ggerganov/llama.cpp/discussions/406 [3]…
    comment by lhl · 2023-04-10 · in The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
  48. They have tacitly endorsed the leak. https://github.com/facebookresearch/llama/pull/73#issuecomme...
    comment by greyface- · 2023-04-09 · in The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
  49. https://github.com/facebookresearch/llama/pull/184
    comment by zhisbug · 2023-04-03 · in State-of-the-art open-source chatbot, Vicuna-13B, just released model weights
  50. lesmo provides a magnet uri to all models here. it's inside (499kb): https://github.com/facebookresearch/llama/pull/73/files/016a...
    comment by Rzor · 2023-04-01 · in Llama.cpp 30B runs with only 6GB of RAM now