Hacker GitHub

← All repos

remixer-dec/llama-mps

View on GitHub ↗ ★ 84 Python

Experimental fork of Facebooks LLaMa model which runs it with GPU acceleration on Apple Silicon M1/M2

6 mentions on Hacker News by 4 people: 0 stories, 6 comments · first 2023-03-08 · latest 2023-04-12

Mentions per year 6 mentions · busiest year 2023 (6)
20082026
AllStoriesComments NewestTopOldest
  1. …won't match not having to page. Edit - I found an example from h.n. user anentropic, pointing at https://github.com/remixer-dec/llama-mps . "The goal of this fork is to use GPU acceleration on Apple M1/M2 devices.... After the model is…
    comment by rnk · 2023-04-12 · in Anthropic’s $5B, 4-year plan to take on OpenAI
  2. Check out the LLaMA memory requirements on Apple Silicon GPU here: https://github.com/remixer-dec/llama-mps
    comment by anentropic · 2023-04-12 · in Anthropic’s $5B, 4-year plan to take on OpenAI
  3. …with enough RAM, Apple unified memory ought to solve that Some people have it working apparently: https://github.com/remixer-dec/llama-mps
    comment by anentropic · 2023-04-12 · in Anthropic’s $5B, 4-year plan to take on OpenAI
  4. There is also a gpu-acelerated fork of the original repo https://github.com/remixer-dec/llama-mps
    comment by BoberMod · 2023-03-10 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  5. dedicated fork: https://github.com/remixer-dec/llama-mps
    comment by singularity2001 · 2023-03-08 · in Fork of Facebook’s LLaMa model to run on CPU
  6. dedicated fork: https://github.com/remixer-dec/llama-mps
    comment by singularity2001 · 2023-03-08 · in Fork of Facebook’s LLaMa model to run on CPU