Hacker GitHub

← All repos

lyogavin/Anima

View on GitHub ↗ ★ 38

Moved to here: https://github.com/lyogavin/airllm

4 mentions on Hacker News by 4 people: 2 stories, 2 comments · first 2023-12-28 · latest 2024-06-21

Mentions per year 4 mentions · busiest year 2023 (3)
20082026
AllStoriesComments NewestTopOldest
  1. …like chatting, more suitable for data processing and other offline asynchronous scenarios. Repo: https://github.com/lyogavin/Anima/tree/main/air_llm
    comment by Rzor · 2024-06-21 · in Run the strongest open-source LLM model: Llama3 70B with just a single 4GB GPU
  2. This just in for the 8GB (4GB?) crowd... https://github.com/lyogavin/Anima/tree/main/air_llm ..seems to be enabled by Apple's new MLX framework (which could become even faster https://github.com/ml-explore/mlx/issues/18 --ANE support would…
    comment by vaxman · 2023-12-31 · in Tracking developer build times to decide if the M3 MacBook is worth upgrading