Hacker GitHub

← All repos

philpax/ggml

View on GitHub ↗ ★ 21 C

Tensor library for machine learning

3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2023-08-24 · latest 2023-09-17

Mentions per year 3 mentions · busiest year 2023 (3)
20082026
AllStoriesComments NewestTopOldest
  1. https://github.com/philpax/ggml/blob/gguf-spec/docs/gguf.md#... It is (IMO) a necessary and good change. I just specified gguf because my 3090 cannot host a 70B model without offloading outside of exLlama's very new ~2 bit quantization.…
    comment by brucethemoose2 · 2023-09-17 · in Run LLMs at home, BitTorrent‑style
  2. ▲ 3
    GGUF File Format Specification
    story by w-m · 2023-08-24 · 1 comment
  3. While we're at it, the GGML file format has been deprecated in favor of GGUF. https://github.com/philpax/ggml/blob/gguf-spec/docs/gguf.md https://github.com/ggerganov/llama.cpp/pull/2398
    comment by int_19h · 2023-08-24 · in Code Llama, a state-of-the-art large language model for coding