Hacker GitHub

← All repos

arcee-ai/mergekit

View on GitHub ↗ ★ 7,441 Python

Tools for merging pretrained large language models.

6 mentions on Hacker News by 6 people: 1 story, 5 comments · first 2023-11-21 · latest 2024-10-25

Mentions per year 6 mentions · busiest year 2024 (5)
20082026
AllStoriesComments NewestTopOldest
  1. …can e.g. write algorithms directly and merge them into the model. https://github.com/yashbonde/rasp https://github.com/arcee-ai/mergekit
    comment by astrange · 2024-10-25 · in Detecting when LLMs are uncertain
  2. …What you think of weights are not binary blobs. That is a common missconception. [1] - https://github.com/arcee-ai/mergekit [2] - https://github.com/center-for-humans-and-machines/transforme...
    comment by NitpickLawyer · 2024-09-28 · in AMD Unveils Its First Small Language Model AMD-135M
  3. …like me who’d not heard of merging before, this seems to be one tool[0] (there may be others) [0] https://github.com/arcee-ai/mergekit
    comment by yumraj · 2024-04-06 · in Language models are Super Mario: Absorbing abilities from homologous models
  4. mergekit is the tool you need to do this https://github.com/cg123/mergekit you can slice off layers and blend models with different strategies.
    comment by denimboy · 2024-01-11 · in Blending Is All You Need: Cheaper, Better Alternative to Trillion-Parameters LLM
  5. Ah, actually reviewing that more closely I found a link to it in the acknowledgements. https://github.com/cg123/mergekit
    comment by ghotli · 2023-11-21 · in LLMs cannot find reasoning errors, but can correct them