MoonshotAI/K2-Vendor-Verifier
View on GitHub ↗ ★ 601 Python
Verify Precision of all Kimi K2 API Vendor
8 mentions on Hacker News by 8 people: 0 stories, 8 comments · first 2025-10-12 · latest 2026-06-17
20082026
-
Kimi K2 had a vendor verifier: https://github.com/MoonshotAI/K2-Vendor-Verifier (there's a table which shows comparison between vendors) Also, it seems there's a general one as well (for all kimi models?):…
comment by thehamkercat · 2026-06-17 · in GLM-5.2 is the new leading open weights model on Artificial Analysis -
…record I started doing this approach because the Kimi team released this which was shocking to me: https://github.com/MoonshotAI/K2-Vendor-Verifier
comment by jc4p · 2026-06-04 · in I built a vulnerable app and spent $1,500 seeing if LLMs could hack it -
> [Groq] rounded out the bottom of Kimi's verification program Ok, this is interesting: https://github.com/MoonshotAI/K2-Vendor-Verifier/ > Did you do any research yourself? How, systematically speaking? I would need a properly structured…
comment by mdp2021 · 2026-06-03 · in How is Groq raising more money? -
It's old, Kimi's been doing this for months now. https://github.com/MoonshotAI/K2-Vendor-Verifier https://github.com/MoonshotAI/Kimi-Vendor-Verifier Note, this is before K2.5 and K2.6 even launched.
comment by jychang · 2026-04-21 · in Kimi vendor verifier – verify accuracy of inference providers -
Very impressive, would love to see the results from the verifier for this fully local setup: https://github.com/MoonshotAI/K2-Vendor-Verifier
comment by Topfi · 2026-01-29 · in Kimi K2.5 on 2 Mac Studios (<$20K) running at 24 TPS -
…from moonshotai for K2 where they compare their official implementation to third party providers. https://github.com/MoonshotAI/K2-Vendor-Verifier It's one of the lowest rated on that table.
comment by msp26 · 2025-11-08 · in Cerebras Code now supports GLM 4.6 at 1000 tokens/sec -
This is most likely issue on the side of the inference provider: https://github.com/MoonshotAI/K2-Vendor-Verifier For example, Together AI has only 71% success rate, while the official API has 100% success rate.
comment by Palmik · 2025-11-07 · in Kimi K2 Thinking, a SOTA open-source trillion-parameter reasoning model -
Inference is impressively fast. But what about quality? In the Kimi vendor verifier ( https://github.com/MoonshotAI/K2-Vendor-Verifier/ ), Together has one of the highest tool call failure rates (>300 failures over the benchmark, compared…
comment by wishawa · 2025-10-12 · in AdapTive-LeArning Speculator System (ATLAS): Faster LLM inference