raullenchai/Rapid-MLX

View on GitHub ↗ ★ 4,123 Python

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.

5 mentions on Hacker News by 2 people: 1 story, 4 comments · first 2026-04-18 · latest 2026-10-01

Mentions per year 5 mentions · busiest year 2026 (5)

20082026

All Stories Comments Newest Top Oldest

…optimized for self-hosted agents on Apple silicon. It’s my current choice for self-hosted models. https://github.com/raullenchai/Rapid-MLX
comment by pbronez · 2026-10-01 · in Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents
…this model family with X parameters” you have to add the architecture specific quantization too. https://github.com/raullenchai/Rapid-MLX
comment by pbronez · 2026-05-15 · in Show HN: Find the best local LLM for your hardware, ranked by benchmarks
…called Model-Harness Index: MHI = 0.50 × ToolCalling + 0.30 × HumanEval + 0.20 × MMLU (scale 0-100) https://github.com/raullenchai/Rapid-MLX
comment by pbronez · 2026-04-21 · in Anthropic says OpenClaw-style Claude CLI usage is allowed again
…Routing based on new tokens after cache hit. --cloud-model openai/gpt-5 --cloud-threshold 20000 https://github.com/raullenchai/Rapid-MLX
comment by pbronez · 2026-04-21 · in Anthropic says OpenClaw-style Claude CLI usage is allowed again
▲ 9
Show HN: Rapid-MLX – Run local LLMs on Mac, 2-3x faster than alternatives
story by raullen · 2026-04-18 · 4 comments