Hacker GitHub

← All repos

waybarrios/vllm-mlx

View on GitHub ↗ ★ 1,651 Python

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

4 mentions on Hacker News by 1 person: 2 stories, 2 comments · first 2025-12-07 · latest 2026-01-16

Mentions per year 4 mentions · busiest year 2025 (2)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 33
    vLLM-MLX – Run LLMs on Mac at 464 tok/s
    story by waybarrios · 2026-01-16 · 3 comments
  2. ▲ 2
    Trying VLLM Ideas on Apple Silicon with MLX (WIP)
    story by waybarrios · 2025-12-07 · 1 comment