Hacker GitHub

← All repos

waybarrios/vllm-mlx

View on GitHub ↗ ★ 1,651 Python

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

4 mentions on Hacker News by 1 person: 2 stories, 2 comments · first 2025-12-07 · latest 2026-01-16

Mentions per year 4 mentions · busiest year 2025 (2)
20082026
AllStoriesComments NewestTopOldest
  1. …Works with standard OpenAI SDK. Happy to answer questions! GitHub: https://github.com/waybarrios/vllm-mlx
    comment by waybarrios · 2026-01-16 · in vLLM-MLX – Run LLMs on Mac at 464 tok/s
  2. …but if you’re into MLX or running LLMs/VLMs on a Mac, I’d love feedback or contributors. Repo: https://github.com/waybarrios/vllm-mlx
    comment by waybarrios · 2025-12-07 · in Trying VLLM Ideas on Apple Silicon with MLX (WIP)