jundot/omlx
View on GitHub ↗ ★ 23,287 Python
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
15 mentions on Hacker News by 9 people: 7 stories, 8 comments · first 2026-02-13 · latest 2026-06-29
20082026
-
▲ 2
OMLX v0.3.9 Stable Merges Native MTP (Multi-Token Prediction)story by febed · 2026-05-22 · 0 comments
-
▲ 4
OMLX: Local LLM Server for Apple Silicon Macsstory by steveharing1 · 2026-05-11 · 0 comments
-
▲ 4
Show HN: oMLX – SSD-backed KV cache cuts coding agent TTFT from 90s to 1s on Macstory by jundot · 2026-03-04 · 1 comment
-
▲ 3
Show HN: oMLX – coding agents on local LLMs without the painful reprefillstory by jundot · 2026-02-24 · 0 comments
-
▲ 1
Show HN: oMLX – Native Mac inference server that persists KV cache to SSDstory by jundot · 2026-02-19 · 0 comments
-
▲ 2
OMLX – Ollama for MLX (LLM Inference Server for Apple Silicon)story by fintechie · 2026-02-15 · 0 comments
-
▲ 3
OMLX – LLM Inference Server for Apple Silicon (Ollama for MLX)story by fintechie · 2026-02-13 · 0 comments