SharpAI/SwiftLM
View on GitHub ↗ ★ 797 Swift
⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
5 mentions on Hacker News by 2 people: 2 stories, 3 comments · first 2026-04-01 · latest 2026-04-01
20082026
-
▲ 77
TurboQuant KV Compression and SSD Expert Streaming for M5 Pro and IOSstory by aegis_camera · 2026-04-01 · 47 comments
-
▲ 1
Show HN: SwiftLM – Qwen Chat on iPhone, 100B+ Moe on M5 Pro 64GB (Native Swift)story by aegis_camera · 2026-04-01 · 2 comments