Hacker GitHub

← All repos

SharpAI/SwiftLM

View on GitHub ↗ ★ 797 Swift

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

5 mentions on Hacker News by 2 people: 2 stories, 3 comments · first 2026-04-01 · latest 2026-04-01

Mentions per year 5 mentions · busiest year 2026 (5)
20082026
AllStoriesComments NewestTopOldest
  1. …figure out this recipe (inspired by a similar workaround in the CI scripts): git clone --recursive https://github.com/SharpAI/SwiftLM.git cd SwiftLM swift build -c release # Trick to copy in that missing mlx.metallib file uv run --with…
    comment by simonw · 2026-04-01 · in TurboQuant KV Compression and SSD Expert Streaming for M5 Pro and IOS
  2. git clone https://github.com/SharpAI/SwiftLM # no --recursive needed cd SwiftLM swift build -c release ### Please let me know if this fix the issue: # Copy metallib next to the binary (one-time step) cp…
    comment by aegis_camera · 2026-04-01 · in TurboQuant KV Compression and SSD Expert Streaming for M5 Pro and IOS
  3. …on Apple Silicon. Also tested QWEN 4B on IPHONE 13 Pro. Code and implementation details: https://github.com/SharpAI/SwiftLM
    comment by aegis_camera · 2026-04-01 · in TurboQuant KV Compression and SSD Expert Streaming for M5 Pro and IOS
  4. ▲ 77
    TurboQuant KV Compression and SSD Expert Streaming for M5 Pro and IOS
    story by aegis_camera · 2026-04-01 · 47 comments
  5. ▲ 1
    Show HN: SwiftLM – Qwen Chat on iPhone, 100B+ Moe on M5 Pro 64GB (Native Swift)
    story by aegis_camera · 2026-04-01 · 2 comments