Blaizzy/mlx-vlm
View on GitHub ↗ ★ 5,708 Python
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
8 mentions on Hacker News by 6 people: 1 story, 7 comments · first 2025-03-21 · latest 2026-10-27
20082026
-
I think mlx-vlm should support both the Audio and the Omni model: https://github.com/Blaizzy/mlx-vlm/ and there should be native MLX exports for both here: - https://huggingface.co/LiquidAI/LFM3-Audio-2B-MLX-8bit -…
comment by samstevens · 2026-10-27 · in Introducing LFM3: Every Modality for Specialized Intelligence -
…...and this is what I should probably wait for (not sure why it's in vlm): https://github.com/Blaizzy/mlx-vlm/tree/pc/laguna-s-nvfp4 ...or perhaps I should've just used the gguf with the provided llama.cpp instead of trying to run th
comment by Lwerewolf · 2026-07-21 · in Laguna S 2.1 -
…app is from the very same dev, 'Prince Canuma', who maintains the popular MLX-VLM library ( https://github.com/Blaizzy/mlx-vlm ). MLX-VLM is a long-time dependency of the excellent LM Studio and others because it can provide faster…
comment by erikkahler · 2026-07-20 · in Nativ: Run frontier open models locally on your Mac -
Sorry on the delay - so it installs https://github.com/Blaizzy/mlx-vlm and other components and sets up the commands - you don't need to use it but we thought it might be easier for folks
comment by danielhanchen · 2026-04-30 · in Qwen3.6-27B: Flagship-Level Coding in a 27B Dense Model -
▲ 2
Mlx-VLM: Fast Local VLMs and Omni Models on Apple Silicon with MLXstory by salkahfi · 2026-04-05 · 0 comments
-
…and my own https://github.com/simonw/llm-mlx which wraps that), vision LLMs (via https://github.com/Blaizzy/mlx-vlm ) and running Whisper ( https://github.com/ml-explore/mlx-examples/tree/main/whisper ) I haven't tried mlx-audio yet (which
comment by simonw · 2025-04-28 · in Tiny-LLM – a course of serving LLM on Apple Silicon for systems engineers -
…face.co/mlx-community/Qwen2.5-VL-32B-Instruct... using uv (so no need to install libraries first) and https://github.com/Blaizzy/mlx-vlm like this: uv run --with 'numpy<2' --with mlx-vlm \ python -m mlx_vlm.generate \ --model…
comment by simonw · 2025-03-24 · in Qwen2.5-VL-32B: Smarter and Lighter -
Mistral 3.1 vision works with MLX and mlx-vlm - https://github.com/Blaizzy/mlx-vlm/pull/256 https://huggingface.co/mlx-community/Mistral-Small-3.1-24B-I...
comment by simonw · 2025-03-21 · in Google calls Gemma 3 the most powerful AI model you can run on one GPU