ml-explore/mlx on Hacker News

I thought this seemed significant at the time: https://github.com/ml-explore/mlx/pull/1983

comment by billbrown · 2026-06-09 · in Apple reveals new AI architecture built around Google Gemini models

▲ 1

Show HN: MLX-Ruby – Ruby Bindings for Apple's MLX ML Framework

story by skryl · 2026-02-16 · 1 comment

…note that MLX's author's reason for not supporting the ANE is that it has a "closed-source" API ( https://github.com/ml-explore/mlx/issues/18#issuecomment-184... ), making it unsuitable for an open-source project, and given that MLX didn't…

comment by llm_nerd · 2026-02-02 · in My iPhone 16 Pro Max produces garbage output when running MLX LLMs

It is a bug in MLX that has been fixed a few days ago: https://github.com/ml-explore/mlx/pull/3083

comment by zcbenz · 2026-02-02 · in My iPhone 16 Pro Max produces garbage output when running MLX LLMs

…for MLX doesn’t hold up. MLX supports running on CPU, Apple GPU via Metal, and NVIDIA GPU via CUDA: https://github.com/ml-explore/mlx/tree/main/mlx/backend

comment by docfort · 2026-02-02 · in My iPhone 16 Pro Max produces garbage output when running MLX LLMs

▲ 2

MLX: Why not implement this in PyTorch?

story by tosh · 2026-01-29 · 0 comments

…Non-inference HPC workloads could see a massive benefit as well. [1]: See MLX integration PR at https://github.com/ml-explore/mlx/pull/2808

comment by guiand · 2025-11-24 · in You can turn a cluster of Macs into an AI supercomputer in macOS Tahoe 26.2

MLX does not support the ANE. https://github.com/ml-explore/mlx/issues/18

comment by woadwarrior01 · 2025-09-08 · in Experimenting with Local LLMs on macOS

They're working—almost done—on a CUDA backend for their Apple Silicon framework: https://github.com/ml-explore/mlx/pull/1983

comment by billbrown · 2025-08-18 · in Apple and Amazon will miss AI like Intel missed mobile

…greener on the other side…pray tell how that goes Plus, you can now deploy [MLX projects on CUDA]( https://github.com/ml-explore/mlx/pull/1983 )

comment by DrBenCarson · 2025-08-10 · in The Framework Desktop is a beast

MLX github: https://github.com/ml-explore/mlx get started: https://developer.apple.com/videos/play/wwdc2025/315/ details: https://developer.apple.com/videos/play/wwdc2025/298/

comment by w10-1 · 2025-07-29 · in My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)

…one of the key features of MLX is using a unified memory architecture? (see bullets on repo readme: https://github.com/ml-explore/mlx ) I would think that bringing that to all UMA APUs (of any vendor) would be interesting, but discreet…

comment by zdw · 2025-07-14 · in Apple's MLX adding CUDA support

▲ 548

Apple's MLX adding CUDA support

story by nsagent · 2025-07-14 · 203 comments

…ANE given its closed-source API! [1] [0]: https://github.com/ggml-org/llama.cpp/issues/10453 [1]: https://github.com/ml-explore/mlx/issues/18#issuecomment-184...

comment by behnamoh · 2025-05-03 · in Run LLMs on Apple Neural Engine (ANE)

For learning internals of ML frameworks I recommend reading the source code of MLX: https://github.com/ml-explore/mlx . It is a modern and clean codebase without legacies, and I could understand most things without seeking external…

comment by zcbenz · 2025-03-22 · in PyTorch Internals: Ezyang's Blog

It uses MLX ( https://github.com/ml-explore/mlx ), Apple’s ML framework, for running LLMs.

comment by woodson · 2025-02-15 · in Show HN: VimLM – A Local, Offline Coding Assistant for Vim

…of python code (10k are tests) to typescript, using GPT4. It cost me ~$70. The python project is https://github.com/ml-explore/mlx and the converted project is https://github.com/frost-beta/node-mlx I wrote a long prompt:…

comment by zcbenz · 2024-07-20 · in Converting Codebases with LLMs

…the resulting adapter layers into Ollama: MLX [1] on macOS, Unsloth [2] on Windows and Linux [1] https://github.com/ml-explore/mlx [2] https://github.com/unslothai/unsloth

comment by jmorgan · 2024-06-16 · in Ollama v0.1.45

Jax is the closest thing at the moment. https://developer.apple.com/metal/jax/ And MLX https://github.com/ml-explore/mlx

comment by kiratp · 2024-06-03 · in cuDF – GPU DataFrame Library

Seen MLX folks post on X about nice results running local LLMs. https://github.com/ml-explore/mlx Also, Siri, and consider: you’re scaling AI on apple’s hardware, too, you can develop your own local custom AI on it, there’s more memory…

comment by bionhoward · 2024-05-08 · in Apple introduces M4 chip

…is an incredible project with competitive performance and support for almost any platform. [1] https://github.com/ml-explore/mlx [2] https://en.wikipedia.org/wiki/Torch_(machine_learning) [3] https://github.com/NVIDIA/TensorRT-LLM

comment by jmorgan · 2024-04-29 · in Ollama v0.1.33 with Llama 3, Phi 3, and Qwen 110B

…get an NVIDIA RTX3090 or RTX4090. Apple Mac M2 or M3's are becoming a viable option because of MLX https://github.com/ml-explore/mlx . If you are getting an M series Mac for LLMs, I'd recommend getting something with 24GB or more of RAM.

comment by aliasaria · 2024-04-01 · in Ask HN: What is the current (Apr. 2024) gold standard of running an LLM locally?

…[1] Comments from MLX (Apple-contributed Metal-only array compute library): https://github.com/ml-explore/mlx/issues/18

comment by AhtiK · 2024-03-01 · in Apple Silicon: A little help from friends and co-processors

▲ 2

MLX: Why not implement this in PyTorch?

story by tosh · 2024-02-28 · 0 comments

▲ 2

MLX Community Projects

story by sebg · 2024-02-08 · 0 comments

https://github.com/ml-explore/mlx https://github.com/ml-explore/mlx-examples This is where all of the action is at right now. You can also use LM Studio: https://lmstudio.ai/

comment by erichocean · 2024-01-15 · in The M2 is more advanced than it seemed

…[7] https://developer.apple.com/documentation/metal/gpu_devices_... [8] https://github.com/ml-explore/mlx/issues/18 [9] https://github.com/ggerganov/llama.cpp/issues/1714#issuecomm... [10] https://testflight.apple.com/join/ERFxInZ

comment by brittlewis12 · 2024-01-08 · in I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros

…..seems to be enabled by Apple's new MLX framework (which could become even faster https://github.com/ml-explore/mlx/issues/18 --ANE support would be particularly important on a lowly M1, which is the main system that would have been…

comment by vaxman · 2023-12-31 · in Tracking developer build times to decide if the M3 MacBook is worth upgrading

Maybe MLX is meant to fill this gap? https://github.com/ml-explore/mlx

comment by lachlan_gray · 2023-12-24 · in Ferret: A Multimodal Large Language Model

…this because CPU and GPU share memory. No need to do any data transfers. Checkout mlx from apple: https://github.com/ml-explore/mlx

comment by chsasank · 2023-12-20 · in PowerInfer: Fast Large Language Model Serving with a Consumer-Grade GPU [pdf]

Apple has it: https://github.com/ml-explore/mlx

comment by paradite · 2023-12-14 · in Windows AI Studio Preview

…I think it's definitely going to get traction on Macs - and iOS when Swift bindings are released https://github.com/ml-explore/mlx/issues/15 (although there might be some C++20 compilation issue blocking right now).

comment by Flux159 · 2023-12-13 · in Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX

It's an array manipulation library for their silicon https://github.com/ml-explore/mlx

comment by adr1an · 2023-12-07 · in Apple demonstrates its commitment to AI with new open source code release

▲ 244

MLX: An array framework for Apple Silicon

story by jacobkahn · 2023-12-06 · 46 comments