huggingface/candle on Hacker News

Integration with candle is already available! https://github.com/huggingface/candle/pull/3934/

comment by melihelibol · 2026-09-17 · in Nvidia announces native GPU programming in Rust

…[1] crate for inference on Rust, this seems like a good step towards nice native Rust kernels. [1] https://github.com/huggingface/candle

comment by dllu · 2026-09-16 · in Nvidia announces native GPU programming in Rust

…with ML on Rust, and easy to move things between CPU and GPU, more of a library than a DSL though: https://github.com/huggingface/candle

comment by embedding-shape · 2026-03-08 · in Show HN: Eyot, A programming language where the GPU is just another thread

…create a new chat or join via link/code. It also has in browser transcription using Whisper (using https://github.com/huggingface/candle/ ). Currently fighting getting background blur to work smoothly on Chrome on Android, which is proving…

comment by properbrew · 2026-01-03 · in Ask HN: What are you working on? (Jan 2026)

If you need WASM, I think Candle is your current best bet: https://github.com/huggingface/candle

comment by klaussilveira · 2025-12-23 · in Executorch: On-device AI across mobile, embedded and edge for PyTorch

…in our inference engine for Mixlayer[2]. [0] https://github.com/coreylowman/cudarc/pull/449 [1] https://github.com/huggingface/candle/pull/2989 [2] https://mixlayer.com

comment by zackangelo · 2025-08-07 · in Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs

…to this effort: https://github.com/tracel-ai/cubecl [0]: https://github.com/tracel-ai/burn [1]: https://github.com/huggingface/candle/

comment by hardwaresofton · 2025-07-26 · in Rust running on every GPU

…[1] and candle [2] recently and they sounded interesting. [1] https://crates.io/crates/burn [2] https://github.com/huggingface/candle Interestingly, burn supports candle as a backend.

comment by porphyra · 2025-05-28 · in Show HN: I rewrote my Mac Electron app in Rust

Surprised this doesn't mention candle: https://github.com/huggingface/candle

comment by qskousen · 2025-04-24 · in CubeCL: GPU Kernels in Rust for CUDA, ROCm, and WGPU

…GPU for computation. If you would like to try out a Rust framework that does support GPUs, Candle https://github.com/huggingface/candle/tree/main may be worth exploring

comment by bt1a · 2024-10-11 · in Lm.rs: Minimal CPU LLM inference in Rust with no dependency

…tensor operations needed to run the forward pass of LLMs isn't as large as you'd think though. [0] https://github.com/huggingface/candle

comment by zackangelo · 2024-09-30 · in Moshi: A speech-text foundation model for real time dialogue

…ML framework for Rust with a focus on performance (including GPU support) and ease of use https://github.com/huggingface/candle

comment by convexstrictly · 2024-04-09 · in Llm.c – LLM training in simple, pure C/CUDA

…and it runs pretty well. Can use both CUDA and Metal backends (or just plain-old CPU). [1] https://github.com/huggingface/candle

comment by dvt · 2024-04-08 · in Llm.c – LLM training in simple, pure C/CUDA

…monopoly of CUDA inevitably gets chipped away. [0] https://github.com/ShelbyJenkins/llm_client [1] https://github.com/huggingface/candle

comment by J_Shelby_J · 2024-03-12 · in Go, Python, Rust, and production AI applications

…Instead of jumping on the tensorflow or torch boat, when doing Rust today I would consider using https://github.com/huggingface/candle

comment by jokethrowaway · 2024-02-22 · in Guide to Using TensorFlow in Rust

…deeper into the source code, but the code in their examples is clear and easy to understand [0] https://github.com/huggingface/candle

comment by sbt567 · 2023-11-08 · in Ask HN: Most beautiful open source projects in Rust

…backends is a huge undertaking. Do you think backends such as MPS may become a shared effort? [1] https://github.com/huggingface/candle [2] https://github.com/huggingface/candle/issues/313

comment by alex_hirner · 2023-10-18 · in ExecuTorch: Run PyTorch programs on mobile and edge devices

…whisper down to a single CUDA-leveraging binary for fast local transcription is pretty cool! [0]: https://github.com/huggingface/candle

comment by n8henrie · 2023-09-16 · in Should I Haskell or OCaml?

Powered by Candle Rust compiled to Wasm: https://github.com/huggingface/candle

comment by r-k-jo · 2023-09-16 · in Segment Anything Model (Sam) in the Browser with Rust and WASM

https://github.com/huggingface/candle/blob/main/candle-kerne... That’s the C++ variant of cuda, not Rust. They’re just binding it as one might in Python. At which point, what’s the value add?

comment by brrrrrm · 2023-08-08 · in Candle: Torch Replacement in Rust

They already support quantization out of the box! https://github.com/huggingface/candle/pull/314/files

comment by FL33TW00D · 2023-08-08 · in Candle: Torch Replacement in Rust

…There is an issue about WebGPU although I don’t notice references to the native version of it. https://github.com/huggingface/candle/issues/344

comment by kvark · 2023-08-08 · in Candle: Torch Replacement in Rust

…library is targeting production, a much smaller subset of engineers. See the 'why candle' section: https://github.com/huggingface/candle#why-candle . So you could use PyTorch to build models and Candle to serve them.

comment by huac · 2023-08-08 · in Candle: Torch Replacement in Rust

▲ 365

Candle: Torch Replacement in Rust

story by osanseviero · 2023-08-08 · 182 comments

…you would get on pytorch. ...And then I spotted Candle, a new ML framework by the same author: https://github.com/huggingface/candle It's all in Rust, self contained, a huge undertaking, but it looks very promising. They already have a…

comment by jokethrowaway · 2023-08-06 · in Llama2.rs: One-file Rust implementation of Llama2