webonnx/wonnx
View on GitHub ↗ ★ 1,756 Rust archived
A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
20 mentions on Hacker News by 11 people: 2 stories, 18 comments · first 2022-02-25 · latest 2023-12-15
20082026
-
…wonnx[2] has the most momentum, but I am aware of other efforts. [1]: https://kompute.cc/ [2]: https://github.com/webonnx/wonnx
comment by raphlinus · 2023-12-15 · in Intel CEO: 'The entire industry is motivated to eliminate the CUDA market' -
You might be interested in this https://github.com/webonnx/wonnx
comment by alex7o · 2023-09-27 · in You can now use WebGPU in Cloudflare Workers -
…approaches, and IREE[3], the latter of which has a Vulkan back-end. [1]: https://kompute.cc/ [2]: https://github.com/webonnx/wonnx [3]: https://github.com/openxla/iree
comment by raphlinus · 2023-08-02 · in VkFFT: Vulkan/CUDA/Hip/OpenCL/Level Zero/Metal Fast Fourier Transform Library -
There's also a third-party WebGPU implementation: https://github.com/webonnx/wonnx
comment by tormeh · 2023-07-25 · in ONNX runtime: Cross-platform accelerated machine learning -
…https://news.ycombinator.com/item?id=35696031 ... TIL about wonnx: https://github.com/webonnx/wonnx#in-the-browser-using-webgpu... microsoft/onnxruntime: https://github.com/microsoft/onnxruntime Apache/arrow has language-port
comment by westurner · 2023-05-20 · in PyTorch for WebGPU -
What's the reason to run pytorch directly on WebGPU vs using ONNX on WebGPU (e.g. with https://github.com/webonnx/wonnx )?
comment by tachim · 2023-05-19 · in PyTorch for WebGPU -
…- Wonnx, A WebGPU inference engine for running AI compute on the server or in the browser. https://github.com/webonnx/wonnx
comment by ianpurton · 2023-05-03 · in I want to talk about WebGPU -
…and then using them via an inference engine all powered by your local GPU? Have a look at wonnix https://github.com/webonnx/wonnx A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
comment by ianpurton · 2023-05-03 · in I want to talk about WebGPU -
…be more complete and mature. And the bonus is that it's implemented in Rust (if you are into it). https://github.com/webonnx/wonnx
comment by pumanoir · 2023-04-25 · in ONNX Runtime merges WebGPU backend -
Looking forward to your WebGPU ML runtime! Also, why not contribute back to WONNX? ( https://github.com/webonnx/wonnx )
comment by misterdata · 2023-04-06 · in Chrome ships WebGPU -
This makes running larger machine learning models in the browser feasible - see e.g. https://github.com/webonnx/wonnx (I believe Microsoft's ONNXRuntime.js will also soon gain a WebGPU back-end).
comment by misterdata · 2023-04-06 · in Chrome ships WebGPU -
Anyone interested in this might also be interested in WONNX: https://github.com/webonnx/wonnx
comment by tormeh · 2023-03-17 · in Web Stable Diffusion -
…and not really for other types of 'neural accelerators' (like e.g. the ANE on Apple devices). [1] https://github.com/webonnx/wonnx
comment by misterdata · 2023-03-09 · in OpenXLA Is Available Now -
I know this framework https://github.com/webonnx/wonnx , but I’ve never used that.
comment by figomore · 2023-02-18 · in AMD ROCm: A Wasted Opportunity -
…whether warp shuffle operations might be useful to reduce some of the shared memory traffic. [1]: https://github.com/webonnx/wonnx/blob/master/wonnx/templates...
comment by raphlinus · 2023-01-05 · in How to Optimize a CUDA Matmul Kernel for CuBLAS-Like Performance: A Worklog -
…than just shipping tract, so the approach I'll take is probably a wonnx+tract approach. [0] https://github.com/webonnx/wonnx/issues/116#issuecomment-114...
comment by davidatbu · 2022-07-08 · in Brain.js: GPU Accelerated Neural Networks in JavaScript -
See also https://github.com/webonnx/wonnx , which runs ONNX models through WebGPU. It is written in Rust and can be used natively on Windows, macOS and Linux (through wgpu which uses either DX12, Vulkan or Metal) or on the web (it has a JS…
comment by misterdata · 2022-07-07 · in Brain.js: GPU Accelerated Neural Networks in JavaScript -
Already on it! https://github.com/webonnx/wonnx - runs ONNX neural networks on top of WebGPU (in the browser, or using wgpu on top of Vulkan/DX12/..)
comment by misterdata · 2022-03-08 · in WebGPU – All of the cores, none of the canvas