Hacker GitHub

← All repos

microsoft/onnxruntime

View on GitHub ↗ ★ 22,207 C++

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

24 mentions on Hacker News by 24 people: 5 stories, 19 comments · first 2019-10-18 · latest 2026-09-02

Mentions per year 24 mentions · busiest year 2023 (5)
20082026
AllStoriesComments NewestTopOldest
  1. We use the ONNX runtime for small models in the browser https://github.com/microsoft/onnxruntime
    comment by seamossfet · 2026-09-02 · in WebLLM: high-performance in-browser LLM inference engine
  2. …put as much effort into a post morten for this one as they're doing for a diagram on a blog post https://github.com/microsoft/onnxruntime/issues/27263#issuec...
    comment by theolivenbaum · 2026-02-18 · in 15 years later, Microsoft morged my diagram
  3. …isn't the best. The best solution for ORT would probably be to introduce a pure MPS provider ( https://github.com/microsoft/onnxruntime/issues/21271 ), but given they've already bought into CoreML the effort may not be worth the reward for…
    comment by Two_hands · 2025-12-22 · in ONNX Runtime and CoreML May Silently Convert Your Model to FP16
  4. …) which has had a few issues running models with CoreML (unrelated to the linked post), e.g. https://github.com/microsoft/onnxruntime/issues/26355
    comment by smcleod · 2025-12-22 · in ONNX Runtime and CoreML May Silently Convert Your Model to FP16
  5. …- The actual underlying tech stack is DirectML ( https://github.com/microsoft/DirectML ) and ONNX ( https://github.com/microsoft/onnxruntime ). ---- So the data is intended to be encrypted at rest along with the rest of the OS, it's all…
    comment by CuriousCosmic · 2024-06-02 · in Recall: Stealing everything you've ever typed or viewed on your own Windows PC
  6. On similar lines, faster tanh https://github.com/microsoft/onnxruntime/pull/20612
    comment by rdevulap · 2024-05-16 · in New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy
  7. …at the commit history. The standard now is to convert PyTorch to onnx, then use onnxruntime ( https://github.com/microsoft/onnxruntime/tree/main/js/web ) to run the model on the browser using webassembly/webGL (and nodejs if you wanted to,…
    comment by ipsum2 · 2024-03-29 · in Deep Learning in JavaScript
  8. …use the same API and same model file to run accelerated inferences on Coral, CUDA, CoreML, etc. - https://github.com/microsoft/onnxruntime/issues/10248
    comment by rgovostes · 2024-01-12 · in Coral Dev Board Micro
  9. …shader more seriously. [1]: https://www.circle-lang.org/ [2]: https://shader-slang.com/ [3]: https://github.com/microsoft/onnxruntime/tree/dev/opencl
    comment by cloudhan · 2024-01-10 · in Vcc – The Vulkan Clang Compiler
  10. …If you really didn't want PyTorch/Transformers, you could consider exporting your models to ONNX ( https://github.com/microsoft/onnxruntime ).
    comment by dmezzetti · 2023-11-26 · in VectorDB: Vector Database Built by Kagi Search
  11. …https://tensorflow.github.io/rust/tensorflow/struct.Tensor.h... "ONNX Runtime merges WebGPU backend" https://github.com/microsoft/onnxruntime https://news.ycombinator.com/item?id=35696031 ... TIL about wonnx:…
    comment by westurner · 2023-05-20 · in PyTorch for WebGPU
  12. …to land in a 1.14 release, a 1.15 release, has already landed, isn't yet scheduled to land, etc? https://github.com/microsoft/onnxruntime/pull/14579 https://github.com/microsoft/onnxruntime/releases I don't see it in any releases yet?…
    comment by MuffinFlavored · 2023-05-03 · in Ask HN: What tech is under the radar with all attention on ChatGPT etc.?
  13. …[2] https://groups.google.com/a/chromium.org/g/blink-dev/c/VomzP... [3] https://github.com/microsoft/onnxruntime/issues/11695#issuec...
    comment by xenova · 2023-03-17 · in Transformers.js
  14. …way at least if you want to TensorRT the model. I appreciate this is a very general question. [1] https://github.com/microsoft/onnxruntime
    comment by quietbritishjim · 2021-10-22 · in PyTorch 1.10
  15. …[2]. I don't think ONNX is going away anytime soon. Not so sure about the TF ecosystem though. [1] https://github.com/microsoft/onnxruntime/releases [2] https://onnx.ai/about.html
    comment by akhundelar · 2021-08-18 · in Convert Apple NeuralHash model for CSAM Detection to ONNX
  16. And ONNX helps too - https://github.com/microsoft/onnxruntime
    comment by manojlds · 2021-02-01 · in Show HN: Deploy ML Models on a Budget
  17. Yes, this seems very similar to the ONNX Runtime https://github.com/microsoft/onnxruntime . I'm not sure why they needed to reinvent the wheel here.
    comment by dtrailin · 2020-06-08 · in Show HN: Neuropod – Uber ATG's open source deep learning inference engine
  18. …Note that this is for an embedded deployment environment. [1] https://github.com/onnx/onnx [2] https://github.com/Microsoft/onnxruntime [3] https://mlflow.org/ [4] https://ray.readthedocs.io/en/latest/tune.html
    comment by Datenstrom · 2019-11-12 · in Ask HN: What is your ML stack like?
  19. Yes, Cortex uses ONNX Runtime ( https://github.com/microsoft/onnxruntime ) under the hood so any model that can be exported to ONNX can be deployed.
    comment by ospillinger · 2019-10-18 · in Cortex: Deploy machine learning models in production