Hacker GitHub

← All repos

vitoplantamura/OnnxStream

View on GitHub ↗ ★ 2,087 C++

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.

7 mentions on Hacker News by 4 people: 5 stories, 2 comments · first 2023-07-20 · latest 2026-02-16

Mentions per year 7 mentions · busiest year 2023 (4)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 2
    Show HN: OnnxStream running TinyLlama and Mistral 7B, with CUDA support
    story by vitoplantamura · 2024-01-14 · 0 comments
  2. ▲ 17
    OnnxStream running TinyLlama and Mistral 7B, with CUDA support
    story by Robin89 · 2024-01-14 · 2 comments
  3. ▲ 109
    OnnxStream: Stable Diffusion XL 1.0 Base on a Raspberry Pi Zero 2
    story by Robin89 · 2023-12-14 · 87 comments
  4. ▲ 510
    Running Stable Diffusion XL 1.0 in 298MB of RAM
    story by Robin89 · 2023-10-03 · 154 comments
  5. ▲ 293
    Running Stable Diffusion in 260MB of RAM
    story by Robin89 · 2023-07-20 · 64 comments