Telosnex/fonnx
View on GitHub ↗ ★ 297 Dart
ONNX runtime for Flutter.
6 mentions on Hacker News by 1 person: 0 stories, 6 comments · first 2023-10-16 · latest 2025-12-08
20082026
-
…as needed. You can get a sense of what that looks like from my package for doing ML inference here: https://github.com/Telosnex/fonnx , specifically https://github.com/Telosnex/fonnx/tree/main/lib/models/minis... : X_native.dart shows us…
comment by refulgentis · 2025-12-08 · in Scala 3 slowed us down? -
https://github.com/Telosnex/fonnx - note thats on 6, count em, 6 platforms, and I need to write 4 implementations (Swift/Kotlin/C++/JS). I'm not kidding. Maybe 4 hours. It's trivial. 93 lines of code. And its extremely rote. Allocate X…
comment by refulgentis · 2024-04-02 · in A16Z blogs are just glorified marketing -
…All platforms incl. web, but WASM is slow, def. not worth it except as a proof of concept. - FONNX: https://github.com/Telosnex/fonnx ONNX runtime at core, all platforms including web. Whisper, Silero VAD, Magika, and two embeddings…
comment by refulgentis · 2024-03-01 · in Show HN: OfflineLLM – a Vision Pro app running TinyLlama on device -
…and FLLAMA, Flutter libraries that work on all platforms. FONNX has embeddings, FLLAMA has llama. https://github.com/Telosnex/fonnx https://github.com/Telosnex/fllama
comment by refulgentis · 2024-02-21 · in Gemma: New Open Models -
…retrieval/vector DB can run on all platforms via one library: https://github.com/Telosnex/fonnx
comment by refulgentis · 2024-01-21 · in Self-Rewarding Language Models -
…Max in MacBook Pro with 64 GB of RAM vs. what I think is M2 in Mac Mini with 8 GB RAM. (benchmarks: https://github.com/Telosnex/fonnx#benchmarks ) I really appreciate what GGML does but I have this irrational feeling that it'd…
comment by refulgentis · 2023-10-16 · in GPU Embedding with GGML