nod-ai/AMD-SHARK-Studio
View on GitHub ↗ ★ 1,450 Python
AMD-SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution
8 mentions on Hacker News by 5 people: 1 story, 7 comments · first 2022-11-24 · latest 2023-08-11
20082026
-
…outpaced the ONNX runtime. But apparently the performance of llama on torch-mlir is progressing: https://github.com/nod-ai/SHARK/issues/1707
comment by brucethemoose2 · 2023-08-11 · in Llama 2 on ONNX runs locally -
We have it running as part of SHARK (which is built on IREE). https://github.com/nod-ai/SHARK/tree/main/shark/examples/sha...
comment by magic_at_nodai · 2023-03-12 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support -
…well as iree/iree-samples and iree/iree-jax repos, paper Scott cited or sers of IREE like Shark ( https://github.com/nod-ai/SHARK#quick-start-for-shark-stable... )) you'll see some example.
comment by JacquesPienaar · 2023-03-09 · in OpenXLA Is Available Now -
…out MLIR which, for instance, is used very sucessfully here and is benching way faster than rocm: https://github.com/nod-ai/SHARK/
comment by brucethemoose2 · 2023-03-01 · in AMD Instinct MI300 Data Center APU – 146B Transistors, Shipping H2’23 -
…you are the dev, have you considered SHARK? Vulkan performance seems to be excellent on AMD cards: https://github.com/nod-ai/SHARK/tree/2f36de319a52479039c7ea0...
comment by brucethemoose2 · 2023-02-24 · in SuperImage: Free and open source AI image upscaler for Android -
Since you mention stable diffusion, there's this: https://github.com/nod-ai/SHARK/blob/main/shark/examples/sha... Looks like it's still early days, but clearly it has recently been made to work and there's an effort going on to make it…
comment by atq2119 · 2022-12-14 · in AMD Radeon RX 7900 XTX and RX 7900 XT Linux Support and Performance Review -
Try SHARK on your AMD GPUs for SD. Follow the setup here: https://github.com/nod-ai/SHARK/tree/main/shark/examples/sha... . It works with Pytorch -> torch-mlir -> MLIR / IREE -> vulkan. Works on both Windows and Linux. And has a simple…
comment by magic_at_nodai · 2022-11-24 · in Stable Diffusion 2.0