Hacker GitHub

← All repos

facebookincubator/AITemplate

View on GitHub ↗ ★ 4,731 Python

AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

11 mentions on Hacker News by 7 people: 3 stories, 8 comments · first 2022-10-03 · latest 2023-10-06

Mentions per year 11 mentions · busiest year 2022 (9)
20082026
AllStoriesComments NewestTopOldest
  1. …version of Facebook's example dynamic AIT script, to get rid of small issues like VRAM spikes: https://github.com/facebookincubator/AITemplate/tree/main/ex... InvokeAI is also diffusers based, but they seem to mess with the pipeline a bit…
    comment by brucethemoose2 · 2023-10-06 · in Show HN: Shortbread – Create AI comics in minutes
  2. RTX 3080-10GB should work. You could check https://github.com/facebookincubator/AITemplate/tree/main/ex... , and https://www.reddit.com/r/StableDiffusion/comments/xv7m89/met... .
    comment by ipiszy · 2022-10-05 · in AITemplate, a revolutionary new inference engine by Meta AI
  3. …an official comparison between AITemplate and tvm / onnx for now, but we do have perf numbers like https://github.com/facebookincubator/AITemplate/tree/main/ex... , https://github.com/facebookincubator/AITemplate/tree/main/ex... . Feel…
    comment by ipiszy · 2022-10-04 · in AITemplate, a revolutionary new inference engine by Meta AI
  4. …section in the blog ( https://ai.facebook.com/blog/gpu-inference-engine-nvidia-amd... ), and https://github.com/facebookincubator/AITemplate#more-about-a... . The basic idea is to do aggressive kernel fusions.
    comment by ipiszy · 2022-10-04 · in AITemplate, a revolutionary new inference engine by Meta AI
  5. …tps://facebookincubator.github.io/AITemplate/tutorial/how_... . For more advanced examples, check out https://github.com/facebookincubator/AITemplate/tree/main/ex...
    comment by haolu7 · 2022-10-04 · in AITemplate, a revolutionary new inference engine by Meta AI
  6. …2.57X faster than Keras' XLA-based GPU compilation solution. More benchmark numbers and repro at: https://github.com/facebookincubator/AITemplate/tree/main/ex...
    comment by haolu7 · 2022-10-03 · in AITemplate, a revolutionary new inference engine by Meta AI
  7. tl;dr: Meta is open sourcing AITemplate, an inference engine for both Nvidia and AMD GPUs. Code: https://github.com/facebookincubator/AITemplate . AITemplate delivers much better perf (1.9x ~ 12.8x) compared to PyTorch eager on SOTA…
    comment by ipiszy · 2022-10-03 · in AITemplate, a revolutionary new inference engine by Meta AI
  8. https://github.com/facebookincubator/AITemplate
    comment by azurezyq · 2022-10-03 · in AITemplate, a revolutionary new inference engine by Meta AI