← All repos

NVIDIA/TransformerEngine

View on GitHub ↗ ★ 3,602 Python

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2023-01-18 · latest 2024-09-25