NervanaSystems/maxas
View on GitHub ↗ ★ 1,073 Sass archived
Assembler for NVIDIA Maxwell architecture
18 mentions on Hacker News by 16 people: 1 story, 17 comments · first 2015-05-03 · latest 2025-03-29
20082026
-
…of optimizing gemm on NVIDIA hardware ( https://salykova.github.io/sgemm-gpu ) mentions 'maxas' ( https://github.com/NervanaSystems/maxas/wiki/Introduction ) - which was really a step forward in this space. I still blame Intel (buying…
comment by touisteur · 2025-03-29 · in Optimizing Matrix Multiplication on RDNA3 -
…about the hardware details required to understand why this helps. Article on this is forthcoming https://github.com/NervanaSystems/maxas/wiki/SGEMM
comment by aaa370 · 2024-07-26 · in How to optimize a CUDA matmul kernel for cuBLAS-like performance (2022) -
…return to static scheduling and I think this is describing more or less the same thing in Maxwell: https://github.com/NervanaSystems/maxas/wiki/Control-Codes
comment by rrss · 2020-09-14 · in Nvidia to Acquire Arm for $40B -
Except that, for CUDA, they do. https://github.com/NervanaSystems/maxas exhibited significantly higher performance than Nvidia's own SGEMM kernel, and https://github.com/mangpo/swizzle-inventor beats all named competitors in the…
comment by namibj · 2020-08-03 · in Autodesk criticised by architects -
…think any well-tuned GPU kernels use 32 warps/block, most are at 4 to 8 warps/block. See also: https://github.com/NervanaSystems/maxas/wiki/SGEMM https://www.nvidia.com/content/GTC-2010/pdfs/2238_GTC2010.pd...
comment by rrss · 2020-06-02 · in Understanding Latency Hiding on GPUs (2016) [pdf] -
…//github.com/numforge/laser/wiki/Convolution-optimisat... - Optimizing matrix multiplication on GPUs: https://github.com/NervanaSystems/maxas/wiki/SGEMM , again it's all about memory and caches optimization - Let's switch to another domain…
comment by mratsim · 2020-04-22 · in A possible new back end for Rust -
Not entirely true - Scott Gray knows: https://github.com/NervanaSystems/maxas/wiki/SGEMM IIRC his kernels shipped in cuBLAS at some point.
comment by tntn · 2019-05-09 · in Build a Neural Network -
…of low-level language (iirc. they are still manufactured on small mainstream process nodes). [0] https://github.com/NervanaSystems/maxas
comment by namibj · 2018-05-01 · in C Is Not a Low-Level Language -
…your own cuda no problem: https://research.google.com/pubs/pub45226.html or write your own assembly https://github.com/NervanaSystems/maxas What you miss is there is a reason why OpenCL didn't get traction and lack of tools translating…
comment by llukas · 2018-03-27 · in NVIDIA Develops NVLink Switch: NVSwitch, 18 Ports For DGX-2 -
…to be hand coded. you can see how much attention to detail scott gray puts into his kernels eg at https://github.com/NervanaSystems/maxas
comment by hughperkins · 2016-09-05 · in An evaluation of throughput computing on CPU and GPU (2010) [pdf] -
There is a Nvidia Maxwell assembler https://github.com/NervanaSystems/maxas But yeah this isn't production ready
comment by valarauca1 · 2016-08-18 · in Intel Announces Knights Mill: A Xeon Phi for Deep Learning -
…engineer the binary formats and write open source assemblers for recent versions of SASS (e.g., https://github.com/NervanaSystems/maxas ).
comment by jrk · 2016-04-25 · in GPUCC – An Open-Source GPGPU Compiler -
…Maxwell added additional control capabilities and so has 1 control for every 3 instructions." [1] https://github.com/NervanaSystems/maxas/wiki/Control-Codes
comment by Marat_Dukhan · 2016-01-10 · in Why I will be using RISC-V in my next chip -
…the manufacturers tend to keep really hidden, in order to avoid the binary compatibility trap, see https://github.com/NervanaSystems/maxas as an example for third party assembler for nvidia Maxwell arch) On GPU's the binary compatibility…
comment by sharpneli · 2015-12-24 · in The Problem with Friendly C -
…in cuDNN's latest kernels. But even if it isn't, if you're willing to download Scott Grey's maxas: https://github.com/NervanaSystems/maxas , you can hit 6.4 TFLOPS with his hand-coded SGEMM. Similarly, one can do the same for convolutional…
comment by varelse · 2015-08-10 · in Nvidia Digits DevBox -
Looking at some of the details in https://github.com/NervanaSystems/maxas/wiki/Control-Codes reminds me somewhat of the Itanium: a very wide architecture that is capable of high throughput for specialised applications, but requires a lot…
comment by userbinator · 2015-05-04 · in Assembler for Nvidia Maxwell architecture -
…is almost 5% faster than NVidia's and its faster than anything that can be done in PTX. [1] https://github.com/NervanaSystems/maxas/wiki/Introduction
comment by zerohp · 2015-05-04 · in Assembler for Nvidia Maxwell architecture