Hacker GitHub

← All repos

eyalroz/cuda-api-wrappers

View on GitHub ↗ ★ 906 C++

Thin, unified, C++-flavored wrappers for the CUDA APIs

17 mentions on Hacker News by 2 people: 1 story, 16 comments · first 2021-09-25 · latest 2026-06-29

Mentions per year 17 mentions · busiest year 2024 (5)
20082026
  1. …for a much more readable, and still fully transparent modern-C++ API version of the same, try this: https://github.com/eyalroz/cuda-api-wrappers/blob/master/exa... that's a sample program for my CUDA API wrappers (header-only) library.
    comment by einpoklum · 2026-06-29 · in What happens when you run a CUDA kernel?
  2. …std::span<T> and std::unique_ptr<T[]> . I wonder if that might seem less annoying to GP. --- [1] : https://github.com/eyalroz/cuda-api-wrappers/
    comment by einpoklum · 2026-01-19 · in Understanding C++ Ownership System
  3. …Well, I wouldn't go that far, it's not that direct. Let's call it: "Less indirect"... [1] : https://github.com/eyalroz/cuda-api-wrappers/
    comment by einpoklum · 2025-11-20 · in CUDA Ontology
  4. …about C++, while at the same time not being properly limited to C. (which is why I wrote this: https://github.com/eyalroz/cuda-api-wrappers/ ) > an awful GPU mailbox design is still the cutting-edge tech Can you elaborate on what you mean…
  5. …even though I've gotten some appreciative comments from individuals, they have shown zero interest. https://github.com/eyalroz/cuda-api-wrappers/ There is also their driver, which is supposedly "open source", but actually none of the logic…
    comment by einpoklum · 2025-01-14 · in The Missing Nvidia GPU Glossary
  6. …to mix the layers. As an author of a library that also focuses on being a "layer" of sorts ( https://github.com/eyalroz/cuda-api-wrappers/ ), I struggle with this temptation a lot! Especially when, like the author says, the boundaries of…
    comment by einpoklum · 2024-11-28 · in The success and failure of Ninja (2020)
  7. Personally, I prefer CuPy over your library. For example, your vectorAdd.cu implementation at https://github.com/eyalroz/cuda-api-wrappers/blob/master/exa... is much longer than a similar CuPy implementation: import cupy as cp vector_add =…
    comment by johndough · 2024-09-20 · in CuPy: NumPy and SciPy for GPU
  8. …easiest way to interface with custom CUDA kernels In Python? Perhaps. Generally? No, it isn't. Try: https://github.com/eyalroz/cuda-api-wrappers/ Full power of the CUDA APIs including all runtime compilation options etc. (Yes, I wrote…
    comment by einpoklum · 2024-09-20 · in CuPy: NumPy and SciPy for GPU
  9. …to cater to CNN simulation for large language models, and basically not much more. [2] - https://github.com/eyalroz/cuda-api-wrappers/
    comment by einpoklum · 2024-07-20 · in Kompute – Vulkan Alternative to CUDA
  10. …code. For the host-side, I would like, at some point, to take the modern-C++ CUDA API wrappers ( https://github.com/eyalroz/cuda-api-wrappers/ ) and derive from them something which supports CUDA, OpenCL and maybe HIP/ROCm. Unfortunately,…
    comment by einpoklum · 2024-07-16 · in Run CUDA, unmodified, on AMD GPUs
  11. …also the Modern-C++ API wrappers, with automatic error checking, RAII resource control etc.; see: https://github.com/eyalroz/cuda-api-wrappers (due disclosure: I'm the author) 2. Implementing the _runtime_ API is not the right choice; it's…
    comment by einpoklum · 2023-07-01 · in VUDA: A Vulkan Implementation of CUDA
  12. …on the Rust side - don't you need a bunch of unsafe code in the library enabling GPU support? [1] : https://github.com/eyalroz/cuda-api-wrappers/
  13. …what you'll get with Rust. That is, provided you use my own Modern C++ wrappers for the CUDA APIs: https://github.com/eyalroz/cuda-api-wrappers/ :-) ... sorry for the shameless self-plug. * ... which brings me to another point: Richer…
    comment by einpoklum · 2023-01-21 · in GNU Octave
  14. …named. Also, the APIs are almost entirely (but not 100%) C'ish. In the API wrappers I've written: https://github.com/eyalroz/cuda-api-wrappers I try to address these and some other issues. We should also remember that NVIDIA artificially…
    comment by einpoklum · 2022-07-05 · in How CUDA Programming Works
  15. ▲ 1
    Thin C++-Flavored Wrappers for the CUDA APIs: Runtime, Driver, NVRTC and NVTX
    story by einpoklum · 2022-06-22 · 0 comments
  16. …helping the get-rich-quick "community". My own C++ wrappers for the CUDA APIs (shameless self-plug: https://github.com/eyalroz/cuda-api-wrappers/ ) would really benefit a lot from behind-the-curtains access to the driver; and even if I…
  17. …the NVIDIA side. Example of how bad: I had to write my own C++ bindings for the CUDA runtime API ( https://github.com/eyalroz/cuda-api-wrappers/ ). You'd think they would have that after 13 years of CUDA being available, right? Wrong. I…
    comment by einpoklum · 2021-09-25 · in AMD’s Lisa Su