HIPCC

Not sure if I completely understand what "Ryzen AI" does, but tinygrad for example has some limited support for RDNA3[0]. It isn't quite there yet in matters of performance though, as you can read in the comments of that file. There's also a small tutorial by AMD on how to use the WMMA intrinsics[1] using their hipcc[2] compiler. Documentation is sparse kinda sparse, but the instruction set is not huge. The RDNA3 ISA guide[3] might also be helpful (and only a fraction of the pages are relevant.) So it doesn't seem like RE is necessary? AMD dumped most code on GitHub. 0. https://github.com/tinygrad/tinygrad/blob/master/extra/gemm/... 1. https://gpuopen.com/learn/wmma_on_rdna3/ 2. https://github.com/ROCm/HIPCC 3. https://www.amd.com/content/dam/amd/en/documents/radeon-tech...

> what would be the point for someone to add ROCm support to various pieces of software which currently require CUDA It isn't just old cards though, CUDA is a point of centralization on a single provider during a time when access to that providers higher end cards isn't even available and that is causing people to look elsewhere. ROCm supports CUDA through the included HIP projects... https://github.com/ROCm/HIP https://github.com/ROCm/HIPCC https://github.com/ROCm/HIPIFY The later will regex replace your CUDA methods with HIP methods. If it is as easy as running hipify on your codebase (or just coding to HIP apis), it certainly makes sense to do so.