open-gpu-kernel-modules

A semi related: a patch for those with multiple cards. You can unlock around 20% increased card to card speed on consumer GPUs using this library: https://github.com/aikitoria/open-gpu-kernel-modules The hardware supports it, but then Nvidia disabled it if the driver detects cheaper cards. This bypasses the NVidia slowdown.

I put it together myself. It was a lot of work and I learned a lot of nasty lessons along the way. The short version of the recipe: - get the largest PSU you can find (1500W at a minimum, more is better) - get the ADT PLX Quad PCIe backplane. Run 4 thin (single slot) GPUs inside your main enclosure, stick the ADT interface board in between two of the thin boards (don't stack them close to each other or they won't be able to breathe). - ensure you have as much or more RAM as you do VRAM - Ensure your CPU has enough PCIe lanes to run at least five boards in x16 (four for the GPUs in the main enclosure, another for the PLX PCIe switch) - In the BIOS set BAR1 to 'resizable' and > 4G decoding should be enabled. - ditch the cables that come with the ADT board, they may work but there are much better ones out there and they're not expensive, thi

For those who can't afford RTX 6000's you can unlock around 20% increased card to card speed on consumer GPUs using this library: https://github.com/aikitoria/open-gpu-kernel-modules The hardware supports it, but Nvidia disabled it if the driver detects cheaper cards.

Have you tried running it on a single 5090? Dual 5090 require https://github.com/aikitoria/open-gpu-kernel-modules for higher perf. Are you using TP?