DeepGEMM

Please don't slander the most open AI company in the world. Even more open than some non-profit labs from universities. DeepSeek is famous for publishing everything. They might take a bit to publish source code but it's almost always there. And their papers are extremely pro-social to help the broader open AI community. This is why they struggle getting funded because investors hate openness. And in China they struggle against the political and hiring power of the big tech companies. Just this week they published a serious foundational library for LLMs https://github.com/deepseek-ai/TileKernels Others worth mentioning: https://github.com/deepseek-ai/DeepGEMM a competitive foundational library https://github.com/deepseek-ai/Engram https://github.com/deepseek-ai/DeepSeek-V3 https://github.com/deepseek-ai/DeepSeek-R1 https://github.com/deeps

And the yield bit modification: https://github.com/deepseek-ai/DeepGEMM/blob/main/deep_gemm/...

The secret is here https://github.com/deepseek-ai/DeepGEMM/blob/main/deep_gemm%...

It seems mostly Python, which is nice: https://github.com/deepseek-ai/DeepGEMM/blob/main/deep_gemm/...

Github: https://github.com/deepseek-ai/DeepGEMM - Up to 1350+ FP8 TFLOPS on Hopper GPUs - No heavy dependency, as clean as a tutorial - Fully Just-In-Time compiled - Core logic at ~300 lines - yet outperforms expert-tuned kernels across most matrix sizes - Supports dense layout and two MoE layouts