neural-redis

Hello, I always used to play with AI. I wrote this, some time ago, just to make an example: https://github.com/antirez/gguf-tools And I have a YouTube channel mostly about AI (in Italian language) where I regularly post videos and often read papers that I then explain in the channel. I have a long time passion about AI, I wrote my first NN implementation in 2003 (used here, many years ago, as a showcase of Redis modules https://github.com/antirez/neural-redis), and never stopped since there to implement, for fun, small GPT models and things like that, using PyTorch or C. Also my work at Redis Vector Sets, in the latest year, exposed me more to working with models (especially text embedding models of many kinds, but also other models). So while Claude was fundamental to get the implementation fast, I had background to have idea about what

There was also this neural network module in redis if you want to do training and inference in a redid DB. (quite old btw) https://github.com/antirez/neural-redis

It's quoted on the neural-redis README[1] and attributed to Mike Townsend[2]. [1]https://github.com/antirez/neural-redis [2]https://twitter.com/Mikettownsend/status/780453119238955008

Assuming this is your code: https://github.com/antirez/neural-redis/blob/master/nn.c You're really just implementing a vector*matrix multiply. You probably want to just use BLAS's sgemv routine. On macOS, link Accelerate and use cblas_sgemv(); on Linux consider installing Intel MKL or OpenBLAS. If you're just looking to learn what a reasonably state-of-the-art SGEMV kernel looks like for a modern chip like Haswell, check out OpenBLAS's code: https://github.com/xianyi/OpenBLAS/blob/develop/kernel/x86_6...