Hi Team,
I am new to KleidiAI and wanted to understand few things on this? is it supports only matmul operations using SME? does it not support any other operations such pooling, depthwise convolution. If yes then I could not find any source in the github for the same? Also do let me know if it uses any other exetnsions to do its operations?
Hello!
KleidiAI also supports Neon, so that there is wide coverage of current devices that gain from it as well. Indeed there's currently greater Neon support than SME, although SME is rapidly catching up. The dot product extension and i8mm (both, like Neon, now very common) are also used for some microkernels.
Currently it is just MatMul as that was the most immediately required/desired. It is being actively expanded, and the aim will be to expand across other areas where it will provide significant speed-up, like convolutions. There's still more MatMul microkernels to do though. (I'm not a member of the Kleidi team, so don't know their roadmap for what will be released when).