Can the Neon DSP be used to optimize the AI algorithm? Does ARM provide an open source implementation ?
NEON can certainly be used to optimise all sorts of calculations and would help many AI calculations.
I am not aware of any implementations, but that does not mean they do not exist.
There is no such thing as "the AI algorithm". Many different algorithms and strategies are used in AI. There isn't even a really good definition of what AI is.