Arm Community
Arm Community
  • Site
  • User
  • Site
  • Search
  • User
Arm Community blogs
Arm Community blogs
AI blog Arm NN plugin framework
  • Blogs
  • Mentions
  • Sub-Groups
  • Tags
  • Jump...
  • Cancel
More blogs in Arm Community blogs
  • AI blog

  • Announcements

  • Architectures and Processors blog

  • Automotive blog

  • Embedded and Microcontrollers blog

  • Internet of Things (IoT) blog

  • Laptops and Desktops blog

  • Mobile, Graphics, and Gaming blog

  • Operating Systems blog

  • Servers and Cloud Computing blog

  • SoC Design and Simulation blog

  • Tools, Software and IDEs blog

Tags
  • Neural Network
  • Arm NN
  • Software Development Tools
Actions
  • RSS
  • More
  • Cancel
Related blog posts
Related forum threads

Arm NN plugin framework

Matteo Martincigh
Matteo Martincigh
November 21, 2019
1 minute read time.

Arm NN enables third parties to run neural network models on their custom inference hardware. It also allows the addition of new backends through the new ‘Pluggable Backend’ mechanism.

Arm NN's architecture has been extended to make a new backend API available to developers. They want to take advantage of Arm NN's high-level optimization and scheduling capabilities on their custom accelerated hardware.

Developers can plug new backends into an Arm NN build and instruct Arm NN's optimization. They can leverage them at runtime by selecting their new backends as a valid resource for running inference workloads.

The developers will also have control on which order the backends should be chosen for inference, or which fallback to resort to in case the execution of a particular part of the network is not possible or supported by the chosen hardware.

To get the most out of their dedicated hardware, third parties have the possibility to apply their own custom optimizations on the original neural network model, resulting in optimal performance.

Arm NN takes care of the rest.

The guide available provides detailed instructions on how to add your own specialized backend to Arm NN, and it provides a working example to help you getting started.

Access the ML platform

Anonymous
AI blog
  • Advancing PyTorch Performance on Arm: Key Enhancements in the 2.9 Release

    Ashok Bhat
    Ashok Bhat
    As part of the new PyTorch 2.9 release, Arm contributed key enhancements to ensure seamless performance and stability on Arm platforms. Learn more about the enhancements in this blog post.
    • October 15, 2025
  • Are you attending PyTorch Conference 2025?

    Michelle Yung
    Michelle Yung
    Join us on site at the PyTorch Conference 2025 on October 22-23 to learn how Arm empowers developers to build and deploy AI applications easily using PyTorch and ExecuTorch.
    • October 15, 2025
  • Unlocking AI Potential with Kleidi: Seamless Acceleration Workshop Recap

    Parichay Das
    Parichay Das
    Explore takeaways from our Kleidi AI workshop led by Arm Ambassador Parichay Das, where participants tackled performance gaps and future AI needs.
    • September 25, 2025