Arm Community
Site
Search
User
Site
Search
User
Groups
Education Hub
Distinguished Ambassadors
Open Source Software and Platforms
Research Collaboration and Enablement
Forums
AI and ML forum
Architectures and Processors forum
Arm Development Platforms forum
Arm Development Studio forum
Arm Virtual Hardware forum
Automotive forum
Compilers and Libraries forum
Graphics, Gaming, and VR forum
High Performance Computing (HPC) forum
Infrastructure Solutions forum
Internet of Things (IoT) forum
Keil forum
Morello forum
Operating Systems forum
SoC Design and Simulation forum
SystemReady Forum
Blogs
AI and ML blog
Announcements
Architectures and Processors blog
Automotive blog
Graphics, Gaming, and VR blog
High Performance Computing (HPC) blog
Infrastructure Solutions blog
Internet of Things (IoT) blog
Operating Systems blog
SoC Design and Simulation blog
Tools, Software and IDEs blog
Support
Arm Support Services
Documentation
Downloads
Training
Arm Approved program
Arm Design Reviews
Community Help
More
Cancel
Arm Community blogs
Infrastructure Solutions blog
Blogs
Mentions
Sub-Groups
Tags
Jump...
Cancel
Infrastructure Solutions blog
Tags
Subscribe by email
More
Cancel
By date
By view count
By comment count
Descending
Ascending
Google’s Axion Powered by Arm Neoverse: Faster Inference and Higher Performance for AI Workloads
Ashok Bhat
Google Axion is an excellent choice for AI inference, capable of handling a wide range of workloads from traditional machine learning tasks like XGBoost to generative AI applications such as LLaMa. Read…
October 30, 2024
Delivering the best H.265 video experience on Arm Neoverse N2 Platform
Willen Yang
H.265 video compression needs more power. Arm Neoverse N2 based Alibaba Yitian710 offers better performance and efficiency for video transcoding. Learn how to use x265 on Arm servers to benefit from this…
October 29, 2024
Running Llama 3 70B on the AWS Graviton4 CPU with Human Readable Performance
Na Li
In this blog, we compare the performance of AWS Graviton4 and AWS Graviton3 for running LLMs, and demonstrate how Llama 3 70B can be run with human readable performance on AWS Graviton4
October 21, 2024
A System Monitoring Control Framework (SMCF) for Arm Neoverse CSS
Marc Meunier
In this blog post, we provide an overview of the System Monitoring Control Framework (SMCF) for Arm-based SoCs. SMCF is a programmable control framework for the next generation silicon.
October 15, 2024
How Arm IT saved cost, space, and power with Ampere Altra-based HPE ProLiant RL300 Gen11 servers
Steve Demski
In this blog post, Arm IT shares how it has saved money, space, and power by deploying HPE RL300 Gen11 servers for its EDA workloads.
September 23, 2024
Demoing LLM Inference with PyTorch on Arm using Llama and AWS Graviton4
Nobel Chowdary Mandepudi
In this blog post, we show the steps for running a Llama 3.1 demo on AWS Graviton4, and how Arm Kleidi Technology can be used to improve the performance of LLMs running on PyTorch.
September 16, 2024
Faster PyTorch Inference using Kleidi on Arm Neoverse
Ashok Bhat
In this blog post, we review Kleidi Technology contributions Arm has made to the PyTorch framework and how these greatly improve PyTorch inference performance.
September 16, 2024
Kleidi Technology Delivers Best Price-Performance for ASR on Arm Neoverse N2
Willen Yang
In this blog post, we show how Kleidi Technology improves the performance of Automatic Speech Recognition on Neoverse N2-based Alibaba Yitian 710 CPUs, outperforming x86-based options.
September 16, 2024
Gain up to 36% performance benefits for deploying Elasticsearch on Alibaba Cloud Yitian 710 instances
Zhengjun Xing
This blog post highlights that G8Y outperforms G7, showing up to a 36% improvement in Elasticsearch performance on Alibaba Cloud Yitian 710 instances.
September 3, 2024
Accelerate Spark SQL on Arm64 with Gluten and Velox
Yuqi Gu
This blog post introduces an accelerator for Spark SQL. Experimental results highlight the potential of this approach for Spark SQL on Neoverse N2.
August 7, 2024
Yitian 710 outperforms Ice Lake up to 83% on Apache Flink
Bolt Liu
Apache Flink is a framework for stateful computations over data streams, performance benchmark shows Yitian 710 outperforms Ice Lake significantly.
July 29, 2024
Software profiling Arm Neoverse CPUs in the cloud
Peter Harris
The Streamline CLI Tools are free cloud-native performance analysis tools for software running on Arm Neoverse CPUs. Read this blog to learn more.
June 20, 2024
Accelerated LLM inference on Arm Neoverse N2
Willen Yang
In this blog post, we show how Alibaba Cloud customers can reduce LLM Inferencing cost per token by using Yitian 710-based instances.
June 18, 2024
Samsung and Arm join forces to pioneer next-generation communication technologies
Mo Jabbari
Samsung and Arm have announced a strategic partnership to develop next-generation communication technologies. Read more here.
June 12, 2024
Accelerating popular Hugging Face models using Arm Neoverse
Ashok Bhat
In this blog post, we show how sentiment analysis can be added to existing applications using Hugging Face and PyTorch models running on AWS Graviton3.
June 5, 2024
BOLT instrumentation brings 52% performance uplift for MongoDB on Neoverse N2
Bolt Liu
BOLT is a post-link optimization technology enabling performance improvement for various workloads. Read more in this post.
June 3, 2024
Best-in-class LLM performance on Arm Neoverse V1 based AWS Graviton3 CPUs
Ravi Malhotra
In this blog post, we demonstrate the performance and cost effectiveness of using Arm Neoverse-based CPUs for smaller large language models (LLMs) like Llama3.
May 22, 2024
Building pervasive infrastructure solutions with Red Hat on Arm
Yan Fisher
In this blog, we explore the latest release of Red Hat Enterprise Linux (RHEL) with improved support for Arm architecture.
May 1, 2024
Accelerated Networking on Arm
Willen Yang
Dataplane stack is an open source reference solution for building networking application and user cases with optimal configuration on Arm Neoverse platform.
March 28, 2024
BOLT optimization technology could bring obvious performance uplift on arm server
Bolt Liu
This blog illustrates how to enable BOLT on arm platform and the performance uplift after enabling it.
March 25, 2024
Achieving High Performance and Efficiency with Firewalls and Networking Workloads on Arm Neoverse
Marc Meunier
Firewalls need to be scalable, efficient, and cost-effective. The whitepaper shows the performance optimizations to make it effective.
March 6, 2024
>