Who is this for?
This is an introductory topic for software developers who want to learn how to run and accelerate the performance of Natural Language Processing (NLP) models on Arm-based servers.
What will you learn?
Upon completion of this Learning Path, you will be able to:
- Deploy PyTorch NLP Sentiment Analysis models from Hugging Face on Arm servers.
- Evaluate the performance of three NLP models using the Sentiment Analysis pipeline.
- Measure the performance uplift of these models by enabling support for BFloat16 fast math kernels on Arm Neoverse-based AWS Graviton3 Processors.
Prerequisites
Before starting, you will need the following:
Summary
AI-assisted
This summary was drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication.
Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.
You’ll deploy Hugging Face Sentiment Analysis models with PyTorch on Arm servers and measure how they perform. Starting from a working Ubuntu 22.04 Arm environment, you’ll run three NLP models with the Sentiment Analysis pipeline, record baseline results, and enable BFloat16 fast math kernels to assess the impact on inference performance. By the end, you’ll compare before-and-after measurements to confirm the effect of BFloat16 on this workload.
Frequently asked questions
AI-assisted
These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication.
Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.
The instructions target an Arm server running Ubuntu 22.04 LTS. They’ve been tested on AWS Graviton3 (c7g) instances.
What system resources should I provision before running the steps?Use an Arm server instance with at least four CPU cores and 8 GB of RAM. This capacity supports running the three sentiment analysis models and collecting measurements.
Which framework and model source will I use in this Learning Path?You’ll uses PyTorch to run NLP Sentiment Analysis models sourced from Hugging Face.
How should I measure the performance uplift from BFloat16 fast math kernels?First, run the models to collect a baseline using the same Sentiment Analysis pipeline. Then enable BFloat16 fast math kernels on supported Arm Neoverse-based AWS Graviton3 processors, rerun the same workload, and compare measurements.
Which models will I evaluate and what should I have at the end?You’ll evaluate three NLP models with the Sentiment Analysis pipeline. By the end, you should have deployed the models on your Arm server and recorded baseline and BFloat16-enabled performance results for comparison.