Give feedback

How would you rate this Learning Path?

Review frequently asked questions

AI-assisted

These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.

Close
?
Which Azure VM size and OS image should I use?
Select D4ps_v6 from the Dpsv6 series powered by Azure Cobalt 100. Use the Ubuntu Pro 24.04 LTS image and select Arm64 as the VM architecture.
What do I need in place before running the baseline latency test?
Activate your Python virtual environment, have the baseline.py script ready, and ensure that the SqueezeNet INT8 model file is available as squeezenet-int8.onnx. Place the model in the same working directory as the script or provide its full path.
How do I know the baseline test worked correctly?
The script completes without errors and reports a timing result for a single inference through the SqueezeNet INT8 model. Successful execution confirms that ONNX Runtime is functioning on the VM.
When should I use onnxruntime_perf_test, and what output should I expect?
Use onnxruntime_perf_test after validating the Python baseline to capture more detailed performance statistics. Expect a summary of inference metrics that you can use to evaluate ONNX Runtime efficiency on the Azure Arm64 instance.
Does the baseline script use a real image as input?
No. The script uses data in float32 with shape (1, 3, 224, 224). This represents one input with three color channels and dimensions of 224 by 224 pixels. You’ll use this synthetic input to measure inference latency.

Share

Tell others about this Learning Path.

Back
Return to Servers and Cloud Computing