Who is this for?

This is an advanced topic for machine learning developers who want to export and quantize a vision-language-action model for ONNX Runtime on Arm.

What will you learn?

After completing this Learning Path, you'll be able to perform the following tasks:

  • Export SmolVLA from PyTorch as an ONNX model
  • Run and validate the FP32 ONNX model with ONNX Runtime on an Arm CPU
  • Quantize eligible linear weights to INT4 and store them in a packed ONNX model
  • Run the FP32 and INT4 models with identical inputs and compare their action outputs and ONNX Runtime latency

Prerequisites

Before starting, you'll need the following prerequisites:

  • An Arm Linux system, such as an Arm cloud instance or Radxa Orion O6, with Python 3.12 installed and at least 50 GB of free storage
  • Familiarity with Python, PyTorch, and Linux command-line tools

Summary

AI-assisted

This summary was drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.

Close
?
You’ll export SmolVLA from PyTorch to FP32 ONNX and validate it with ONNX Runtime on an Arm Linux CPU. First, you’ll set up the pinned model, source, and Python environment. Then, you’ll export the model and compare its output with PyTorch. Finally, you’ll quantize eligible linear weights to packed INT4 with TorchAO and compare FP32 and INT4 action outputs and latency using identical inputs.