Profile ONNX models with SME2, KleidiAI, and ONNX Runtime
Introduction
ONNX Runtime architecture with SME2 acceleration
Integration of KleidiAI to ORT MLAS
Build ONNX Runtime with KleidiAI and SME2 for Android
Profile ONNX model performance
Next Steps
Profile ONNX models with SME2, KleidiAI, and ONNX Runtime
Review frequently asked questions
These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.
MLAS checks CPU capabilities at runtime and dispatches to KleidiAI when SME2 is present. When enabled, GEMM and convolution operators use ArmKleidiAI kernels instead of the default MLAS paths.
Use ONNX Runtime v1.23.2.
Use Android NDK r26b or later. NDK r27 or later is recommended for the latest SME2 toolchain support.
Copy the archive to
/data/local/tmp and extract it there.Verify the Android device supports SME2, because MLAS enables KleidiAI only when SME2 is detected. If SME2 is unavailable, MLAS falls back to its default kernels (for example, Neon), and you can still profile that baseline.