Profile ONNX model performance with SME2 using KleidiAI and ONNX Runtime

About this Learning Path

Who is this for?

This is an advanced topic for software developers, performance engineers, and AI practitioners.

What will you learn?

Upon completion of this Learning Path, you will be able to:

• Build ONNX Runtime with KleidiAI and SME2 support for Android
• Profile ONNX model performance using benchmark tools
• Analyze how KleidiAI kernels accelerate ONNX operators with SME2
• Compare performance improvements between standard and SME2-optimized execution

Prerequisites

Before starting, you will need the following:

• An Android device with Arm SME2 support
• Basic understanding of machine learning model inference
• Familiarity with Android NDK and cross-compilation