Profile ONNX model performance with SME2 using KleidiAI and ONNX Runtime
Introduction
ONNX Runtime architecture with SME2 acceleration
Integration of KleidiAI to ORT MLAS
Build ONNX Runtime with KleidiAI and SME2 for Android
Profile ONNX model performance
Next Steps
Profile ONNX model performance with SME2 using KleidiAI and ONNX Runtime
Who is this for?
This is an advanced topic for software developers, performance engineers, and AI practitioners.
What will you learn?
Upon completion of this Learning Path, you will be able to:
- Build ONNX Runtime with KleidiAI and SME2 support for Android
- Profile ONNX model performance using benchmark tools
- Analyze how KleidiAI kernels accelerate ONNX operators with SME2
- Compare performance improvements between standard and SME2-optimized execution
Prerequisites
Before starting, you will need the following:
- An Android device with Arm SME2 support
- Basic understanding of machine learning model inference
- Familiarity with Android NDK and cross-compilation