Who is this for?

This is an advanced topic for software developers, performance engineers, and AI practitioners.

What will you learn?

After completing this Learning Path, you'll be able to perform the following tasks:

  • Build ONNX Runtime with KleidiAI and SME2 support for Android
  • Profile ONNX model performance using benchmark tools
  • Analyze how KleidiAI kernels accelerate ONNX operators with SME2
  • Compare performance improvements between standard and SME2-optimized execution

Prerequisites

Before starting, you'll need the following prerequisites:

  • An Android device with Arm SME2 support
  • Basic understanding of machine learning model inference
  • Familiarity with Android NDK and cross-compilation

Summary

AI-assisted

This summary was drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.

Close
?
You’ll build ONNX Runtime for Android with KleidiAI SME2 microkernels and profile a model on a device. First, you’ll cross-compile with the Android NDK, deploy the binaries and model, and use onnxruntime_perf_test to capture baseline and SME2 results. Then, you’ll compare KleidiAI dispatch, operator execution, and end-to-end inference time with ResNet-50 v2.
Next