Accelerate LiteRT Models on Android with KleidiAI and SME2
Introduction
Explore LiteRT, XNNPACK, KleidiAI, and SME2
Create LiteRT models
Build the LiteRT benchmark tool
Benchmark the LiteRT model
Next Steps
Accelerate LiteRT Models on Android with KleidiAI and SME2
Review frequently asked questions
These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.
Copy your LiteRT model file and two
benchmark_model binaries to the device: one built with KleidiAI and SME2 enabled and one baseline build. Run both against the same model on the same device.From an
adb shell, run cat /proc/cpuinfo and look for sme2 in the Features line. If it is present, the CPU supports SME2.Only the subset of KleidiAI SME2 micro-kernels integrated into XNNPACK are accelerated. Operators outside the supported data types and quantization configurations use XNNPACK’s default implementation.
The SME2-enabled binary demonstrates performance gains for models that use supported operators and data types. Both runs should complete successfully so you can compare their reported measurements.
Verify the device reports SME2 support, and confirm your model uses the supported operator configurations. Also ensure you ran the SME2-enabled binary under the same conditions as the baseline.