Accelerate LiteRT Models on Android with KleidiAI and SME2

About this Learning Path

Who is this for?

This is an advanced topic for developers looking to leverage Arm's Scalable Matrix Extension 2 (SME2) instructions to accelerate LiteRT model inference on Android.

What will you learn?

Upon completion of this Learning Path, you will be able to:

• Understand how KleidiAI integrates with LiteRT
• Build the LiteRT benchmark tool and enable XNNPACK and KleidiAI with SME2 support in LiteRT
• Create LiteRT models that can be accelerated by SME2 through KleidiAI
• Use the benchmark tool to evaluate and validate the SME2 acceleration performance of LiteRT models

Prerequisites

Before starting, you will need the following:

• An Arm64 Linux development machine
• An Android device that supports Arm SME2 architecture features - see this list of devices with SME2 support