Who is this for?
This is an advanced topic for software developers, performance engineers, and AI practitioners
What will you learn?
Upon completion of this Learning Path, you will be able to:
- Build llama.cpp with KleidiAI and SME2 support
- Profile LLM inference performance on Android
- Understand how KleidiAI and SME2 accelerate LLM operators
Prerequisites
Before starting, you will need the following:
- Knowledge of KleidiAI and SME2
- A Linux host machine (x86_64 or aarch64) for building llama.cpp with the Arm GNU Toolchain
- Git, CMake, and Android Debug Bridge (ADB) installed on your host machine
- An Android device with Arm SME2 support for running and profiling the executable