Who is this for?
This is an introductory topic for software developers interested in learning how to build an Android chat app with Llama, KleidiAI, ExecuTorch, and XNNPACK.
What will you learn?
Upon completion of this learning path, you will be able to:
- Set up an ExecuTorch development environment.
- Describe how ExecuTorch uses KleidiAI kernels to accelerate performance on Arm-based platforms.
- Describe how 4-bit groupwise PTQ quantization reduces model size without significantly sacrificing model accuracy.
- Build and run Llama models using ExecuTorch on your development machine.
- Build and run an Android Chat app with different Llama models using ExecuTorch on an Arm-based smartphone.
Prerequisites
Before starting, you will need the following:
- An Apple M1/M2 development machine with Android Studio installed or a Linux machine with at least 16GB of RAM.
- An Arm-powered smartphone with the i8mm feature running Android, with 16GB of RAM.
- A USB cable to connect your smartphone to your development machine.
- Android Debug Bridge (adb) installed on your device. Follow the steps in
adb
to install Android SDK Platform Tools. The adb tool is included in this package.
- Java 17 JDK. Follow the steps in
Java 17 JDK
to download and install JDK for host.
- Python 3.10.