Explore related resources

Find more information about the topics in this Learning Path:

Give feedback

How would you rate this Learning Path?

Review frequently asked questions

AI-assisted

These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.

Close
?
Which Llama model variant should I download, and can I use a different one?
You should use the Llama 3.2 1B Instruct model. If you want to use a different model, you can adapt the same steps to other variants with minimal modification.
What output should I have after exporting the model for ExecuTorch?
You should produce a .pte file. This format is optimized for on-device inference and is loadable by the ExecuTorch runtime.
What should I check if the Android cross-compile step fails to find the toolchain?
Verify that ANDROID_NDK is set to the correct path and that build/cmake/android.toolchain.cmake exists there. Also confirm your ExecuTorch dependencies are installed in the Python environment.
How do I make sure KleidiAI acceleration is included in my Android build?
Build ExecuTorch and its libraries for Android with KleidiAI kernels enabled through XNNPACK. Use the provided CMake configuration to include these kernels.
What result should I expect when I run the chatbot on the phone?
The Llama runner or chat app should load the exported model and generate responses to prompts on the device.

Share

Tell others about this Learning Path.

Back
Return to Mobile, Graphics, and Gaming