Give feedback

How would you rate this Learning Path?

Review frequently asked questions

AI-assisted

These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.

Close
?
Which compiler and toolchain should I use to build with SME2?
Use the aarch64 GCC cross-compile toolchain with the aarch64-none-linux-gnu- prefix from the Linux-hosted Arm GNU Toolchain. You need GCC version 14.2 or later to enable SME2.
Why do I need a Linux host to build llama.cpp?
The build uses the Linux-hosted Arm GNU Toolchain. If you work on macOS or Windows, run the commands in a Linux virtual machine, container, or development machine.
What files must be on the Android device before measuring performance?
Place the built llama-cli executable and the Llama-3.2-3B-Instruct-Q4_0.gguf model on the device.
How do I verify that the SME2 path is used during inference?
Follow the verification step that confirms SME2 microkernels are active. The ggml-cpu backend selects KleidiAI SME2 microkernels when the hardware supports them.
How should I compare runs with SME2 enabled and disabled?
Run the model on the Android device twice — once with SME2 enabled and once with it disabled. Compare the performance reported by llama.cpp from both runs.

Share

Tell others about this Learning Path.

Back
Return to Mobile, Graphics, and Gaming