Give feedback

How would you rate this Learning Path?

Review frequently asked questions

AI-assisted

These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.

Close
?
Which Axion machine type should I choose to follow the steps?
Use c4a-standard-16 or larger, as specified. Smaller types are not listed for this workflow.
What should I check in my Google Cloud project before launching the Axion VM?
Confirm that your project has quota for Axion instances and that sufficient storage is available. The Learning Path calls for at least 128 GB to accommodate the model and dependencies.
Which `llama.cpp` repository should I clone for AFM-4.5B?
Clone the standard upstream repository from ggerganov/llama.cpp. Arcee AI has contributed the required modeling code upstream, so you don’t need a custom fork.
How do I know the `llama.cpp` build on Axion completed successfully?
The build should finish without errors and produce binaries that run as shown in the steps. Invoking the tool to display its help or version is a quick validation before proceeding.
What result should I expect after quantization and a test inference?
Quantization produces a smaller model artifact that llama.cpp can load. A brief prompt should generate tokens without errors, and a perplexity run should complete with a numeric value.

Share

Tell others about this Learning Path.

Back
Return to Servers and Cloud Computing