Explore related resources

Find more information about the topics in this Learning Path:

Give feedback

How would you rate this Learning Path?

Review frequently asked questions

AI-assisted

These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.

Close
?
Which Phi-3 model variant should I use for this path?
Use the Phi-3 Mini (3.3B) short-context (4K) ONNX model, which is quantized to 4 bits.
How do I know ONNX Runtime built correctly for Windows on Arm?
Confirm the build completes without errors and produces the expected binaries for WoA. If the build succeeds, proceed to build the Generate() API and run the model runner.
How can I confirm the Generate() API is available in my setup?
Build the onnxruntime-genai source and use the provided runner to generate text. Successful text generation indicates the Generate() API is correctly integrated.
What result should I expect when running the model runner?
Expect generated text from the Phi-3 Mini model along with performance metrics printed by the runner. If output appears without errors, continue to experiment with prompts.
Do I need to configure KleidiAI separately?
No. The path builds and runs ONNX Runtime with KleidiAI acceleration, and it doesn’t list any additional KleidiAI configuration.

Share

Tell others about this Learning Path.

Back
Return to Laptops and Desktops