Run Phi-3 on Windows on Arm using ONNX Runtime

Who is this for?

This is an advanced topic for developers looking to build ONNX Runtime for Windows on Arm (WoA) and leverage the Generate() API to run Phi-3 inference with KleidiAI acceleration.

What will you learn?

Upon completion of this Learning Path, you will be able to:

• Build ONNX Runtime and enable the Generate() API for Windows on Arm.
• Run inference with a Phi-3 model using ONNX Runtime with KleidiAI acceleration.

Prerequisites

Before starting, you will need the following:

• A Windows on Arm computer such as a Lenovo Thinkpad X13 running Windows 11, or a Windows on Arm virtual machine .