Deploy SqueezeNet 1.0 INT8 model with ONNX Runtime on Azure Cobalt 100
Introduction
Overview
Create an Arm-based Azure Cobalt 100 virtual machine
ONNX Installation
Baseline Testing
Benchmark ONNX runtime performance with onnxruntime_perf_test
Next Steps
Deploy SqueezeNet 1.0 INT8 model with ONNX Runtime on Azure Cobalt 100
Who is this for?
This Learning Path is for developers deploying ONNX-based applications on Arm-based machines.
What will you learn?
Upon completion of this Learning Path, you will be able to:
- Provision an Azure Arm64 virtual machine using Azure console, with Ubuntu Pro 24.04 LTS as the base image
- Perform ONNX baseline testing and benchmarking on Arm64 virtual machines
Prerequisites
Before starting, you will need the following:
- A Microsoft Azure account with access to Cobalt 100 based instances (Dpsv6)
- Basic understanding of Python and machine learning concepts
- Familiarity with ONNX Runtime and Azure cloud services