Build an Android chat application with ONNX Runtime API
Introduction
Create a development environment
Build ONNX Runtime
Build ONNX Runtime Generate() API
Run a benchmark on an Android phone
Build and run an Android chat app
Review
Next Steps

  Log an issue

  Fork and edit

  Discuss on Discord

About this Learning Path

Skill level:  Advanced
Reading time:  1 hr
Last updated:  25 Oct 2024
Skill level:
  Advanced
Reading time:
  1 hr
Last updated:
  25 Oct 2024
Author:Koki Mitsunami, Arm
Arm IP:Cortex-A Cortex-X
Tags: ML Windows Android Kotlin C++ ONNX Runtime Android Mobile
Author:
Koki Mitsunami, Arm
Arm IP:
Cortex-A Cortex-X
Tags:
ML Windows Android Kotlin C++ ONNX Runtime Android Mobile

Who is this for?

This is an advanced topic for software developers interested in learning how to build an Android chat app with ONNX Runtime and ONNX Runtime Generate() API.

What will you learn?

Upon completion of this learning path, you will be able to:

  • Build ONNX Runtime and ONNX Runtime generate() API for Android.
  • Run a Phi-3 model using ONNX Runtime on an Arm-based smartphone.

Prerequisites

Before starting, you will need the following:

  • A Windows x86_64 development machine with at least 16GB of RAM.
  • An Android phone with at least 8GB of RAM. This learning path was tested on Samsung Galaxy S24.
Next