Add an LLM to your Android app with Arm's AI Chat library

Who is this for?

This is an introductory topic for developers who want to add a local, on-device LLM chat experience using Arm's AI Chat library, Kotlin, and Android Studio.

What will you learn?

Upon completion of this Learning Path, you will be able to:

• Create a simple Android chatbot app scaffold in Android Studio
• Load a mobile-friendly GGUF model on-device and run streamed chat inference

Prerequisites

Before starting, you will need the following:

• An Android development environment with Android Studio installed
• An Android phone for testing, in Developer Mode, with USB cable for connection
• Basic familiarity with Kotlin and Android app development