Who is this for?

This is for software developers and AI enthusiasts who want to run pre-trained AI models locally using Docker Model Runner.

What will you learn?

After completing this Learning Path, you'll be able to perform the following tasks:

  • Run AI models locally using Docker Model Runner.
  • Build containerized applications that integrate Large Language Models (LLMs).

Prerequisites

Before starting, you'll need the following prerequisites:

  • Docker Desktop (version 4.40 or later) installed on a system with at least 16GB of RAM (recommended).
  • Basic understanding of Docker CLI and concepts.
  • Familiarity with LLM concepts.

Summary

AI-assisted

This summary was drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.

Close
?
You’ll run pretrained LLMs locally with Docker Model Runner, then compose a Flask chat application around them. You’ll use the Model Runner extension with llama.cpp, clone the example repository, start the frontend and backend with Docker Compose, choose a supported model such as Llama 3.2 or Gemma 3, and verify the chat UI and container status.
Next