Explore related resources

Find more information about the topics in this Learning Path:

Give feedback

How would you rate this Learning Path?

Review frequently asked questions

AI-assisted

These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.

Close
?
Do I need to install or build any ML frameworks to run a model with Docker Model Runner?
No. Docker Model Runner uses llama.cpp, so you don’t need to download, build, or install LLM frameworks.
Which model should I choose for the example chat application?
The example supports local AI models such as Llama 3.2 or Gemma 3. Use a model available through Docker Model Runner in your environment.
What should I expect after starting the Docker Compose project?
Docker Compose brings up a Flask-based web frontend and a backend that serves AI responses through Docker Model Runner. You can enter a prompt and receive a generated reply.
How can I confirm that the model and services are running correctly?
Open the chat interface and send a prompt; a response indicates the backend is reachable and the model is active. If there’s no response, check the status of the container and logs in Docker Desktop.
Does local inference with Docker Model Runner require a cloud service?
No. The models run locally without cloud dependencies.

Share

Tell others about this Learning Path.

Back
Return to Laptops and Desktops