Visualize Arm CPU orchestration with Ollama and a local AI agent
Introduction
Understand the agent and how work is split between CPU and GPU
Set up your environment before running the agent
Serve a model locally with Ollama
Understand the concierge agent code
Run the agent and read the timeline
Understand the CPU's role in the agentic workflow
Next Steps
Visualize Arm CPU orchestration with Ollama and a local AI agent
Who is this for?
This is an introductory topic for developers who want to build a local, privacy-friendly AI agent on Arm hardware and visualize how the CPU orchestrates an agentic workflow around a locally served Large Language Model (LLM).
What will you learn?
After completing this Learning Path, you'll be able to perform the following tasks:
- Set up a Python environment and obtain a Serper web search API key for the agent
- Serve an LLM locally with Ollama and select a model that fits your hardware
- Understand how the CPU orchestrates an agentic workflow while the GPU handles model inference
- Run the agent and interpret the CPU and GPU timeline it produces for each query
Prerequisites
Before starting, you'll need the following prerequisites:
- An Arm-based computer running Linux or macOS, such as an Apple silicon MacBook or an NVIDIA DGX Spark
- Familiarity with running Python scripts from the terminal
Summary
This summary was drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.
You’ll run a local concierge agent on an Arm machine and examine how the workload splits between CPU orchestration and GPU-backed model inference. You’ll set up a Python environment, configure a Serper web search API key, and serve Gemma 3 locally with Ollama. As the agent answers your research-style questions, you’ll use its per-query timeline to see how much of web search, scraping, ranking, deduplication, and extraction runs on the CPU.