Who is this for?

This is an introductory topic for developers who want to build a local, privacy-friendly AI agent on Arm hardware and visualize how the CPU orchestrates an agentic workflow around a locally served Large Language Model (LLM).

What will you learn?

After completing this Learning Path, you'll be able to perform the following tasks:

  • Set up a Python environment and obtain a Serper web search API key for the agent
  • Serve an LLM locally with Ollama and select a model that fits your hardware
  • Understand how the CPU orchestrates an agentic workflow while the GPU handles model inference
  • Run the agent and interpret the CPU and GPU timeline it produces for each query

Prerequisites

Before starting, you'll need the following prerequisites:

  • An Arm-based computer running Linux or macOS, such as an Apple silicon MacBook or an NVIDIA DGX Spark
  • Familiarity with running Python scripts from the terminal

Summary

AI-assisted

This summary was drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.

Close
?
You’ll run a local concierge agent on an Arm machine and examine how the workload splits between CPU orchestration and GPU-backed model inference. You’ll set up a Python environment, configure a Serper web search API key, and serve Gemma 3 locally with Ollama. As the agent answers your research-style questions, you’ll use its per-query timeline to see how much of web search, scraping, ranking, deduplication, and extraction runs on the CPU.