Who is this for?

This is an introductory topic for software developers who want to create a retrieval-augmented generation (RAG) application on Arm servers.

What will you learn?

After completing this Learning Path, you'll be able to perform the following tasks:

  • Create a RAG application using Zilliz Cloud.
  • Launch a large language model (LLM) service on Arm servers.

Prerequisites

Before starting, you'll need the following prerequisites:

  • A basic understanding of a RAG pipeline
  • An AWS Graviton3 C7g.2xlarge instance, or any Arm-based instance from a cloud service provider or an on-premise Arm server
  • A Zilliz account , which you can sign up for with a free trial

Summary

AI-assisted

This summary was drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.

Close
?
You’ll build a RAG workflow on Arm with Zilliz Cloud and llama.cpp. First, you’ll create a dedicated Zilliz Cloud cluster on Arm-based machines, then build a local llama.cpp server with an OpenAI-compatible API. You’ll use Python to create and inspect an embedding, connect to the local model endpoint, and issue test requests. Finally, you’ll validate vector search in Zilliz Cloud and local model inference on your Arm server.
Next