# Build a RAG pipeline on Arm-based NVIDIA DGX Spark

## In this learning path

- [Introduction](https://learn.arm.com/learning-paths/laptops-and-desktops/dgx_spark_rag/)
- [Explore building a RAG pipeline on Arm-based Grace–Blackwell systems](https://learn.arm.com/learning-paths/laptops-and-desktops/dgx_spark_rag/1_rag/)
- [Configure the RAG development environment and models](https://learn.arm.com/learning-paths/laptops-and-desktops/dgx_spark_rag/2_rag_setup/)
- [Add documents to the RAG vector database](https://learn.arm.com/learning-paths/laptops-and-desktops/dgx_spark_rag/2b_rag_setup/)
- [Build and run the RAG pipeline](https://learn.arm.com/learning-paths/laptops-and-desktops/dgx_spark_rag/3_rag_pipeline/)
- [Monitor unified memory performance](https://learn.arm.com/learning-paths/laptops-and-desktops/dgx_spark_rag/4_rag_memory_observation/)
- [Next Steps](https://learn.arm.com/learning-paths/laptops-and-desktops/dgx_spark_rag/_next-steps/)

## About this Learning Path

|  |  |
| --- | --- |
| Skill level: | Advanced |
| Reading time: | 1 hr |
| Last updated: | 12 Nov 2026 |

|  |  |
| --- | --- |
| Author: | Odin Shen , Arm<br>[GitHub](https://github.com/odincodeshen)<br>[LinkedIn](https://linkedin.com/in/odin-shen-lmshen) |
| Arm IP: | [Cortex-A](https://support.arm.com/?tab=compute-ip&Product%20Type=Application%20Processors) |
| Tags: | [AI/ML](https://learn.arm.com/tag/ai-ml/) [Linux](https://learn.arm.com/tag/linux) [Python](https://learn.arm.com/tag/python) [llama.cpp](https://learn.arm.com/tag/llama.cpp) [Hugging Face](https://learn.arm.com/tag/hugging-face) |

### Who is this for?
This is an advanced topic for developers who want to build a Retrieval-Augmented Generation (RAG) pipeline on the NVIDIA DGX Spark platform. You'll learn how Arm-based Grace CPUs handle document retrieval and orchestration, while Blackwell GPUs speed up large language model inference using the open-source llama.cpp REST server. This is a great fit if you're interested in combining Arm CPU management with GPU-accelerated AI workloads.

### What will you learn?
After completing this Learning Path, you'll be able to perform the following tasks:

- Describe how a RAG system combines document retrieval and language model generation
- Deploy a hybrid CPU-GPU RAG pipeline on the GB10 platform using open-source tools
- Use the llama.cpp REST Server for GPU-accelerated inference with CPU-managed retrieval
- Build a reproducible RAG application that demonstrates efficient hybrid computing

### Prerequisites
Before starting, you'll need the following prerequisites:

- An NVIDIA DGX Spark system with at least 15 GB of available disk space

### Summary
You’ll build a Retrieval-Augmented Generation (RAG) pipeline on an Arm-based NVIDIA DGX Spark. You’ll prepare embedding and Llama 3.1 8B Instruct models, clean and chunk a sample corpus, create a FAISS index on the Grace CPU, and connect retrieval to GPU inference through the `llama.cpp` REST server. You’ll run queries and monitor unified memory during active RAG requests.
