Build LlamaIndex RAG apps on Google Axion C4A
Introduction
Learn about LlamaIndex and Google Cloud C4A for RAG applications
Configure Google Cloud firewall rules for LlamaIndex
Create a Google Cloud C4A virtual machine for LlamaIndex
Install LlamaIndex on a Google Axion C4A VM
Build and test a browser-based RAG application with LlamaIndex
Next Steps
Build LlamaIndex RAG apps on Google Axion C4A
Who is this for?
This is an introductory topic for DevOps engineers, AI engineers, machine learning engineers, and software developers who want to build retrieval-augmented generation (RAG) applications using LlamaIndex on SUSE Linux Enterprise Server (SLES) Arm64, integrate vector databases, and query custom documents using local large language models (LLMs).
What will you learn?
After completing this Learning Path, you'll be able to perform the following tasks:
- Install and configure LlamaIndex on Google Cloud C4A Axion processors for Arm64.
- Build indexing and retrieval pipelines using LlamaIndex.
- Integrate ChromaDB vector databases with local LLMs using Ollama.
- Build and test a browser-based RAG application using FastAPI.
Prerequisites
Before starting, you'll need the following prerequisites:
- A Google Cloud Platform (GCP) account with billing enabled
- Basic familiarity with Python, as well as AI and LLM concepts
Summary
This summary was drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.
You’ll build a RAG application on a Google Axion C4A virtual machine (VM). First, you’ll configure SUSE Linux, Python 3.11, LlamaIndex, Ollama, and ChromaDB. Then, you’ll create a FastAPI backend and browser interface. You’ll add sample documents, connect the indexing and retrieval pipeline, and submit browser queries. Finally, you’ll observe how LlamaIndex retrieves context from ChromaDB and sends it to your local model for grounded responses.