Build LlamaIndex RAG apps on Google Axion C4A
Introduction
Learn about LlamaIndex and Google Cloud C4A for RAG applications
Configure Google Cloud firewall rules for LlamaIndex
Create a Google Cloud C4A virtual machine for LlamaIndex
Install LlamaIndex on a Google Axion C4A VM
Build and test a browser-based RAG application with LlamaIndex
Next Steps
Build LlamaIndex RAG apps on Google Axion C4A
Review frequently asked questions
These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.
Open TCP port
8000. After you create the rule, verify that it applies to the VM’s VPC network, then open http://<VM-EXTERNAL-IP>:8000 after the app starts.Select
c4a-standard-4, which provides four vCPUs and 16 GB of memory.Install Python 3.11 after you refresh and update the system packages.
Submit a query from the browser interface and confirm that the response reflects your sample documents. Your FastAPI backend should call LlamaIndex, retrieve context from ChromaDB, and send that context to the local LLM through Ollama.
Confirm that the FastAPI server is running, the VM’s external IP is reachable, and the firewall rule for port
8000 is active. After confirming, open http://<VM-EXTERNAL-IP>:8000 again.