Explore related resources

Find more information about the topics in this Learning Path:

Give feedback

How would you rate this Learning Path?

Review frequently asked questions

AI-assisted

These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.

Close
?
Do I need to complete the quantized LLM Learning Path before starting this one?
Complete the Learning Path Unlock quantized LLM performance on Arm-based NVIDIA DGX Spark first. That background covers CPU and GPU builds of llama.cpp used in this RAG solution.
Which models should I use for embeddings and generation in this RAG pipeline?
Use e5-base-v2 for embeddings and Llama 3.1 8B Instruct for generation. These models are prepared during the environment setup steps.
What should I expect after preparing documents and building the FAISS index?
The workflow converts your documents into clean, chunked text segments, then vectorizes and indexes them with FAISS. The result is a searchable vector database that returns the most relevant chunks for a query.
How do I know the retrieval and generation components are integrated correctly?
Run a query and confirm the response reflects information from your loaded documentation. Retrieval and indexing run on the Arm Grace CPUs, and generation uses the llama.cpp REST server on Blackwell GPUs.
What should I look for when monitoring unified memory performance on GB10?
Start from an idle state, then launch the model server and issue a query while observing system memory and GPU activity. You should see changes between idle and active states that align with zero-copy data sharing and hybrid AI inference described in the steps.

Share

Tell others about this Learning Path.

Back
Return to Laptops and Desktops