Review frequently asked questions
These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.
After configuring permissions, pull and run the pre-built PyTorch container as shown in the setup step. If it runs without permission errors, Docker is configured correctly.
The path fine-tunes Llama 3.2 3B using
Llama3_3B_full_finetuning.py. The The path uses the 8B example only to illustrate why fine-tuning improves factual responses.Use a JSONL dataset prepared for supervised fine-tuning. Ensure its fields match what the script loads; check the dataset loading section in the training script to align names and structure.
The process produces a fine-tuned Llama model that the testing step can load with vLLM. If you’re able to serve the model in the vLLM container without errors, the fine-tuning completed successfully.
On Raspberry Pi datasheet questions, the fine-tuned model should answer factual queries correctly. For example, it reports the RP2350 maximum clock as 150 MHz, while the base model might hallucinate a higher value.