Fine-tune PyTorch models on DGX Spark

About this Learning Path

Who is this for?

This is an advanced topic for AI developers and ML engineers who want to fine-tune large language models using PyTorch and Hugging Face on the NVIDIA DGX Spark platform.

What will you learn?

Upon completion of this Learning Path, you will be able to:

• Understand how fine-tuning teaches a model domain-specific knowledge
• Prepare a custom JSONL dataset for supervised fine-tuning
• Fine-tune Llama 3.2 3B on Raspberry Pi datasheet content using PyTorch and Hugging Face
• Compare base and fine-tuned model responses to verify factual accuracy improvements

Prerequisites

Before starting, you will need the following:

• Hugging Face account and access token
• NVIDIA DGX Spark workstation