Fine-tune SmolVLA for SO-101 on NVIDIA DGX Spark
Introduction
Understand the SmolVLA fine-tuning workflow
Install LeRobot and prepare a Python environment
Connect the SO-101 and cameras
Calibrate and teleoperate the SO-101
Record and validate a pick-and-place dataset
Fine-tune SmolVLA with the recorded SO-101 demonstrations
Evaluate the fine-tuned SmolVLA model
Next Steps
Fine-tune SmolVLA for SO-101 on NVIDIA DGX Spark
Introduction
Understand the SmolVLA fine-tuning workflow
Install LeRobot and prepare a Python environment
Connect the SO-101 and cameras
Calibrate and teleoperate the SO-101
Record and validate a pick-and-place dataset
Fine-tune SmolVLA with the recorded SO-101 demonstrations
Evaluate the fine-tuned SmolVLA model
Next Steps
Who is this for?
This is an advanced topic for robotics and AI developers who want to train a vision-language-action model from their own SO-101 demonstrations.
What will you learn?
After completing this Learning Path, you'll be able to perform the following tasks:
- Set up a LeRobot environment for SO-101 data collection and SmolVLA training.
- Connect, calibrate, and teleoperate an SO-101 leader-follower pair with cameras.
- Record and inspect a pick-and-place dataset, then optionally upload it.
- Fine-tune and physically evaluate a SmolVLA model on an NVIDIA DGX Spark.
Prerequisites
Before starting, you'll need the following prerequisites:
- An NVIDIA DGX Spark with at least 30 GB of free storage
- An assembled SO-101 leader and follower, two USB cameras, and an unobstructed workspace
- A vial or similar graspable object and a stable rack for the placement target
- A black task mat or similarly high-contrast pickup surface
- A Hugging Face account if you want to upload the dataset
Summary
This summary was drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.