Fine-tune SmolVLA for SO-101 on NVIDIA DGX Spark
Introduction
Understand the SmolVLA fine-tuning workflow
Install LeRobot and prepare a Python environment
Connect the SO-101 and cameras
Calibrate and teleoperate the SO-101
Record and validate a pick-and-place dataset
Fine-tune SmolVLA with the recorded SO-101 demonstrations
Evaluate the fine-tuned SmolVLA model
Next Steps
Fine-tune SmolVLA for SO-101 on NVIDIA DGX Spark
Introduction
Understand the SmolVLA fine-tuning workflow
Install LeRobot and prepare a Python environment
Connect the SO-101 and cameras
Calibrate and teleoperate the SO-101
Record and validate a pick-and-place dataset
Fine-tune SmolVLA with the recorded SO-101 demonstrations
Evaluate the fine-tuned SmolVLA model
Next Steps
Review frequently asked questions
These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.
Set
ROBOT_PORT, LEADER_PORT, GRIPPER_CAMERA_ID, and WORKSPACE_CAMERA_ID in the terminal that you’ll use for calibration. If you reconnect a USB device or open a new terminal, repeat device discovery and export the current paths before proceeding.Connect the SO-101 leader, SO-101 follower, gripper camera, and workspace camera to the DGX Spark over USB. Mount the gripper camera on the follower, and keep the workspace camera fixed to frame the follower, pickup area, rack, and the arm’s full range of motion.
Start each arm with its joints near the middle of their usable ranges. Move each requested joint slowly through its safe range, support the arm, and stop before reaching limits.
After calibrating and verifying teleoperation, arrange the two-camera workspace. Lay the vial on the black mat, place the rack beside it within the follower’s calibrated reach, and leave enough space between them for grasping and movement.
You’ll get a SmolVLA model adapted to your demonstrations. Evaluate it with LeRobot on the Arm-based NVIDIA DGX Spark, then use it to control the robot on the vial-to-rack pick-and-place task under the recorded conditions.