Who is this for?
This Learning Path is for developers who want to run DeepSeek-R1 on Arm-based servers.
What will you learn?
Upon completion of this learning path, you will be able to:
- Clone and build llama.cpp on your Arm-based server.
- Download a pre-quantized DeepSeek-R1 model from Hugging Face.
- Run the model on your Arm CPU and benchmark its performance.
Prerequisites
Before starting, you will need the following:
- An
Arm-based instance
from a cloud provider or an on-premise Arm server. This Learning Path was tested on an AWS Graviton4 r8g.24xlarge instance.