About this Learning Path

Who is this for?

This is an introductory topic for anyone interested in running a local Large Language Model on a Raspberry Pi 5.

What will you learn?

Upon completion of this learning path, you will be able to:

  • Install the Python version of llama.cpp on your Raspberry Pi 5.
  • Download an LLM from Hugging Face.
  • Assess LLM memory size and performance.
  • Run the LLM on your Raspberry Pi 5 using Python bindings for llama.cpp.


Before starting, you will need the following:

  • A Raspberry Pi 5 running Raspberry Pi OS.