Run a local LLM chatbot on a Raspberry Pi 5
Introduction
Run a Large Language Model (LLM) chatbot on a Raspberry Pi 5
Next Steps
Run a local LLM chatbot on a Raspberry Pi 5
Who is this for?
This is an introductory topic for anyone interested in running a local Large Language Model on a Raspberry Pi 5.
What will you learn?
Upon completion of this Learning Path, you will be able to:
- Install the Python version of llama.cpp on your Raspberry Pi 5.
- Download an LLM from Hugging Face.
- Assess LLM memory size and performance.
- Run the LLM on your Raspberry Pi 5 using Python bindings for llama.cpp.
Prerequisites
Before starting, you will need the following:
- A Raspberry Pi 5 running Raspberry Pi OS.