Give feedback

How would you rate this Learning Path?

Review frequently asked questions

AI-assisted

These FAQs were drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.

Close
?
What Arm server do I need before starting?
Use an Arm server with Ubuntu 24.04 LTS, at least 16 cores, 64 GB of memory, and 50 GB of storage. You can use the tested AWS Graviton4 r8g.4xlarge setup as reference.
Which model do I download?
Download Meta Llama 3.1 from its Meta repository on Hugging Face.
Which Python environment do I activate for the frontend?
Run source torch_env/bin/activate before you install the frontend dependencies.
How do I resolve the httpx proxies error?
Install httpx==0.27.2, then restart the frontend.
How do I check that the chatbot works end to end?
Start the Torchchat backend and Streamlit frontend. Open the web interface, enter a prompt, and check that you receive a model response.

Share

Tell others about this Learning Path.

Return to Servers and Cloud Computing