# Provision your Graviton4 environment

## In this learning path

- [Introduction](https://learn.arm.com/learning-paths/servers-and-cloud-computing/arcee-foundation-model-on-aws/)
- [Overview](https://learn.arm.com/learning-paths/servers-and-cloud-computing/arcee-foundation-model-on-aws/00_overview/)
- [Provision your Graviton4 environment](https://learn.arm.com/learning-paths/servers-and-cloud-computing/arcee-foundation-model-on-aws/01_launching_a_graviton4_instance/)
- [Configure your Graviton4 environment](https://learn.arm.com/learning-paths/servers-and-cloud-computing/arcee-foundation-model-on-aws/02_setting_up_the_instance/)
- [Build Llama.cpp](https://learn.arm.com/learning-paths/servers-and-cloud-computing/arcee-foundation-model-on-aws/03_building_llama_cpp/)
- [Install Python dependencies](https://learn.arm.com/learning-paths/servers-and-cloud-computing/arcee-foundation-model-on-aws/04_install_python_dependencies_for_llama_cpp/)
- [Download and optimize the AFM-4.5B model](https://learn.arm.com/learning-paths/servers-and-cloud-computing/arcee-foundation-model-on-aws/05_downloading_and_optimizing_afm45b/)
- [Run inference with AFM-4.5B](https://learn.arm.com/learning-paths/servers-and-cloud-computing/arcee-foundation-model-on-aws/06_running_inference/)
- [Benchmark and evaluate the quantized models](https://learn.arm.com/learning-paths/servers-and-cloud-computing/arcee-foundation-model-on-aws/07_evaluating_the_quantized_models/)
- [Review what you built](https://learn.arm.com/learning-paths/servers-and-cloud-computing/arcee-foundation-model-on-aws/08_conclusion/)
- [Next Steps](https://learn.arm.com/learning-paths/servers-and-cloud-computing/arcee-foundation-model-on-aws/_next-steps/)

## Requirements
Before you begin, make sure you have the following:
- An AWS account
- Permission to launch a Graviton4 EC2 instance of type `c8g.4xlarge` (or larger)
- At least 128 GB of available storage

If you’re new to EC2, check out the Learning Path [Getting Started with AWS](https://learn.arm.com/learning-paths/servers-and-cloud-computing/csp/aws/).

## Create an SSH key pair
To deploy the Arcee AFM-4.5B model, you need an EC2 instance running on Arm-based Graviton4 hardware.

To do this, start by signing in to the [AWS Management Console](https://console.aws.amazon.com), change to your preferred region, and navigate to the **EC2** service.

From there, you can create an SSH key pair that allows you to connect to your instance securely.

## Set up secure access
Open the **Key Pairs** section under **Network & Security** in the sidebar, and create a new key pair named `arcee-graviton4-key`.

Next, select **RSA** as the key type, and **.pem** as the file format. Once you create the key, your browser will download the `.pem` file automatically.

To ensure the key remains secure and accessible, move the `.pem` file to your SSH configuration directory, and update its permissions to restrict access.

To do this, on macOS or Linux, run:
```bash
mkdir -p ~/.ssh
mv arcee-graviton4-key.pem ~/.ssh/
chmod 400 ~/.ssh/arcee-graviton4-key.pem
```

## Launch and configure the EC2 instance
In the left sidebar of the EC2 dashboard, select **Instances**, and then **Launch instances**.

Use the following settings to configure your instance:
- **Name**: `Arcee-Graviton4-Instance`
- **Application and OS image**:
  - Select the **Quick Start** tab
  - Select **Ubuntu Server 24.04 LTS (HVM), SSD Volume Type**
  - Ensure the architecture is set to **64-bit (ARM)**
- **Instance type**: select `c8g.4xlarge` or larger
- **Key pair name**: select `arcee-graviton4-key` from the list

## Configure network
To enable internet access, choose a VPC with at least one public subnet.

Then select a public subnet from the list.

Under **Auto-assign public IP**, select **Enable**.

## Configure firewall
Select **Create security group**. Then select **Allow SSH traffic from** and select **My IP**.

> Note: You’ll only be able to connect to the instance from your current host, which is the most secure setting. Avoid selecting **Anywhere** unless absolutely necessary, as this setting allows anyone on the internet to attempt a connection.  
> You only need SSH access for this Learning Path. If you already have a security group that allows inbound SSH traffic, you can reuse it.

## Configure storage
Set the **root volume size** to `128` GB, then select **gp3** as the volume type.

## Review and launch the instance
Review all your configuration settings, and when you’re ready, select **Launch instance** to create your EC2 instance.

## Monitor the instance launch
After a few seconds, you should see a confirmation message like this:
```
Successfully initiated launch of instance (i-xxxxxxxxxxxxxxxxx)
```

If the launch fails, double-check the instance type, permissions, and network settings.

To retrieve the connection details, go to the **Instances** list in the EC2 dashboard.

Then select your instance by selecting **Instance ID**.

In the **Details** tab, copy the **Public DNS** value - you’ll use this to connect through SSH.

## Connect to your instance
Open a terminal and connect to the instance using the SSH key you downloaded earlier:
```bash
ssh -i ~/.ssh/arcee-graviton4-key.pem ubuntu@<PUBLIC_DNS_HOSTNAME>
```

When prompted, type `yes` to confirm the connection.

You should now be connected to your Ubuntu instance running on Graviton4.

> Note: 
> - **Region**: make sure you’re launching in your preferred AWS region.
> - **AMI**: confirm that the selected AMI supports the Arm64 architecture.
> - **Security**: for best practice, restrict SSH access to your own IP.
> - **Storage**: 128 GB is sufficient for the AFM-4.5B model and dependencies.
> - **Backup**: consider creating an AMI or snapshot after setup is complete.