Before you begin, make sure you have the following:
c8g.4xlarge (or larger)If you’re new to EC2, check out the Learning Path Getting Started with AWS .
To deploy the Arcee AFM-4.5B model, you need an EC2 instance running on Arm-based Graviton4 hardware.
To do this, start by signing in to the AWS Management Console , change to your preferred region, and navigate to the EC2 service.
From there, you can create an SSH key pair that allows you to connect to your instance securely.
Open the Key Pairs section under Network & Security in the sidebar, and create a new key pair named arcee-graviton4-key.
Next, select RSA as the key type, and .pem as the file format. Once you create the key, your browser will download the .pem file automatically.
To ensure the key remains secure and accessible, move the .pem file to your SSH configuration directory, and update its permissions to restrict access.
To do this, on macOS or Linux, run:
mkdir -p ~/.ssh
mv arcee-graviton4-key.pem ~/.ssh/
chmod 400 ~/.ssh/arcee-graviton4-key.pem
In the left sidebar of the EC2 dashboard, select Instances, and then Launch instances.
Use the following settings to configure your instance:
Arcee-Graviton4-Instancec8g.4xlarge or largerarcee-graviton4-key from the listTo enable internet access, choose a VPC with at least one public subnet.
Then select a public subnet from the list.
Under Auto-assign public IP, select Enable.
Select Create security group. Then select Allow SSH traffic from and select My IP.
You’ll only be able to connect to the instance from your current host, which is the most secure setting. Avoid selecting Anywhere unless absolutely necessary, as this setting allows anyone on the internet to attempt a connection.
You only need SSH access for this Learning Path. If you already have a security group that allows inbound SSH traffic, you can reuse it.
Set the root volume size to 128 GB, then select gp3 as the volume type.
Review all your configuration settings, and when you’re ready, select Launch instance to create your EC2 instance.
After a few seconds, you should see a confirmation message like this:
Successfully initiated launch of instance (i-xxxxxxxxxxxxxxxxx)
If the launch fails, double-check the instance type, permissions, and network settings.
To retrieve the connection details, go to the Instances list in the EC2 dashboard.
Then select your instance by selecting Instance ID.
In the Details tab, copy the Public DNS value - you’ll use this to connect through SSH.
Open a terminal and connect to the instance using the SSH key you downloaded earlier:
ssh -i ~/.ssh/arcee-graviton4-key.pem ubuntu@<PUBLIC_DNS_HOSTNAME>
When prompted, type yes to confirm the connection.
You should now be connected to your Ubuntu instance running on Graviton4.
Region: make sure you’re launching in your preferred AWS region.
AMI: confirm that the selected AMI supports the Arm64 architecture.
Security: for best practice, restrict SSH access to your own IP.
Storage: 128 GB is sufficient for the AFM-4.5B model and dependencies.
Backup: consider creating an AMI or snapshot after setup is complete.