Scale AI workloads with Ray on Google Cloud C4A Axion VM
Introduction
Get started with Ray on Google Axion C4A
Create a firewall rule for Ray Dashboard and Serve
Create a Google Axion C4A Arm virtual machine on GCP
Deploy Ray on GCP SUSE Arm64
Run Distributed Workloads with Ray
Ray Tune, Serve, and Benchmarking
Next Steps

  Log an issue

  Fork and edit

  Discuss on Discord

Provision a Google Axion C4A Arm VM

In this section, you’ll create a Google Axion C4A Arm-based virtual machine on Google Cloud Platform. You’ll use the c4a-standard-4 machine type, which provides 4 vCPUs and 16 GB of memory. This VM will host your Ray application.

Note

For help with GCP setup, see the Learning Path Getting started with Google Cloud Platform .

Provision a Google Axion C4A Arm VM in Google Cloud Console

To create a virtual machine based on the C4A instance type:

  • Navigate to the Google Cloud Console .
  • Go to Compute Engine > VM Instances and select Create Instance.
  • Under Machine configuration:
    • Populate fields such as Instance name, Region, and Zone.
    • Set Series to C4A.
    • Select c4a-standard-4 for machine type.

Image Alt Text:Screenshot of the Google Cloud Console showing the Machine configuration section. The Series dropdown is set to C4A and the machine type c4a-standard-4 is selectedConfiguring machine type to C4A in Google Cloud Console

  • Under OS and storage, select Change, and then choose an Arm64-based operating system image.
    • For this Learning Path, select SUSE Linux Enterprise Server.
    • For the license type, choose Pay as you go.
    • Increase Size (GB) from 10 to 100 to allocate sufficient disk space.
    • Select Choose to apply the changes.
  • Expand the Networking section and enter allow-ray-ports in the Network tags field. This tag links the VM to the firewall rule you created earlier, enabling external access to the Ray Dashboard and Serve API ports.
  • Select Create to launch the virtual machine.

After the instance starts, select SSH next to the VM in the instance list to open a browser-based terminal session.

Image Alt Text:Google Cloud Console VM instances page showing the running C4A instance with a green status checkmark and the SSH button highlighted in the Connect columnConnecting to a running C4A VM using SSH

A new browser window opens with a terminal connected to your VM.

Image Alt Text:Browser-based SSH terminal window with black background showing Linux command prompt and Google Cloud branding at topTerminal session connected to the VM

What you’ve accomplished and what’s next

In this section, you provisioned a Google Axion C4A Arm VM and connected to it using SSH.

Next, you’ll install Ray and the required dependencies on your VM.

Back
Next