Who is this for?
This is an introductory topic for developers, data engineers, and platform engineers who want to build high-performance data pipelines and analytics systems using Alluxio on Arm-based cloud environments.
What will you learn?
After completing this Learning Path, you'll be able to perform the following tasks:
- Install and configure Alluxio on Azure Cobalt 100 Arm64 virtual machines
- Configure data caching using Alluxio memory storage
- Integrate Alluxio with Apache Spark for analytics workloads
- Benchmark data access performance and understand caching benefits
Prerequisites
Before starting, you'll need the following prerequisites:
- A Microsoft Azure account with access to Cobalt 100 based instances (Dpsv6)
- Basic knowledge of Linux command-line operations
- Familiarity with SSH and remote server access
- Basic understanding of data processing, storage systems, and caching concepts
Summary
This summary was drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.
You’ll deploy Alluxio on an Arm-based virtual machine powered by Azure Cobalt 100 and use it as a data orchestration and caching layer for Apache Spark. After creating a Dpsv6 VM, you’ll enable the Alluxio Web UI by adding an inbound rule for TCP port 19999 in the Azure Network Security Group. You’ll install and configure Alluxio with local storage and memory-backed caching, then install Apache Spark under
/opt and configure Spark to read through Alluxio. The result is a set of read workloads comparing uncached and cached access that you can use to interpret the impact of in-memory caching on analytics tasks.