Build a real-time analytics pipeline with ClickHouse on Google Cloud Axion

About this Learning Path

Who is this for?

This is an introductory topic for developers deploying and optimizing ClickHouse on Arm-based Linux environments using Google Cloud C4A virtual machines powered by Axion processors, to evaluate ClickHouse performance and behavior on Arm-based infrastructure.

What will you learn?

Upon completion of this Learning Path, you will be able to:

• Provision an Arm-based SUSE SLES virtual machine on Google Cloud using C4A (Axion processors)
• Configure Google Cloud Pub/Sub for real-time log ingestion
• Deploy and validate ClickHouse on a SUSE Linux Arm64 (Axion) VM
• Build a streaming ETL pipeline using Apache Beam and Google Dataflow
• Ingest real-time Pub/Sub data into ClickHouse using Dataflow
• Validate end-to-end data flow from Pub/Sub to ClickHouse
• Perform baseline and analytical query benchmarking on ClickHouse running on Arm64
• Measure and report query latency (including p95) on Axion processors

Prerequisites

Before starting, you will need the following:

• A Google Cloud Platform (GCP) account with billing enabled
• Basic familiarity with ClickHouse
• Basic understanding of databases and SQL