Accelerate a voice assistant with KleidiAI and SME2
Introduction
Set up your environment
Overview
Build the Voice Assistant
Run the Voice Assistant
KleidiAI
Benchmark Voice Assistant
Performance
Performance with Streamline
Next Steps
Accelerate a voice assistant with KleidiAI and SME2
Who is this for?
This is an introductory topic for developers who want to implement a multimodal pipeline for a Voice Assistant application and accelerate the performance on Android devices using KleidiAI and SME2.
What will you learn?
After completing this Learning Path, you'll be able to perform the following tasks:
- Learn about the multimodal Voice Assistant pipeline and different components used.
- Learn about the functionality of ML components used and how these can be built and benchmarked on various platforms.
- Compile and run a multimodal Voice Assistant example based on Android OS.
- Optimize performance of multimodal Voice Assistant using KleidiAI and SME2.
Prerequisites
Before starting, you'll need the following prerequisites:
- An Android phone that supports the i8mm Arm architecture feature (8-bit integer matrix multiplication).
- An Android phone with support for SME (Scalable Matrix Extension) instructions, required for SME performance checking
- This Learning Path was tested on a Vivo X300 Pro.
- A development machine with Android Studio installed.
- Arm Performance Studio installed. Follow the Arm Performance Studio install guide for instructions.
Summary
This summary was drafted with an approved AI-assisted workflow and reviewed by Arm contributors before publication. Human technical review remains part of the process so the final page reflects engineering rigor, accuracy, and Arm editorial standards.
You’ll build and run a multimodal Voice Assistant on an Android device, then compare and profile its LLM performance with KleidiAI and SME2. First, you’ll install Android Studio and command-line dependencies, clone and build the app, and deploy it to your phone. Then, you’ll use its speech-to-text, local LLM, and Android text-to-speech pipeline, benchmark LLMs with and without SME2, and use Arm Streamline to inspect performance.