Accelerate Denoising, Background Blur and Low-Light Camera Effects with KleidiAI and KleidiCV
Introduction
Prerequisites
Overview
Build the pipelines
Run the pipelines
Performance
Next Steps

  Log an issue

  Fork and edit

  Discuss on Discord

Accelerate Denoising, Background Blur and Low-Light Camera Effects with KleidiAI and KleidiCV

Download the AI camera pipelines project

Clone the project repository:

    

        
        
git clone https://git.gitlab.arm.com/kleidi/kleidi-examples/ai-camera-pipelines.git ai-camera-pipelines.git

Fetch the required large files using Git LFS:

    

        
        
cd ai-camera-pipelines.git
git lfs install
git lfs pull

Create a build container

Build the Docker container used to compile the pipelines:

    

        
        
docker build -t ai-camera-pipelines -f docker/Dockerfile \
  --build-arg DOCKERHUB_MIRROR=docker.io \
  --build-arg CI_UID=$(id -u) \
  docker/

Build the AI camera pipelines

Start a shell in the container you just built:

    

        
        
docker run --rm --volume $PWD:/home/cv-examples/example -it ai-camera-pipelines

Inside the container, run the following commands:

    

        
        
ENABLE_SME2=0
TENSORFLOW_GIT_TAG="v2.19.0"
# Build flatbuffers
git clone https://github.com/google/flatbuffers.git
cd flatbuffers
git checkout v24.3.25
mkdir build
cd build
cmake .. -DCMAKE_INSTALL_PREFIX=../install
cmake --build . -j16
cmake --install .
cd ../..

# Build the pipelines
mkdir build
cd build
cmake -GNinja -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=../install -DARMNN_TFLITE_PARSER=0 -DTENSORFLOW_GIT_TAG=$TENSORFLOW_GIT_TAG -DTFLITE_HOST_TOOLS_DIR=../flatbuffers/install/bin -DENABLE_SME2=$ENABLE_SME2 -DENABLE_KLEIDICV:BOOL=ON -DXNNPACK_ENABLE_KLEIDIAI:BOOL=ON -DCMAKE_TOOLCHAIN_FILE=toolchain.cmake -S ../example -B .
cmake --build . -j16
cmake --install .

# Package and export the pipelines.
cd ..
tar cfz example/install.tar.gz install

Leave the container by pressing Ctrl+D.

Notes on the CMake configuration options

The cmake command-line options relevant to this learning path are:

Command-line optionDescription
ENABLE_SME2=$ENABLE_SME2SME2 (Scalable Matrix Extension 2) is disabled in this build with ENABLE_SME2=0.
ARMNN_TFLITE_PARSER=0Configures the ai-camera-pipelines repository to use LiteRT with XNNPack instead of ArmNN.
ENABLE_KLEIDICV:BOOL=ONEnables KleidiCV for optimized image processing.
XNNPACK_ENABLE_KLEIDIAI:BOOL=ONEnables KleidiAI acceleration for LiteRT workloads via XNNPack.

Install the pipelines

    

        
        
cd $HOME
tar xfz ai-camera-pipelines.git/install.tar.gz
mv install ai-camera-pipelines

Dive deeper into the AI camera pipelines

The AI camera pipelines repository contains more information in its README file should you wish to dive deeper into it.

Back
Next