Accelerate Generative AI workloads using KleidiAI
Introduction
KleidiAI and matrix multiplication
KleidiAI in a real software stack
Quantizing and packing micro-kernels
Review
Next Steps

  Log an issue

  Fork and edit

  Discuss on Discord

What you've learned

You should now know how to:

  • Describe how basic math operations power Large Language Models.
  • Describe how the KleidiAI micro-kernels speed up Generative AI inference performance.
  • Run a basic C++ matrix multiplication example to showcase the speedup that KleidiAI micro-kernels can deliver.

Knowledge Check

Which of these devices does KleidiAI NOT work on?

If your ML framework supports KleidiAI, you automatically benefit from its AI workload acceleration.

Which operation forms the foundation of deep neural network/GenAI computations?


Back
Next