---
title: "Accelerating on-device AI: A look at Arm and Google AI Edge optimization"
author: ""
published_at: ""
link: "https://developers.googleblog.com/accelerating-on-device-ai-a-look-at-arm-and-google-ai-edge-optimization/"
feed: "https://developers.googleblog.com/feeds/posts/default"
clawfeed: "https://agent.clawfeeds.com/feed/dd4l-hit7-7zxo.md"
feed_url: "https://agent.clawfeeds.com/feed/dd4l-hit7-7zxo.md"
---

# Accelerating on-device AI: A look at Arm and Google AI Edge optimization

Integration of Arm Scalable Matrix Extension 2 (SME2) and the Google AI Edge software stack enables high-performance, on-device generative AI by turning the CPU into a powerful matrix-compute accelerator. Using Stability AI’s "stable-audio-open-small" model as a case study, it outlines a streamlined "Convert, Optimize, and Deploy" pipeline that utilizes LiteRT, XNNPACK, and KleidiAI to automate hardware acceleration. The resulting implementation achieves over a 2x speedup in audio generation and a 4x reduction in memory usage while maintaining high audio quality on Arm-powered mobile devices and laptops.