xdna

A close-to-metal Python API for programming AMD Ryzen™ AI NPUs (AI Engines), built on an open-source MLIR-based compiler toolchain.

Close-to-metal Python API for AMD Ryzen™ AI NPUs, built on MLIR-AIE: declare operators, compile them into graphs, autotune them, and run models entirely on the NPU.

useful Gentoo overlay Curated ebuilds, AI, tools & science

Open-source bring-up + verified matmul on the first-gen AMD XDNA1 (Phoenix/Hawk Point) NPU on Linux — the gen FastFlowLM/Lemonade skip. RyzenAI-npu1, mlir-aie/IRON, XRT.

Run LLMs and Ollama Qwen across AMD XDNA1 NPU, CPU, and GPU on Ryzen AI Linux systems.

Transport-neutral, vendor-agnostic virtual accelerator devices. First class cross-platform NPU backend support for Apple, Intel, AMD, Qualcomm devices, as well as Vulkan for cross-platform GPU support.

Fedora COPR packaging for FastFlowLM - Run LLMs on AMD Ryzen AI NPUs

Practical applications for the AMD XDNA NPU on Linux — webcam effects (working) + embeddings/audio/ggml roadmap. Built on open-xdna.

Stable Diffusion image generation on AMD Ryzen AI NPUs for Linux

AI Engine RunTime, lite: language models and image generation on the NPU of AMD Ryzen AI processors

LLM and speech-to-text on the AMD Ryzen AI NPU with custom AI Engine kernels: LFM2.5-230M at 58 tok/s, Parakeet TDT 0.6B encoder at 185 ms per 10 s audio with FP32 accuracy. IRON/MLIR-AIE, XRT.

A lightweight TUI monitor for AMD Ryzen AI NPUs

Detect, validate, enable and assess the AMD XDNA NPU on Linux. Dependency-free. Gives an honest, machine-specific LLM-feasibility verdict for XDNA 1 (Phoenix) vs XDNA 2 (Strix).

Unlocking the power of the Halo NPU: NPU + iGPU live verification, compression, and routing research on AMD Strix Halo

Open, reproducible AMD XDNA1 + Strix Point XDNA2 compute on Linux: pinned builds, CPU-reference checks, persistent C/Python runners, and an LLM roadmap.

Whisper encoder on the AMD XDNA1 NPU (Ryzen AI, Phoenix) under Linux — open toolchain only: XRT, MLIR-AIE/IRON, peano. Includes an HTTP service speaking whisper.cpp's contract.

Fix for AMD XDNA NPU driver on Ryzen AI 300 (Strix Point/Halo) — SMU init bypass patch, systemd auto-loader, full root cause analysis

Bazarr subtitles with XDNA1: Whisper on the AMD XDNA1 NPU (Ryzen 7 8845HS) with word timestamps, VAD, lyrics, speaker diarization and the whisper-asr-webservice API

Experiments, notes, and benchmarks for AMD Ryzen AI (Krackan Point NPU + Radeon iGPU) on Linux

Ten CNNs benchmarked on AMD XDNA1 (Phoenix) NPU vs CPU vs iGPU, with an interactive web studio