From 807f3133d7fbd16ce8d827c4d973361cd4d04102 Mon Sep 17 00:00:00 2001 From: Baoyuan Qi Date: Thu, 26 Mar 2026 10:21:00 +0800 Subject: [PATCH] [skip ci][Docs] Add FlashAttention requirement for audio generation to prevent noise-only outputs in mimo-audio model (#2205) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Signed-off-by: 齐保元 --- examples/offline_inference/mimo_audio/README.md | 4 ++++ examples/online_serving/mimo_audio/README.md | 3 +++ 2 files changed, 7 insertions(+) diff --git a/examples/offline_inference/mimo_audio/README.md b/examples/offline_inference/mimo_audio/README.md index 55f7dca0f..747e734cc 100644 --- a/examples/offline_inference/mimo_audio/README.md +++ b/examples/offline_inference/mimo_audio/README.md @@ -29,6 +29,10 @@ The `MIMO_AUDIO_TOKENIZER_PATH` environment variable is mandatory due to the spe export MIMO_AUDIO_TOKENIZER_PATH="XiaomiMiMo/MiMo-Audio-Tokenizer" ``` +### Flash Attention (audio generation) + +For **audio generation** (e.g. TTS variants, multi-turn spoken dialogue with audio output), install the **`flash-attn`** package with a build that matches your **CUDA** and **PyTorch** versions. On GPU, omitting **`flash-attn`** can cause **generated audio to be noise-only or otherwise unusable**. See the [FlashAttention](https://github.com/Dao-AILab/flash-attention) project for installation options and prebuilt wheels. + ## Quick Start Run a single sample for basic TTS: diff --git a/examples/online_serving/mimo_audio/README.md b/examples/online_serving/mimo_audio/README.md index 555d69b45..9f70d59cb 100644 --- a/examples/online_serving/mimo_audio/README.md +++ b/examples/online_serving/mimo_audio/README.md @@ -4,6 +4,9 @@ Please refer to [README.md](../../../README.md) +> ⚠️ **Important (audio generation)** +> For **audio generation** (TTS, responses that include synthesized audio, etc.), install **`flash-attn`** for your **CUDA** and **PyTorch** stack. Without it on GPU, **output audio may be noise-only or unusable**. See the [FlashAttention](https://github.com/Dao-AILab/flash-attention) repository for compatible builds. + ## Run examples (MiMo-Audio) ### Launch the Server