vllm-omni/examples/offline_inference/qwen3_omni

Qwen3-Omni

Run examples (Qwen3-Omni)

Multiple Prompts

Download dataset from seed_tts. For processing dataset please refer to Qwen2.5-Omni README.md Get into the example folder

cd examples/offline_inference/qwen3_omni

Then run the command below.

bash run_multiple_prompts.sh

Single Prompt

Get into the example folder

cd examples/offline_inference/qwen3_omni

Then run the command below.

bash run_single_prompt.sh

If you have not enough memory, you can set thinker with tensor parallel. Just run the command below.

bash run_single_prompt_tp.sh

Modality control

If you want to control output modalities, e.g. only output text, you can run the command below:

python end2end.py --output-wav output_audio \
                  --query-type use_audio \
                  --modalities text

Using Local Media Files

The end2end.py script supports local media files (audio, video, image) via command-line arguments:

# Use local video file
python end2end.py --query-type use_video --video-path /path/to/video.mp4

# Use local image file
python end2end.py --query-type use_image --image-path /path/to/image.jpg

# Use local audio file
python end2end.py --query-type use_audio --audio-path /path/to/audio.wav

If media file paths are not provided, the script will use default assets. Supported query types:

• use_video: Video input
• use_image: Image input
• use_audio: Audio input
• text: Text-only query

FAQ

If you encounter error about backend of librosa, try to install ffmpeg with command below.

sudo apt update
sudo apt install ffmpeg