vllm-omni/examples/offline_inference/qwen3_omni/run_single_prompt_tp.sh at 4882a36c41c481f70a3211c72f4e36e7bc800983 - vllm-omni - Gitea: Git with a cup of tea

anodyine/vllm-omni

0 Fork 0

Files

T

f0b8d3db82 [Feature] Control the stage init timeout threshold by --stage-init-timeout (#393 )

Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Signed-off-by: Li Shunyang <gmsv2544@nus.edu.sg>
Signed-off-by: Li Shunyang <lishunyang12@163.com>
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Signed-off-by: dengyunyang <584797741@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com>
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: dengyunyang <584797741@qq.com>
Co-authored-by: Samit <285365963@qq.com>

2025-12-30 23:37:10 +08:00

6 lines

249 B

Bash

Raw Blame History

 python end2end.py --output-wav output_audio \
                   --query-type use_audio \
                   --stage-init-timeout 300
 # stage-init-timeout sets the maximum wait to avoid two vLLM stages initializing at the same time on the same card.