anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity

smaller talker gpu util to avoid oom

Browse Source 
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
This commit is contained in:
Taichang Zhou committed 2026-03-08 01:48:42 +08:00
1 parent f405240513
commit c8b695f181
1 file changed
+1 -1
Download Patch File Download Diff File Expand all files Collapse all files
tests/e2e/stage_configs/qwen3_omni_ci.yaml
+1 -1
View File
@@ -47,7 +47,7 @@ stage_args:
model_arch: Qwen3OmniMoeForConditionalGeneration
worker_type: ar
scheduler_cls: vllm_omni.core.sched.omni_ar_scheduler.OmniARScheduler
gpu_memory_utilization: 0.6
gpu_memory_utilization: 0.5
enforce_eager: false
trust_remote_code: true
engine_output_type: latent # Output codec codes for code2wav