[Bugfix] Fix Qwen3-TTS Stage 0 prefix-caching correctness (#3665)

Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>

the ci failure case is irrelavent to this PR and occurs rarely
This commit is contained in:
Yueqian LinandRein Yang authored and GitHub committed 2026-05-25 23:09:38 +08:00
1 parent 5f9aee193e
commit e996723bc9
12 files changed
+655 -43

No files matched your search

@@ -1,3 +1,4 @@
from collections import OrderedDict
from types import SimpleNamespace
import numpy as np
@@ -15,6 +16,8 @@ from vllm_omni.model_executor.models.qwen3_tts.qwen3_tts_talker import (
def _make_minimal_talker():
model = Qwen3TTSTalkerForConditionalGeneration.__new__(Qwen3TTSTalkerForConditionalGeneration)
model.talker_config = SimpleNamespace(codec_pad_id=7, num_code_groups=16)
model._ref_audio_artifact_cache_max_entries = 256
model._ref_audio_artifact_cache = OrderedDict()
return model