amy-why-3459 de253412b0 [Core] Defer generation payload host waits to output consumption (#8540) ...

Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>

2026-10-07 17:20:54 +08:00

..

output

[Refactor] Worker/ModelRunner runner correctness fixes (G2/N) (#5452)

2026-08-20 16:47:50 +08:00

__init__.py

Initial vLLM-omni repository structure

2025-09-11 14:32:51 +08:00

base.py

[Model] Enable Higgs Audio v3 MRV2 streaming and fix mixed-prefill capture bounds (#8226)

2026-09-30 11:32:27 +00:00

encoder_cudagraph.py

[Perf][Qwen3-Omni] Capture the thinker image encoder with CUDA graphs (part of #7452) (#8215)

2026-10-07 09:29:59 +08:00

gpu_ar_model_runner.py

[Core] Defer generation payload host waits to output consumption (#8540)

2026-10-07 17:20:54 +08:00

gpu_ar_worker.py

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781)

2026-09-20 23:03:08 -07:00

gpu_generation_model_runner.py

[Core] Defer generation payload host waits to output consumption (#8540)

2026-10-07 17:20:54 +08:00

gpu_generation_worker.py

[Model] Enable Higgs Audio v3 MRV2 streaming and fix mixed-prefill capture bounds (#8226)

2026-09-30 11:32:27 +00:00

gpu_memory_utils.py

[Docs] Remove stale stage config references (#6270)

2026-08-20 07:09:12 +08:00

gpu_model_runner.py

[Perf][Qwen3-Omni] Capture the thinker image encoder with CUDA graphs (part of #7452) (#8215)

2026-10-07 09:29:59 +08:00

memory_utils.py

[Rebase] Rebase to vllm 0.23.0 (#4286)

2026-06-13 16:43:02 +00:00

mixins.py

[Feat] Add native Mooncake KV transfer from AR to DiT (#7166)

2026-09-20 14:44:55 +00:00

omni_connector_model_runner_mixin.py

[Core] Split Omni connector model runner mixin (#6903)

2026-09-09 13:49:43 +08:00

omni_connector_validation.py

[Refactor][2/N Scheduler]Replace _FULL_PAYLOAD_INPUT_STAGES with a resolved stage transport capability. (#6149)

2026-08-25 15:24:59 +08:00

payload_span.py

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781)

2026-09-20 23:03:08 -07:00

runner_assisted_metadata.py

[Perf][VoxCPM2] Add unified decode graph optimization (#4606)

2026-07-04 05:30:48 +00:00

sampling_utils.py

[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781)

2026-09-20 23:03:08 -07:00

sparse_audio.py

[Refactor] Worker/ModelRunner runner correctness fixes (G2/N) (#5452)

2026-08-20 16:47:50 +08:00