anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
3,412 Commits 235 Branches 31 Tags
757dd3b2c4eb8a5efaa28503f0e91e8cb19d03ce
Commit Graph
18 Commits
Author SHA1 Message Date
tzhouam b256e1ec4e Adapt Moss sampling and runner fixtures to vLLM 0.31 interfaces 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 22:22:39 +08:00
tzhouam 43e05c6e13 fix: align MRV2 profiling and capture with vLLM 0.31 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 22:03:13 +08:00
tzhouam 2974f8be59 test: use the vLLM 0.31 model-length property in graph fixtures 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 21:20:08 +08:00
tzhouam ed876de879 rebase: target the official vLLM 0.31.0 release 
Use upstream release images at db9527a46873, preserve custom processor conditioning, and include weekly jobs in full Buildkite release validation.

Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 21:11:54 +08:00
tzhouam 008fa25263 Merge main into dev/vllm-align for vLLM 0.31 release 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 21:05:17 +08:00
Sy03andYueqian Lin 3bc3f1a7d0 [Model] Optimize MOSS Local 1.5 MRV2 serving and progressive chunks (#8213) 
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
 2026-10-02 18:03:14 +00:00
Sy03 e372aa3a41 [Bugfix] Restore Fish Speech and CosyVoice3 audio quality at high concurrency (#8422) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-10-02 07:11:04 -07:00
Sy03 e84014dffb [Model] Add single-stage Qwen3-TTS with in-Talker streaming codec decode (#8259) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-10-02 21:34:30 +10:00
Sy03 d93e1a8e09 [Model] Optimize Qwen3-Omni MRv2 handoff, code prediction and audio decoding (#8223) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-10-01 22:22:54 -07:00
tzhouam 2721f16ca8 rebase: align vllm-omni with vLLM ac9126e58aa7 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-02 10:37:50 +08:00
Sy03 56763cd6c3 [Model] Enable Higgs Audio v3 MRV2 streaming and fix mixed-prefill capture bounds (#8226) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-30 11:32:27 +00:00
Sy03 5af3a16526 [Model] Add MiniCPM-o 4.5 turn-mode MRv2 and batched audio inference (#8222) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-29 11:41:39 -07:00
Sy03 001f8a80b9 [Core] Extend the shared multi-stage execution framework for mixed V1/MRv2 pipelines (#8184) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-29 07:40:57 -07:00
Sy03 e1303e5067 [Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-26 22:51:04 +08:00
Sy03 5d0963b3dc [Bugfix] Fix MRV2 payload slicing with CUDA Graph padding (#8159) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-25 16:07:22 +00:00
Sy03 5634f03eb1 [Bugfix] Restore MRV2 full-payload transport for offline Qwen3-TTS (#8010) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-23 01:51:20 +00:00
Zhou TaichangClaude Opus 5Gao Han
 		59db6a4285 [Rebase] Rebase to vLLM 0.30.0 (#7820) 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
 2026-09-22 15:52:01 +00:00
Sy03 a9e2117f5e [Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-20 23:03:08 -07:00