anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
3,412 Commits 235 Branches 31 Tags
757dd3b2c4eb8a5efaa28503f0e91e8cb19d03ce
Commit Graph
3412 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
tzhouam 757dd3b2c4 Leave Code2Wav workspace headroom in two-L4 serving fixture 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 22:51:54 +08:00
tzhouam 0dd5f3e17d Use blockwise Flux offload within single-L4 memory capacity 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 22:34:10 +08:00
tzhouam 649b0f763a Fit weekly serving fixtures to assigned GPUs and initialize accuracy groups 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 22:29:17 +08:00
tzhouam 9361c52de3 Honor Omni stage runner selection in shared vLLM config 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 22:22:40 +08:00
tzhouam b256e1ec4e Adapt Moss sampling and runner fixtures to vLLM 0.31 interfaces 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 22:22:39 +08:00
tzhouam 0b6591ae0a test: fit Qwen2.5 online expansion on its declared two GPUs 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 22:06:27 +08:00
tzhouam 864bc7b22a test: update the Moss runner fixture for release output APIs 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 22:06:27 +08:00
tzhouam c8d5f99f10 fix: scope CI package version overrides to Omni 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 22:03:13 +08:00
tzhouam 43e05c6e13 fix: align MRV2 profiling and capture with vLLM 0.31 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 22:03:13 +08:00
tzhouam 16f73d0da2 fix: match vLLM 0.31 generation profiling API 
Accept the upstream randomize_inputs profiling flag while preserving structured codec inputs during generation-stage dummy runs.

Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 21:23:18 +08:00
tzhouam 2974f8be59 test: use the vLLM 0.31 model-length property in graph fixtures 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 21:20:08 +08:00
tzhouam ed876de879 rebase: target the official vLLM 0.31.0 release 
Use upstream release images at db9527a46873, preserve custom processor conditioning, and include weekly jobs in full Buildkite release validation.

Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 21:11:54 +08:00
tzhouam 008fa25263 Merge main into dev/vllm-align for vLLM 0.31 release 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 21:05:17 +08:00
tzhouam 84cbf94b1b fix: preserve Omni processor conditioning on vLLM 0.31 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-03 21:03:26 +08:00
andyluo7 ee8fdab1dc [CI/Build] Fix MOSS CPU tests on ROCm workers (#8447) 
Signed-off-by: andyluo7 <andy.luo@amd.com>
 2026-10-03 09:13:51 +08:00
Sy03andYueqian Lin 3bc3f1a7d0 [Model] Optimize MOSS Local 1.5 MRV2 serving and progressive chunks (#8213) 
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
 2026-10-02 18:03:14 +00:00
Zheng Wengangandamy-why-3459 527982d886 [Bugfix] Skip async-chunk SHM put for stage-0-final requests (#7245) 
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-10-02 09:14:39 -07:00
Sy03 2ba5074ca0 [Model] Optimize CosyVoice3 packed streaming with bounded HiFT graphs (#8420) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-10-02 08:49:50 -07:00
Yueqian Lin 4025bb30f6 [Perf][AuK] Graph the encoder prefill, cache reference latents and fuse the codec activation (#8305) 
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
 2026-10-02 15:43:55 +00:00
Yueqian Lin 13c66da752 [Perf][AuK] Precompute adaLN modulations per request and run the conv position embedding as one GEMM (#8328) 
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
 2026-10-02 08:12:29 -07:00
Nick CaoandCodex 0e6791e9c4 [Bugfix] Initialize eager state in Higgs test fixture (#8426) 
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-10-02 10:22:52 -04:00
Zheng Wengangandamy-why-3459 eb1699bfca [FEAT][Fronted] Support incremental prefill for realtime video streaming (#5894) 
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: Zheng Wengang <zwg0606@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-10-02 22:18:51 +08:00
Sy03 e372aa3a41 [Bugfix] Restore Fish Speech and CosyVoice3 audio quality at high concurrency (#8422) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-10-02 07:11:04 -07:00
Sy03princeprideClaude Opus 5.5
 		ae58c2d8b9 [Model] YuE2: async single-stage synthesis and CUDA graph acceleration (#8407) 
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: Wang Zhipeng <wangzhipeng628@gmail.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-02 05:17:06 -07:00
linzhenpl07Claude Opus 5Zhou Taichang
 		b10270a01c [AR-Diffusion] Page in kernel-legal blocks so the default resolution can run (#6481) 
Signed-off-by: linzhenpl07 <linzhenpl07@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk>
 2026-10-02 20:05:04 +08:00
Sy03 e84014dffb [Model] Add single-stage Qwen3-TTS with in-Talker streaming codec decode (#8259) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-10-02 21:34:30 +10:00
Rahul Steiger 596487fe62 [Core] Prototype diffusion attention execution contracts with FA4 (#7379) 2026-10-02 17:58:47 +08:00
MaciejBalaNVand汪志鹏 97d6c693a6 [feature] Add HSDP pre-sharded option (#7948) 
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2026-10-02 09:35:09 +00:00
汪志鹏 b742f86136 [CI/Build] Restore streaming executor fixture contract (#8418) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-10-02 01:45:56 -07:00
andyluo7 53c7340668 test: measure offload memory inside diffusion workers (#8189) 
Signed-off-by: andyluo7 <andy.luo@amd.com>
 2026-10-02 14:07:20 +08:00
Sy03 d93e1a8e09 [Model] Optimize Qwen3-Omni MRv2 handoff, code prediction and audio decoding (#8223) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-10-01 22:22:54 -07:00
wtz2333andYuanheng Zhao 68003cf6ad [Bugfix] Fix washed-out LingBot Video outputs (#7037) 
Signed-off-by: wtz2333 <2955110911@qq.com>
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com>
 2026-10-02 03:57:50 +00:00
tzhouam 0c84edee02 rebase: align vllm-omni with vLLM ac9126e58aa7 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-02 11:06:23 +08:00
tzhouam 2721f16ca8 rebase: align vllm-omni with vLLM ac9126e58aa7 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-02 10:37:50 +08:00
andyluo7 bbee488da3 fix: repair ROCm test routing, CPU timeouts, and Breeze autotuning (#8342) 
Signed-off-by: andyluo7 <andy.luo@amd.com>
 2026-10-02 07:36:41 +08:00
Joshna-MedisettyandCursor 2560f91859 fix(ming): build ISTFT spectrogram in float32 (#7538) 
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-10-01 22:45:09 +00:00
Doug Smith 7b15d22f48 [CI/Build] Package runtime data explicitly (#7956) 
Signed-off-by: Doug Smith <dosmith@redhat.com>
 2026-10-01 19:10:21 +00:00
Youyuan Liandprincepride 423f34326e [Model] Add YuE2-3B text-to-music (model + /v1/audio/speech adapter) (#7886) 
Signed-off-by: Youyuan Li <105433145+Darcy-Lee@users.noreply.github.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
 2026-10-01 18:04:31 +08:00
tzhouam 383cc5ef1d ci: pin the official vLLM main commit image 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
 2026-10-01 15:26:34 +08:00
汪志鹏 a038b38179 [Model] Add MiniMax-H3 latent super-resolution and hi-res refinement (#8322) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-10-01 14:24:40 +08:00
yzhautouskay 27a6321a63 [Model][Cosmos3] Keep diffusion sampling state in FP32 (#7592) 
Signed-off-by: Yuliya Zhautouskaya <yzhautouskay@nvidia.com>
 2026-09-30 11:35:51 -07:00
amy-why-3459 4af28f33bd [Bugfix] Defer VoxCPM2 NPU patch to avoid platform import cycle (#8330) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-09-30 05:25:36 -07:00
Sy03 56763cd6c3 [Model] Enable Higgs Audio v3 MRV2 streaming and fix mixed-prefill capture bounds (#8226) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-30 11:32:27 +00:00
psv666andamy-why-3459 b44b2f981c [Bugfix] Fix Qwen3-Omni audio-input mean_e2el_ms regression (#8306) 
Signed-off-by: psv666 <2693925048@qq.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-09-30 18:07:55 +08:00
Alicia c524e1a879 [CI/Build] Refresh targeted perf baselines (#6538) 
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
 2026-09-30 09:24:25 +00:00
wangyuandAlicia d0f073686a [CI/Build] Split long weekly TTS jobs and route slow full-model cases to nightly (#8239) 
Signed-off-by: wangyu <410167048@qq.com>
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com>
 2026-09-30 09:08:24 +00:00
Yan CaoyancaocnZhou Taichang
 		004a5711dc [Bugfix][Helios] Guard cross-attn KV cache against address reuse (#8064) 
Signed-off-by: yancaocn <yancaochn@163.com>
Co-authored-by: yancaocn <yancaochn@163.com>
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk>
 2026-09-30 16:44:51 +08:00
WeiQing Chen e34f8c4f42 [Doc] Update vLLM-Omni WeChat QR code (#8301) 
Signed-off-by: David Chen <530634352@qq.com>
 2026-09-30 11:39:05 +08:00
Armaan AmatyaYueqian LinHongsheng Liu
 		aa41a3ac97 [Bugfix] Fix the remaining Python 3.10 breakages (#7985) 
Signed-off-by: Armaan Amatya <armaanamatya2014@gmail.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-09-30 11:38:23 +08:00
Hongchen Liandredearly123 989161c49d [Benchmark] Add MammothModa2 startup/loading breakdown (#7312) 
Signed-off-by: redearly123 <65453204+redearly123@users.noreply.github.com>
Co-authored-by: redearly123 <65453204+redearly123@users.noreply.github.com>
 2026-09-30 11:38:07 +08:00