anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
2,641 Commits 235 Branches 31 Tags
339761045f4bd9704672e27cfa9ebac0349e6b8d
Commit Graph
2641 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Hongsheng Liu 339761045f [Core] Make post-load publication warm-only 
Close publication leases inside Host Weight Runtime, return only the publication report, and cover the new terminal mappings. Rename the runtime test module to avoid the pytest basename collision reported in #6436.

Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-21 12:18:12 +08:00
Hongsheng Liu 4c773109b1 [Core] Add post-load host weight publication 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-21 09:05:34 +08:00
Hongsheng Liu 73b623f2f7 [Core] Add Host Weight Runtime foundation (#6419) 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-21 08:50:59 +08:00
Ian Eaves 5730af0a95 [Bugfix] Preserve prompt token usage details (#5181) 
Signed-off-by: Ian Eaves <ian.k.eaves@gmail.com>
 2026-08-20 20:05:05 +00:00
林鑫sheenlinyurainGao Han
 		37c11e6e4f [Perf][Qwen3-TTS] Fuse QKV and gate_up projections in code predictor (#5791) 
Signed-off-by: sheenlin <sheenlin@tencent.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: sheenlin <sheenlin@tencent.com>
Co-authored-by: yurain <yurain26@users.noreply.github.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
 2026-08-20 19:22:40 +00:00
MaciejBalaNVandRoger Wang 13c2de684c Cosmos3 logging and prompt improvements (#6325) 
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-08-20 12:04:49 -07:00
Alicia b2011a3edd [CI/Build] Update perf baselines base on 8/1-8/7 7 days avg (#6201) 
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
 2026-08-20 18:56:23 +00:00
MaciejBalaNV b3270dec8d Cosmos3 transfer fix (#5614) 
Signed-off-by: Maciej Bala <mbala@nvidia.com>
 2026-08-20 11:40:51 -07:00
Nick Cao ebb4abde0a [Tests] Run diffusion tiny model tests in parallel (#6339) 
Signed-off-by: Nick Cao <ncao@redhat.com>
 2026-08-20 12:46:32 -04:00
Yash Jain c6e38860e9 [Bugfix][Core] Fix replica device split when a stage omits devices (#5445) 
Signed-off-by: Yash Jain <yashjainjain1704@gmail.com>
 2026-08-21 00:44:03 +08:00
zzh b1da47b781 Fix npu moe registration (#6350) 
Signed-off-by: zzh <943967662@qq.com>
 2026-08-20 16:34:24 +00:00
dengyunyang 8d34d3b5de [Perf][Hunyuan] Optimize for vae and patch_embed (#6306) 
Signed-off-by: dengyunyang <584797741@qq.com>
 2026-08-20 16:29:21 +00:00
Inesh Reddy Chappidi cd3867c373 [Model] Suppress silence codec tokens for the first N Qwen3-TTS decod… (#5048) 
Signed-off-by: Inesh Reddy <ineshreddy249@gmail.com>
 2026-08-20 09:22:37 -07:00
KristofferandHongsheng Liu 718d9a4cd7 [Bugfix] Return diffusion metrics for image-edit endpoint (#5999) 
Signed-off-by: Kristoffer <kristoffer.torp@amd.com>
Signed-off-by: kTorp <kristorp@amd.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-20 15:28:55 +00:00
wangyu 273ffce130 [CI/Build] Strengthen pre-commit with markdownlint, SPDX, and policy hooks (#6273) 
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: [Your Name] <your.email@example.com>
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com>
 2026-08-20 21:07:04 +08:00
Zhou TaichangandClaude Fable 5 10906e3a6d [Refactor] Worker/ModelRunner runner correctness fixes (G2/N) (#5452) 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-20 16:47:50 +08:00
amy-why-3459 48e4f6a385 [Bugfix][MiniCPM-o][NPU] Skip Code2Wav dynamo unwrap when flow.encode… (#6397) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-20 16:24:08 +08:00
WeiQing Chen 53df9fe62b [Bugfix] Use dedicated WORLD group for distributed VAE communication (#6401) 
Signed-off-by: david6666666 <530634352@qq.com>
 2026-08-20 16:13:34 +08:00
NATURERuirui Yang | ReinHongsheng Liu
 		b57dc70ec4 [Bugfix] Reclaim resumable async-chunk requests on finish (#6360) 
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
Co-authored-by: Ruirui Yang | Rein <73573651+R2-Y@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-20 15:59:39 +08:00
Sy03andSy03 480e10ba9c [CI/Build] Match perf warmups to benchmark concurrency (#6356) 
Signed-off-by: Sy03 <24841857+Sy0307@users.noreply.github.com>
Co-authored-by: Sy03 <24841857+Sy0307@users.noreply.github.com>
 2026-08-20 00:25:49 -07:00
R0CKSTAR b58feb1420 [MUSA] Fix SwiGLU to use fused op (#6364) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-08-20 14:19:14 +08:00
linzhenpl07andClaude Opus 5 38cf9adc38 [BugFix][Diffusion] Fix MiniMax-H3 VAE hang when decoder tiles are fewer than ranks (#6345) 
Signed-off-by: linzhenpl07 <linzhenpl07@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-20 12:42:14 +08:00
amy-why-3459andCursor 9c61d5b67b [Bugfix][MiniCPM-o] Stop Talker mid-utterance truncation and load cod… (#6346) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-08-20 11:50:07 +08:00
Shenglei FuandHongsheng Liu 47b1893676 [Perf][CI] Reuse the Whisper judge worker across a test module (#6208) 
Signed-off-by: Shenglei Fu <sfu@confluent.io>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-20 10:49:44 +08:00
Joshna-MedisettyandCursor bd17618c11 [XPU][Bugfix] Make Omni AR async output path device-agnostic (#5569) 
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-08-19 20:06:33 -05:00
Yukim1 6f55a06fab [Docs] Remove stale stage config references (#6270) 
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
 2026-08-20 07:09:12 +08:00
Thanaji Rao ThakkalapelliandChendi.Xue efaf4276f9 [Bugfix] Record device-agnostic torch.Event on XPU to fix async D2H image corruption [XPU] (#5571) 
Signed-off-by: Thanaji Rao Thakkalapelli <thanaji.rao.thakkalapelli@intel.com>
Co-authored-by: Chendi.Xue <chendi.xue@intel.com>
 2026-08-19 16:30:38 -05:00
Joshna-MedisettyCursorChendi.Xue
 		ea24deefcc [Bugfix][FLUX.2-klein] Fix duplicated image position ids (#6130) 
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
Signed-off-by: Joshna-Medisetty <joshna.medisetty@intel.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Chendi.Xue <chendi.xue@intel.com>
 2026-08-19 16:30:12 -05:00
WeiQing Chen c3f80502e0 [Doc] Update vLLM-Omni WeChat QR code (#6369) 
Signed-off-by: David Chen <530634352@qq.com>
 2026-08-19 18:52:24 +08:00
Zeyu Huang | 黃澤宇andHongsheng Liu 8dc3d504d8 [skip ci][Doc] Remove obsolete DiffusionParallelConfig in many example scripts (#6347) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-19 15:27:58 +08:00
BruceLoveDecimal 7099583404 [Bugfix][MiniCPM-o] Restore streaming audio cache and unstall the first duplex response (#6274) 
Signed-off-by: BruceLoveDecimal <liuqihao970610@gmail.com>
 2026-08-19 07:26:03 +00:00
herotai214 ac0067078b [Tests][Refactor] P0.1: Add API server surface guardrails (#6202) 
Signed-off-by: herotai214 <herotai214@gmail.com>
 2026-08-19 07:20:18 +00:00
Sy03 26e003715c [Perf] Enable async schedule for MOSS-TTS (#6241) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-08-19 06:36:19 +00:00
Yuanheng Zhao a630b0c2ec [Ming] Cleanup Ming-family shared modules (#6119) 
Signed-off-by: Yuanheng <jonathan.zhaoyh@gmail.com>
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
 2026-08-19 14:13:40 +08:00
BruceLoveDecimaland汪志鹏 adf6d0c1ea [Model] Add SANA-WM support(Stage-1 only) (#4061) 
Signed-off-by: BruceLoveDecimal <liuqihao970610@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Signed-off-by: liuqihao <liuqihao970610@gmail.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2026-08-18 23:57:55 -06:00
bjf-frzandHongsheng Liu 14bd8f8772 [REFACT]Refactor diffusion parallel state (#5531) 
Signed-off-by: bjf-frz <frz123db@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-19 11:23:10 +08:00
Canlin Guo 14f2c16fb2 [Perf] Fuse MiniMax H3 modulation with FP32 accumulation (#6281) 
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
 2026-08-18 20:13:54 -07:00
Canlin Guo 9683b7f4b4 [Perf] Fuse MiniMax H3 SwiGLU activation (#6283) 
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
 2026-08-18 20:12:10 -07:00
Doug Smith 07ceb3324a [BugFix][TTS] Move user input from INFO to DEBUG in TTS/audio log lines (#6329) 2026-08-18 16:22:11 -06:00
Alex Brooks b4b907e7b6 [Bugfix | Model] Fix SenseNova & Use Well-defined Model Configs (#5877) 
Signed-off-by: Alex Brooks <albrooks@redhat.com>
 2026-08-18 16:43:05 +00:00
Weiming Liao f208f907bc [BugFix][NPU] Wan2.2-S2V RoPE: replace complex64 advanced indexing with index_select (#6320) 
Signed-off-by: Weiming Liao <liaowm5@gmail.com>
 2026-08-19 00:06:29 +08:00
Hongsheng Liu 284e05c88b [Core] Support online FP8 with DLO AllGather (#6279) 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-18 23:48:07 +08:00
Hongsheng Liu c3de04e127 [Bugfix] Avoid eager pi0 runtime import in pipeline registry (#6322) 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-18 23:42:03 +08:00
Joshna-MedisettyHongsheng LiuCursorNick Cao
 		4cd667875f [XPU][SDXL] Fix text encoder input device under CPU offload (#6125) 
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Nick Cao <ncao@redhat.com>
 2026-08-18 14:03:31 +00:00
Wang fuyinandHongsheng Liu e1c5f59aab [Config] Reuse vLLM configs in VllmOmniConfig (#6050) 
Signed-off-by: Acerak01-fy <wfy2003324@163.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-18 21:27:58 +08:00
TJian 02069a5bbf [ROCm] [CI] Fix circular import for rocm due to patch (#6287) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-08-18 09:45:05 +00:00
zhumingjue138 cd9ae66b3a [Bugfix][Test] fix Qwen3-omni OOM reliability and drop voxcpm2 stability/reliability test cases (#6299) 
Signed-off-by: zhumingjue <zhumingjue@huawei.com>
 2026-08-18 17:36:08 +08:00
Yukim1andzwhzzz0821 0a1846aa45 [Diffusion] Add native KV cache initialization and Scheduler-managed block allocation (#6094) 
Signed-off-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com>
Co-authored-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com>
 2026-08-18 07:00:24 +00:00
Yueqian Lin b283215c28 [Model] Add MiniMax Music 3 text-to-music (#6186) 
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
 2026-08-18 04:33:13 +00:00
psv666andamy-why-3459 199ef7779c [Bugfix][MiniCPM-o] Load Daily-Omni QA metadata from the hub cache (#6276) 
Signed-off-by: psv666 <2693925048@qq.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-18 10:53:55 +08:00