anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
2,441 Commits 235 Branches 31 Tags
dfe6e13cfc94f6688ea4b00a7659bc4138d28bde
Commit Graph
2441 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Hongsheng Liu dfe6e13cfc Update docs/.nav.yml 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-06 12:27:54 +08:00
Hongsheng Liu 9d80efcbe5 docs: keep design reorg arrangement-only 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-06 12:27:18 +08:00
Hongsheng Liu ddbbfd29e5 docs: reorganize design navigation 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-06 12:27:18 +08:00
hesiruandamy-why-3459 9235b0ae65 Optimize MiniCPM-o 4.5 Whisper chunk-attention mask construction (#5382) 
Signed-off-by: a-kaa <siruhe666@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-06 09:48:46 +08:00
SYLARandlishunyang12 1c2a81f6d8 feat(minimax-h3): enable 2x RTX 4090/5090 with DLO (#5764) 
Signed-off-by: lishunyang12 <lishunyang03@gmail.com>
Signed-off-by: lishunyang12 <lishunyang12@163.com>
Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
 2026-08-06 09:02:29 +08:00
zhengjiaandCursor b4581b293b [Doc] Add Cosmos3-Nano ROCm recipe (1x MI350X) (#5634) 
Signed-off-by: zjli2013 <leezhengjiang@126.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-08-05 22:50:15 +08:00
bjf-frz 9f978923f2 [docs] consolidate diffusion execution modes (#5599) 
Signed-off-by: bjf-frz <frz123db@gmail.com>
 2026-08-05 22:41:18 +08:00
Nick Cao 589afcef6c Add @NickCao to CODEOWNERS (#5807) 
Signed-off-by: Nick Cao <ncao@redhat.com>
 2026-08-05 21:50:48 +08:00
Zeyu Huang | 黃澤宇 556c5f88a0 [skip ci][Doc] add comfyui hint for Minimal-H3 (#5785) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
 2026-08-05 11:12:06 +00:00
R0CKSTAR 2eada79b99 [Hardware][MUSA] Make MiniMax H3 conditioned VAE RNG device-aware (#5703) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-08-05 03:11:46 -07:00
wangyu 7fb62db5c2 [CI]For NPU CI, Nest perf baselines by hardware label (H100/A3) (#5402) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-08-05 17:35:41 +08:00
ooooooye 6510de344e [Bugfix][Diffusion] Fix DLO AllGather size mismatch for models with h… (#5802) 
Signed-off-by: brandneway <gyuan4892@gmail.com>
 2026-08-05 09:32:41 +00:00
Wallbreazzz 740cb35a59 [BugFix] Fix MOSS-TTS codec v1/v2 detection and align vendored tokenizer with upstream (#5635) 
Signed-off-by: Wallbreazzz <110282866+Wallbreazzz@users.noreply.github.com>
 2026-08-05 08:24:32 +00:00
WeiQing Chen ae7bee0c43 [Feature] Align MiniMax H3 official input matrix (#5752) 
Signed-off-by: david6666666 <530634352@qq.com>
 2026-08-05 07:12:01 +00:00
GXIN 6a604be610 [Bugfix][NPU] Fallback to BSND RoPE when Qwen3-TTS short-seq BNSD li… (#5608) 
Signed-off-by: XIN GAO <1037396230@qq.com>
 2026-08-05 13:02:47 +08:00
Yuekai ZhangClaude Fable 5amy-why-3459
 		f201b7171f [Perf][MiniCPM-o] TensorRT acceleration for the Code2Wav vocoder (DiT estimator + campplus) (#5638) 
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-04 20:58:19 -07:00
wangyu 0a7ac4c67e [CI/Build] Speed up omni sleep-mode entrypoint tests with shared engines (#5713) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-08-05 03:26:23 +00:00
Yueqian LinandSy0307 e788ef6e76 [Feature] PersonaPlex (Moshi-based full-duplex S2S): native vLLM port + duplex serving (#4771) 
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Signed-off-by: Sy0307 <24841857+Sy0307@users.noreply.github.com>
Co-authored-by: Sy0307 <24841857+Sy0307@users.noreply.github.com>
 2026-08-04 20:10:33 -07:00
Shenglei FuandClaude f24a6165ff [Test] Prefix-cache passthrough test coverage prerequisite for W2 (#4855) (#5310) 
Signed-off-by: Shenglei Fu <sfu@confluent.io>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-08-04 20:03:57 -07:00
Joshna-Medisetty bfaaa3c2c3 [Bugfix][XPU][Tests] Add tests/e2e/accuracy/__init__.py to fix pytest… (#5780) 
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
 2026-08-05 07:14:22 +08:00
Atharv Arun Chivate c9f2e5ad94 fix(bagel): correct CFG position ID concatenation for multimodal RoPE (#5775) 
Signed-off-by: atharv0o <missionblood2@gmail.com>
 2026-08-05 01:53:59 +08:00
Nick Cao fbea788668 [Refactor] Use vLLM video loader for video reference decoding (#5085) 
Signed-off-by: Nick Cao <ncao@redhat.com>
 2026-08-05 01:49:41 +08:00
Gao Han 78c144f3a8 [CI failed] Revert "[Perf][Qwen3-TTS] Fuse QKV and gate_up projections in code predictor" (#5777) 2026-08-04 15:21:38 +00:00
NATURE 1c4aca7f6e [Bugfix][Hunyuan/Bagel]Avoid payload connector for KV-only senders (#5744) 
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
 2026-08-04 14:40:27 +00:00
林鑫sheenlinyurain
 		6fdc4ca62d [Perf][Qwen3-TTS] Fuse QKV and gate_up projections in code predictor (#4958) 
Signed-off-by: sheenlin <sheenlin@tencent.com>
Co-authored-by: sheenlin <sheenlin@tencent.com>
Co-authored-by: yurain <yurain26@users.noreply.github.com>
 2026-08-04 11:59:32 +00:00
Zeyu Huang | 黃澤宇andCopilot Autofix powered by AI b6728db486 [Frontend] Add ComfyUI support for r2v (MiniMax H3 as example) (#5756) 
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
 2026-08-04 11:51:12 +00:00
Mu GuanLin b9a51592f0 [Model][Feat] MiniMax H3 online FP8 support (#5737) 
Signed-off-by: mglyn <1203789601@qq.com>
 2026-08-04 11:35:01 +00:00
ruirui(rein) yang 5215e03a91 [Refactor][1/N Scheduler]Remove duplicated AR/generation scheduler plumbing and establish explicit shared lifecycle contracts. (#5461) 
Signed-off-by: R2-Y <ruiruyang2@gmail.com>
 2026-08-04 15:10:47 +08:00
Chenguang Zheng d5d47e9be1 [Doc] Document async Omni output materialization (#5610) 
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
 2026-08-04 14:50:38 +08:00
Hongsheng Liu 30cba84222 [Doc] Update README and installation docs for v0.26.0 (#5715) 
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
 2026-08-04 14:18:51 +08:00
WeiQing Chen 9f9f9f274a [Bugfix] Fix MiniMax H3 reference video URL (#5740) 
Signed-off-by: David Chen <530634352@qq.com>
 2026-08-04 14:15:26 +08:00
WeiQing Chen 900a7f0813 [Model] Add MiniMax H3 T2VA accuracy test (#5709) 
Signed-off-by: david6666666 <530634352@qq.com>
 2026-08-03 23:59:30 +08:00
Yukim1 7a2007cc17 [Refactor] Remove legacy --stage-configs-path from the serve CLI (#5647) 
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
 2026-08-03 23:41:52 +08:00
WeiQing Chen 76de642c54 Update WeChat community QR code (#5701) 
Signed-off-by: David Chen <530634352@qq.com>
 2026-08-03 17:56:16 +08:00
ooooooye a4ea67a21b [Model] Add soundfile fallback for MiniMax H3 audio loading (#5699) 
Signed-off-by: brandneway <gyuan4892@gmail.com>
v0.26.0 		2026-08-03 16:24:50 +08:00
zzh e0c2b9d73f Adapt HunyuanImage3.0 test for npu (#5436) 
Signed-off-by: zzh <943967662@qq.com>
 2026-08-03 06:31:50 +00:00
Isotr0py 24741961eb [Model] Add MiniMax H3 diffusion support (#5691) 2026-08-03 14:10:40 +08:00
wangyu 727f90958e [CI/Build] Split diffusion distributed nightly tests by L4 and H100 (#5695) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-08-03 12:35:54 +08:00
ChoHee 67c54777bb [Bugfix] Reject /v1/completions for thinker+talker models when --trust-remote-code is unset (#5525) 
Signed-off-by: ChoHee15 <cc5281@126.com>
 2026-08-01 15:49:12 +00:00
Zhou TaichangandClaude Fable 5 2c4e9a945b [BugFix] Make pure-TP KV receive fallback all-or-nothing across ranks (#5636) 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-01 15:43:48 +00:00
SYLARandlishunyang12 4b1547b4d8 [Bugfix] Fix Wan2.2 omitted guidance scale resolution (#5615) 
Signed-off-by: lishunyang12 <lishunyang03@gmail.com>
Signed-off-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
 2026-08-01 15:17:33 +00:00
SYLARandlishunyang12 6e8c279a68 [Bugfix] Match image file metadata to output format (#5619) 
Signed-off-by: lishunyang12 <lishunyang03@gmail.com>
Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
 2026-08-01 15:09:27 +00:00
SYLARandlishunyang12 6f98c807d2 [Bugfix] Restore BAGEL CFG KV transfers (#5620) 
Signed-off-by: lishunyang12 <lishunyang03@gmail.com>
Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
 2026-08-01 15:06:05 +00:00
Librium 185e3d6df6 [Bugfix] Preserve channel-last video tensor layout (#5418) 
Signed-off-by: pxljs <1621352782@qq.com>
 2026-08-01 07:05:57 +00:00
amy-why-3459andCursor 67aa6c55a4 [Bugfix][MiniCPM-o] Align Daily-Omni bench with MiniCPM interleaved A… (#5625) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-31 22:41:00 -07:00
Shenglei Fu 9d67f8e02f [CI/Build] Let audio assertions pin the transcript language (#5646) 
Signed-off-by: Shenglei Fu <sfu@confluent.io>
 2026-07-31 21:44:28 -07:00
akshatvishu cd5daaea6a [BugFix][Metrics] Fix per-stage time and token stats in metrics API (#4974) 
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
 2026-08-01 03:54:17 +00:00
Harenome 安仁 Ranaivoarivony-Razanajato 8cb79308c6 diffusion: Fix silent override of explicit guidance_scale=0 (#4999) 
Signed-off-by: Harenome Ranaivoarivony-Razanajato <harenome.razanajato1@huawei.com>
 2026-08-01 03:19:21 +00:00
NATURE 0a03359224 [Bugfix][MiniCPM-o] Stabilize single-GPU audio generation (#5637) 
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
 2026-08-01 03:01:06 +00:00
Weiming Liao fe02e8b81e [CI][NPU] Add MiniCPM-o 4.5 dependencies (#5660) 
Signed-off-by: Weiming Liao <liaowm5@gmail.com>
 2026-08-01 02:57:12 +00:00