anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
2,224 Commits 235 Branches 31 Tags
bfa907d528ea9ca91685ca08486a813c49dfddd5
Commit Graph
2224 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
lishunyang12 bfa907d528 docs: add merge target (2026-07-24, v0.26.0) 2026-07-15 10:15:27 +00:00
lishunyang12 1f74c3cfa2 docs: pin versions vLLM-Omni v0.25.0 / FlashInfer 0.6.14 / ModelOpt 0.45.0 2026-07-15 10:13:43 +00:00
lishunyang12 09125567ea docs: pin FlashInfer/ModelOpt versions in upstream-mapping 2026-07-15 10:12:02 +00:00
lishunyang12 c539c8d02d docs: pin vLLM-Omni / FlashInfer / ModelOpt versions 2026-07-15 10:10:43 +00:00
lishunyang12 c695836d81 docs: drop Notes section 2026-07-15 10:09:07 +00:00
lishunyang12 20b8a77605 docs: state test hardware SM103 (B300) 2026-07-15 10:08:31 +00:00
lishunyang12 369f696a01 docs: unify trtllm-gen naming 2026-07-15 10:05:18 +00:00
lishunyang12 7bc53e7430 docs: drop calibration intro paragraph 2026-07-15 10:03:19 +00:00
lishunyang12 c34f67e39c docs: heading hierarchy (h1 title > h2 parts > h3 sections) 2026-07-15 10:01:27 +00:00
lishunyang12 593a9605b1 docs: simplify knobs table 2026-07-15 09:59:36 +00:00
lishunyang12 c74176c065 docs: simplify upstream-mapping table 2026-07-15 09:58:29 +00:00
lishunyang12 ef426192b5 docs: drop (don't invent) note 2026-07-15 09:56:55 +00:00
lishunyang12 d8439f196d docs: drop redundant intro lines 2026-07-15 09:56:39 +00:00
lishunyang12 6607cceba0 docs: add SAGE + Skip-Softmax (trtllm-gen) API design & test plan 2026-07-15 09:55:06 +00:00
Shi Boao Bowieandbjf-frz a432b8a325 [Refactor][OutputProcessor 1/8]: clean up multimodal payload accumulation and move payload logic into MultimodalPayload & directory refactor (#4980) 
Signed-off-by: Boao Shi <aoibosh@connect.hku.hk>
Signed-off-by: bjf-frz <frz123db@gmail.com>
Co-authored-by: bjf-frz <frz123db@gmail.com>
 2026-07-15 15:50:19 +08:00
wangyu 795e4e0160 [CI] Add local job runner scripts for L2-L4 pytest execution (#4672) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-07-15 14:18:58 +08:00
Honghan Zhuzhuhh97Claude Opus 4.7Gao HanHongsheng Liu
 		f84f0e72fd [Bug Fix] Hunyuan image cfg bugfix (#4752) 
Signed-off-by: zhuhh97 <zhuhonghan@huawei.com>
Signed-off-by: dph97 <nenbaying@163.com>
Co-authored-by: zhuhh97 <z00806815@gmail.com>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-07-15 13:08:15 +08:00
zyz111222andamy-why-3459 2d58070f60 [Hardware][Ascend][Model] Optimize Qwen3-TTS on 310P (#4841) 
Signed-off-by: zouyizhou <zouyizhou@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-07-15 08:57:44 +08:00
wkutak a7b6a174bc Fix loading of ModelOpt FP8 checkpoints for Cosmos3 (#5076) 
Signed-off-by: Wojciech Kutak <wkutak@nvidia.com>
 2026-07-14 17:33:27 -07:00
wuli666andwuli666 6603450d71 [Bugfix][Quantization] Initialize component quantization base state (#5103) 
Signed-off-by: wuli666 <djjpro975@gmail.com>
Co-authored-by: wuli666 <djjpro975@gmail.com>
 2026-07-14 12:06:55 +00:00
bjf-frz b14ff23041 [PERF][CI]Add Cosmos3 diffusion perf config (#5010) 
Signed-off-by: bjf-frz <frz123db@gmail.com>
 2026-07-14 10:25:17 +00:00
bjf-frz 1a4a042a83 [REFACT]Refactor diffusion outputs to payload metadata (#4922) 
Signed-off-by: bjf-frz <frz123db@gmail.com>
 2026-07-14 17:24:03 +08:00
Alex Steiner 4b9d09cb87 [Bugfix][Quantization] Support packed parameters with HSDP (#5088) 
Signed-off-by: Alex Steiner <asteiner@nvidia.com>
 2026-07-14 08:24:26 +00:00
wjsuijlenh 3589a676e2 [Bugfix] Accept kv_prefetch_jobs in ARDiffusionModelRunner.execute_model (#4941) 
Signed-off-by: Wijnand Suijlen <wijnand.suijlen@huawei.com>
 2026-07-14 08:22:40 +00:00
Zhang JianandChendi Xue b1809985ef [recipe] Add cosmos3-nano recipe for npu (1xA3) (#4978) 
Signed-off-by: Zhang Jian <jianmusings@gmail.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Chendi Xue <chendi.xue@intel.com>
 2026-07-14 16:19:44 +08:00
Diya Penganddiyapeng e0570a0859 [Quantization] Add BitsAndBytes W4 online quantization for diffusion transformer (#5037) 
Signed-off-by: diyapeng <50388704+diyapeng@users.noreply.github.com>
Co-authored-by: diyapeng <50388704+diyapeng@users.noreply.github.com>
 2026-07-14 15:48:48 +08:00
Weiming Liao b20ebc8f9b [NPU] Upgrade CI IMAGE to v0.25.0 (#5095) 
Signed-off-by: Weiming Liao <liaowm5@gmail.com>
 2026-07-14 15:47:02 +08:00
akshatvishu 2c0d8399ac [Bugfix] Restore Qwen3-Omni speaker metadata during non-async handoff (#5086) 
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
 2026-07-14 04:35:44 +00:00
Hongsheng Liuandhsliu_ustc 625892032b [Doc] Standardize serving names and identifiers (#5081) 
Signed-off-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Co-authored-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
 2026-07-13 23:59:42 +08:00
Rahul Steiger 66b9ad287a Extend Cosmos3 CPU offloading to component and layerwise paths (#4695) 2026-07-13 09:48:53 +00:00
wangyu 98229b08ba [Bugfix] Pass --trust-remote-code via HunyuanImage3 DFX serve_args (#5006) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-07-13 15:34:46 +08:00
Chendi.Xue 161b005cfc [XPU][CI] Fix xpu after rebasing for 0.25.0 (#5066) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2026-07-13 15:34:27 +08:00
Zheng Wengang 3f4abedbda [Perf] Ming-TTS Stage-0 flow-head speedup: RoPE/QKV fusion, opt-in torch.compile, PIECEWISE cudagraph (#4942) 2026-07-12 19:50:51 -07:00
WeiQing Chen 8e14f69d96 docs: update WeChat QR code (#5061) 
Signed-off-by: David Chen <530634352@qq.com>
 2026-07-13 10:24:17 +08:00
Yi Liu 9a02963acf docs: document Cosmos3-Super AutoRound world-model support (#5062) 
Signed-off-by: yiliu30 <yi4.liu@intel.com>
 2026-07-13 02:22:16 +00:00
Hongsheng Liu a6da469134 docs: update README for v0.24.0 (#5060) 
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
 2026-07-13 08:26:37 +08:00
LHXuuu a28ded243f [Perf][Ming-TTS] Add initial latent chunk for lower streaming TTFP (#5011) 
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
 2026-07-13 06:45:28 +08:00
Zhou TaichangandClaude Opus 4.8 d3c47efc4f [Rebase] Rebase to vllm v0.25.0 (#5042) 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
v0.25.0rc1 		2026-07-12 23:39:53 +08:00
wangyu dda88a6f86 [BugFix] Align invalid layers DFX tests with 2-10 range (#5044) (#5047) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-07-12 09:50:54 +00:00
Alex Brooks 9014bb9917 [CI] Fix core_model Level for non-Diffusion Models (#5008) 2026-07-12 03:00:50 +00:00
Naga Sai Abhinay Devarinti 6581e2afa9 [Model] Add Krea 2 text-to-image diffusion model (#4730) 
Signed-off-by: Abhinay1997 <devarintinagasaiabhinay@gmail.com>
 2026-07-11 16:25:41 -07:00
Isotr0py b95905deb1 [Quantization] Migrate GGUF diffusion model support to OOT plugin (#4769) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
 2026-07-11 18:48:43 +00:00
Kushanamkushanamkahmadian
 		ff6f0da271 [Core] Composable parallel: Phase 1 strategy overlay (TP/DP/stage-replica) (RFC #4084) (#4281) 
Signed-off-by: Kushan A. <kahmadian@nvidia.com>
Signed-off-by: kushanam <kushanam@users.noreply.github.com>
Signed-off-by: Kushan A <kahmadian@nvidia.com>
Signed-off-by: kahmadian <kahmadian@users.noreply.github.com>
Co-authored-by: kushanam <kushanam@users.noreply.github.com>
Co-authored-by: kahmadian <kahmadian@users.noreply.github.com>
 2026-07-10 21:29:24 -06:00
NumberWan fe478a95ab [BugFix] Restore vllm_c IR op priority and torch.nn.RMSNorm for Qwen-Image (#4964) (#5009) 
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
 2026-07-10 17:39:07 +00:00
amy-why-3459 cbd3939c3d [BugFix] Fix CI failures caused by stale test expectations after recent stage-payload / deploy-config changes. (#5015) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-07-10 18:02:17 +08:00
amy-why-3459 9a44e7e019 [Refactor][Phase 1]Remove redundant functions and logs (#4986) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-07-10 15:13:35 +08:00
LHXuuu 5c3923509d [BugFix][Ming-TTS] Use uploaded direct speaker embeddings by voice (#5005) 
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
 2026-07-10 07:06:18 +00:00
Zheng Wengang 9fe26cfacb [Bugfix][Model] Fix Qwen3-Omni video metadata handling for use_audio_in_video (#4959) 
Signed-off-by: ZhengWG <zwg0606@gmail.com>
 2026-07-10 14:24:18 +08:00
林鑫andyurain 020792e6be [Perf][Qwen3-TTS] Sample code predictor outputs via Gumbel-max (#4261) 
Signed-off-by: 林鑫 <77673148+l-wave@users.noreply.github.com>
Co-authored-by: yurain <yurain26@users.noreply.github.com>
 2026-07-10 05:41:54 +00:00
leo b3a4819694 Fix VoxCPM2 perf server trust remote code (#4984) 
Signed-off-by: leo <yaoliu548926@gmail.com>
 2026-07-10 04:01:10 +00:00