 Sy03
|
7be49aa0ce
|
[Model] Default MOSS Local 1.5 to adaptive CUDA MRV2 with MPS (#8438)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-06 08:20:46 -07:00 |
|
|
JungleandCodex
|
67d21b5fff
|
[Core] Add token_ids output type and enforce canonical names (#7843)
Signed-off-by: Jungle430 <junglece430@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-10-05 16:49:03 +08:00 |
|
|
Zhou Taichang
|
0b0d2d7009
|
[Rebase] Align vLLM-Omni with vLLM v0.31.0 (#8459)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-10-05 14:11:01 +08:00 |
|
|
|
bbd539d2b6
|
[feature] Enable multi-node inference through Ray backend (#7938)
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Co-authored-by: Bartosz Stefaniak <bstefaniak@nvidia.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-10-05 02:53:36 +00:00 |
|
|
SunandOpenAI Codex
|
3f20252151
|
[Model] Fuse MammothModa2 QK norm and RoPE (#7969)
Signed-off-by: levius <2114377220@qq.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-10-05 02:44:45 +08:00 |
|
|
Sy03andYueqian Lin
|
3bc3f1a7d0
|
[Model] Optimize MOSS Local 1.5 MRV2 serving and progressive chunks (#8213)
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-10-02 18:03:14 +00:00 |
|
|
Sy03
|
e84014dffb
|
[Model] Add single-stage Qwen3-TTS with in-Talker streaming codec decode (#8259)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-02 21:34:30 +10:00 |
|
|
MaciejBalaNVand汪志鹏
|
97d6c693a6
|
[feature] Add HSDP pre-sharded option (#7948)
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-10-02 09:35:09 +00:00 |
|
|
Sy03
|
001f8a80b9
|
[Core] Extend the shared multi-stage execution framework for mixed V1/MRv2 pipelines (#8184)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-29 07:40:57 -07:00 |
|
|
|
7d6904aa94
|
SeedVR2: bounded long-video restoration (#8102)
Signed-off-by: 0z5a <Dezhen.lu@student.uni-tuebingen.de>
Signed-off-by: 0z5a <dezhen.lu@uni-tuebingen.de>
Signed-off-by: 0z5a <dezhen.lu@student.uni-tuebingen.de>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: 0z5a <dezhen.lu@uni-tuebingen.de>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
|
2026-09-29 11:33:50 +00:00 |
|
|
RuQing Xu
|
0173cb3748
|
[Kernel] Improve 2 backends importing FlashInfer: FLASHINFER_ATTN and TRTLLM_ATTN (#7431)
Signed-off-by: Ruqing Xu <7891482+xrq-phys@users.noreply.github.com>
|
2026-09-28 21:21:58 +00:00 |
|
|
Hongsheng Liuandhsliu_ustc
|
7ab582ae25
|
[Doc] Update README and docs for v0.30.0 (#8175)
Signed-off-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Co-authored-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
|
2026-09-27 10:07:58 +08:00 |
|
|
R0CKSTAR
|
6715c57b2d
|
feat: configure Torch Dynamo recompile limit from environment (#7243)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
|
2026-09-26 22:54:47 +08:00 |
|
|
Sy03
|
e1303e5067
|
[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-26 22:51:04 +08:00 |
|
|
Hoseung KimandHoseung Kim
|
d4570afabf
|
[Frontend] Reject built-in name collisions in voice upload and add VLLM_OMNI_SPEAKER_REGISTRATION_POLICY (#6848)
Signed-off-by: Hoseung Kim <hoseung.kim@navercorp.com>
Co-authored-by: Hoseung Kim <hoseung.kim@navercorp.com>
|
2026-09-21 18:35:07 -07:00 |
|
|
Sy03
|
473da2cf82
|
[Perf][Qwen3-TTS] Enable event-driven orchestration by default (#7088)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-21 12:09:19 -07:00 |
|
|
Sy03
|
60a933b9ab
|
[Model] Default Qwen3-TTS to experimental Model Runner V2 (#7930)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-21 18:56:06 +00:00 |
|
|
Zhou TaichangandClaude Fable 5.1
|
86fcfe95f1
|
[LingBot World] Eleven bit-identical removals of repeated work in the realtime path (#7648)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-21 06:12:45 +00:00 |
|
|
Sy03
|
a9e2117f5e
|
[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-20 23:03:08 -07:00 |
|
|
Linze Shi
|
c8b3a17bd3
|
[Frontend] Allow explicit turn-based serving (#7675)
Signed-off-by: Linze-Shi <linzeshi0@gmail.com>
|
2026-09-16 17:29:57 -07:00 |
|
|
chickeytonandClaude Opus 5
|
99ff4f3070
|
[Core][Frontend] Unified Full-duplex Framework (#7413)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 15:35:36 +08:00 |
|
|
Zheng Wengangandwuli666
|
275720b378
|
[Bugfix] Keep async video jobs queued until inference and abort on delete (#6759)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: wuli666 <421774554@qq.com>
Co-authored-by: wuli666 <421774554@qq.com>
|
2026-09-15 20:43:30 -07:00 |
|
|
Ethan ZHUandZhu Shihao
|
9f85b3722e
|
[Model] Stop MiniCPM-o Thinker at TTS boundaries (#7463)
Signed-off-by: Zhu Shihao <zhushihao@bytedance.com>
Co-authored-by: Zhu Shihao <zhushihao@bytedance.com>
|
2026-09-14 15:25:00 -07:00 |
|
|
Yuan Wu
|
6753bbd18c
|
[Core] Add NIXL omni connector (#6093)
Signed-off-by: yuanwu <yuan.wu@intel.com>
Signed-off-by: Yuan Wu <yuan.wu@intel.com>
|
2026-09-13 16:35:02 +08:00 |
|
|
KANG Qihan
|
f7d9deb45a
|
[Kernel][Boogu-Image] Fuse Q/K RMSNorm + interleaved RoPE via fused_qk_norm_rope (#6982)
Signed-off-by: Qihan Kang <rollykanggg@gmail.com>
|
2026-09-13 09:39:27 +08:00 |
|
|
Zhou TaichangandClaude Opus 5
|
aff7d64948
|
[Rebase] Rebase to vLLM 0.29.0 (#7230)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-10 12:08:28 +08:00 |
|
|
汪志鹏
|
c59b48b47e
|
[Feature][MiniMax-H3] Complete VSA and Ulysses support (#6909)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-09-02 07:19:21 -04:00 |
|
|
Hongsheng Liu
|
d1c8beeb18
|
[Doc] Update README and docs for v0.28.0 (#6858)
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
|
2026-09-01 19:50:26 +08:00 |
|
|
Zheng Wengangandamy-why-3459
|
94b1546ce3
|
[Model] Qwen3-Omni: register thinker-only pipeline for Instruct serve (#6284)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: Zheng Wengang <zwg0606@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-27 08:21:03 +00:00 |
|
|
|
c2723979c0
|
[Bugfix] Validate per-stage device layout before spawning workers (#5003) (#5742)
Signed-off-by: ChoHee15 <cc5281@126.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-08-26 19:25:22 +00:00 |
|
|
Yueqian LinandYueqian Lin
|
8cfede4309
|
[Perf][Engine] Event-driven orchestration loop (opt-in) — S1 of #4855 (#5221)
Signed-off-by: Yueqian Lin <gao@yueqian.us>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <gao@yueqian.us>
|
2026-08-26 22:15:25 +08:00 |
|
|
amy-why-3459
|
5de6f7c37a
|
[Bugfix][MiniCPM-o] Serve native duplex from shipping YAMLs and fence… (#6619)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-26 10:56:51 +08:00 |
|
|
Hongsheng Liu
|
a708ae5b7a
|
[Bugfix] Reconcile env-var inventory with post-#6217 main drift (#6631)
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
|
2026-08-26 06:13:28 +08:00 |
|
|
Hongsheng Liu
|
780e8d40aa
|
[Doc] Add environment variables configuration reference (#6217)
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-08-26 04:58:54 +08:00 |
|
|
|
b39f599b09
|
[Core] Add UniProc diffusion executor for single-GPU (#6308)
Signed-off-by: Rahul Steiger <rsteiger@nvidia.com>
Signed-off-by: Rahul Steiger <rsteiger@aws-cmh-slurm-1-vscode-04.cm.cluster>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Rahul Steiger <rsteiger@aws-cmh-slurm-1-vscode-04.cm.cluster>
|
2026-08-22 21:58:21 +08:00 |
|
|
Yukim1
|
6f55a06fab
|
[Docs] Remove stale stage config references (#6270)
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
|
2026-08-20 07:09:12 +08:00 |
|
|
Yukim1andzwhzzz0821
|
0a1846aa45
|
[Diffusion] Add native KV cache initialization and Scheduler-managed block allocation (#6094)
Signed-off-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com>
Co-authored-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com>
|
2026-08-18 07:00:24 +00:00 |
|
|
Hongsheng Liu
|
265d80b4dd
|
[Docs] Classify PD disaggregation as an experimental feature (#6115)
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-08-17 17:38:44 +08:00 |
|
|
bjf-frz
|
9f978923f2
|
[docs] consolidate diffusion execution modes (#5599)
Signed-off-by: bjf-frz <frz123db@gmail.com>
|
2026-08-05 22:41:18 +08:00 |
|
|
Hongsheng Liu
|
30cba84222
|
[Doc] Update README and installation docs for v0.26.0 (#5715)
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
|
2026-08-04 14:18:51 +08:00 |
|
|
Yukim1
|
7a2007cc17
|
[Refactor] Remove legacy --stage-configs-path from the serve CLI (#5647)
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
|
2026-08-03 23:41:52 +08:00 |
|
|
bjf-frzandHongsheng Liu
|
be667a8067
|
[Refact] Refactor diffusion output streaming (#5166)
Signed-off-by: bjf-frz <frz123db@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-07-23 10:06:08 +08:00 |
|
|
Bingyu (Spencer) Liu
|
dcf8b07d39
|
[Core] Cleanup Omni connector runtime and transfer backends (#5096)
Signed-off-by: spencerr221 <liubingyu62@gmail.com>
|
2026-07-22 09:44:15 +08:00 |
|
|
|
4fbbdfd250
|
[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031)
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
Co-authored-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-07-18 09:34:33 +00:00 |
|
|
Hongsheng Liuandhsliu_ustc
|
625892032b
|
[Doc] Standardize serving names and identifiers (#5081)
Signed-off-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Co-authored-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
|
2026-07-13 23:59:42 +08:00 |
|
|
|
ff6f0da271
|
[Core] Composable parallel: Phase 1 strategy overlay (TP/DP/stage-replica) (RFC #4084) (#4281)
Signed-off-by: Kushan A. <kahmadian@nvidia.com>
Signed-off-by: kushanam <kushanam@users.noreply.github.com>
Signed-off-by: Kushan A <kahmadian@nvidia.com>
Signed-off-by: kahmadian <kahmadian@users.noreply.github.com>
Co-authored-by: kushanam <kushanam@users.noreply.github.com>
Co-authored-by: kahmadian <kahmadian@users.noreply.github.com>
|
2026-07-10 21:29:24 -06:00 |
|
|
amy-why-3459
|
9a44e7e019
|
[Refactor][Phase 1]Remove redundant functions and logs (#4986)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-07-10 15:13:35 +08:00 |
|
|
JiangJie ZhangandSamit
|
c45ac74d43
|
[Core][Frontend] Support request-level batching for diffusion pipelines (#4079)
Signed-off-by: jader <yjader@foxmail.com>
Co-authored-by: Samit <285365963@qq.com>
|
2026-06-29 18:09:19 +02:00 |
|
|
Isaac Hung
|
e9d4931781
|
[Core] Remove dead custom_process_input_func hooks in stage input processors (#4531)
Signed-off-by: Isaac Hung <manhei5001@gmail.com>
|
2026-06-29 05:17:25 +02:00 |
|
|
amy-why-3459
|
0470e96771
|
[Docs] Modify Qwen3-Omni's recipe (#3109)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-04-27 21:41:13 +08:00 |
|