 Sy03
|
e1303e5067
|
[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-26 22:51:04 +08:00 |
|
|
Hoseung KimandHoseung Kim
|
d4570afabf
|
[Frontend] Reject built-in name collisions in voice upload and add VLLM_OMNI_SPEAKER_REGISTRATION_POLICY (#6848)
Signed-off-by: Hoseung Kim <hoseung.kim@navercorp.com>
Co-authored-by: Hoseung Kim <hoseung.kim@navercorp.com>
|
2026-09-21 18:35:07 -07:00 |
|
|
Sy03
|
473da2cf82
|
[Perf][Qwen3-TTS] Enable event-driven orchestration by default (#7088)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-21 12:09:19 -07:00 |
|
|
Sy03
|
60a933b9ab
|
[Model] Default Qwen3-TTS to experimental Model Runner V2 (#7930)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-21 18:56:06 +00:00 |
|
|
Zhou TaichangandClaude Fable 5.1
|
86fcfe95f1
|
[LingBot World] Eleven bit-identical removals of repeated work in the realtime path (#7648)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-21 06:12:45 +00:00 |
|
|
Sy03
|
a9e2117f5e
|
[Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-20 23:03:08 -07:00 |
|
|
Linze Shi
|
c8b3a17bd3
|
[Frontend] Allow explicit turn-based serving (#7675)
Signed-off-by: Linze-Shi <linzeshi0@gmail.com>
|
2026-09-16 17:29:57 -07:00 |
|
|
chickeytonandClaude Opus 5
|
99ff4f3070
|
[Core][Frontend] Unified Full-duplex Framework (#7413)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 15:35:36 +08:00 |
|
|
Zheng Wengangandwuli666
|
275720b378
|
[Bugfix] Keep async video jobs queued until inference and abort on delete (#6759)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: wuli666 <421774554@qq.com>
Co-authored-by: wuli666 <421774554@qq.com>
|
2026-09-15 20:43:30 -07:00 |
|
|
Ethan ZHUandZhu Shihao
|
9f85b3722e
|
[Model] Stop MiniCPM-o Thinker at TTS boundaries (#7463)
Signed-off-by: Zhu Shihao <zhushihao@bytedance.com>
Co-authored-by: Zhu Shihao <zhushihao@bytedance.com>
|
2026-09-14 15:25:00 -07:00 |
|
|
Yuan Wu
|
6753bbd18c
|
[Core] Add NIXL omni connector (#6093)
Signed-off-by: yuanwu <yuan.wu@intel.com>
Signed-off-by: Yuan Wu <yuan.wu@intel.com>
|
2026-09-13 16:35:02 +08:00 |
|
|
KANG Qihan
|
f7d9deb45a
|
[Kernel][Boogu-Image] Fuse Q/K RMSNorm + interleaved RoPE via fused_qk_norm_rope (#6982)
Signed-off-by: Qihan Kang <rollykanggg@gmail.com>
|
2026-09-13 09:39:27 +08:00 |
|
|
Zhou TaichangandClaude Opus 5
|
aff7d64948
|
[Rebase] Rebase to vLLM 0.29.0 (#7230)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-10 12:08:28 +08:00 |
|
|
汪志鹏
|
c59b48b47e
|
[Feature][MiniMax-H3] Complete VSA and Ulysses support (#6909)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-09-02 07:19:21 -04:00 |
|
|
Hongsheng Liu
|
d1c8beeb18
|
[Doc] Update README and docs for v0.28.0 (#6858)
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
|
2026-09-01 19:50:26 +08:00 |
|
|
Zheng Wengangandamy-why-3459
|
94b1546ce3
|
[Model] Qwen3-Omni: register thinker-only pipeline for Instruct serve (#6284)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: Zheng Wengang <zwg0606@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-27 08:21:03 +00:00 |
|
|
|
c2723979c0
|
[Bugfix] Validate per-stage device layout before spawning workers (#5003) (#5742)
Signed-off-by: ChoHee15 <cc5281@126.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-08-26 19:25:22 +00:00 |
|
|
Yueqian LinandYueqian Lin
|
8cfede4309
|
[Perf][Engine] Event-driven orchestration loop (opt-in) — S1 of #4855 (#5221)
Signed-off-by: Yueqian Lin <gao@yueqian.us>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <gao@yueqian.us>
|
2026-08-26 22:15:25 +08:00 |
|
|
amy-why-3459
|
5de6f7c37a
|
[Bugfix][MiniCPM-o] Serve native duplex from shipping YAMLs and fence… (#6619)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-08-26 10:56:51 +08:00 |
|
|
Hongsheng Liu
|
a708ae5b7a
|
[Bugfix] Reconcile env-var inventory with post-#6217 main drift (#6631)
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
|
2026-08-26 06:13:28 +08:00 |
|
|
Hongsheng Liu
|
780e8d40aa
|
[Doc] Add environment variables configuration reference (#6217)
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-08-26 04:58:54 +08:00 |
|
|
|
b39f599b09
|
[Core] Add UniProc diffusion executor for single-GPU (#6308)
Signed-off-by: Rahul Steiger <rsteiger@nvidia.com>
Signed-off-by: Rahul Steiger <rsteiger@aws-cmh-slurm-1-vscode-04.cm.cluster>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Rahul Steiger <rsteiger@aws-cmh-slurm-1-vscode-04.cm.cluster>
|
2026-08-22 21:58:21 +08:00 |
|
|
Yukim1
|
6f55a06fab
|
[Docs] Remove stale stage config references (#6270)
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
|
2026-08-20 07:09:12 +08:00 |
|
|
Yukim1andzwhzzz0821
|
0a1846aa45
|
[Diffusion] Add native KV cache initialization and Scheduler-managed block allocation (#6094)
Signed-off-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com>
Co-authored-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com>
|
2026-08-18 07:00:24 +00:00 |
|
|
Hongsheng Liu
|
265d80b4dd
|
[Docs] Classify PD disaggregation as an experimental feature (#6115)
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-08-17 17:38:44 +08:00 |
|
|
bjf-frz
|
9f978923f2
|
[docs] consolidate diffusion execution modes (#5599)
Signed-off-by: bjf-frz <frz123db@gmail.com>
|
2026-08-05 22:41:18 +08:00 |
|
|
Hongsheng Liu
|
30cba84222
|
[Doc] Update README and installation docs for v0.26.0 (#5715)
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
|
2026-08-04 14:18:51 +08:00 |
|
|
Yukim1
|
7a2007cc17
|
[Refactor] Remove legacy --stage-configs-path from the serve CLI (#5647)
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
|
2026-08-03 23:41:52 +08:00 |
|
|
bjf-frzandHongsheng Liu
|
be667a8067
|
[Refact] Refactor diffusion output streaming (#5166)
Signed-off-by: bjf-frz <frz123db@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-07-23 10:06:08 +08:00 |
|
|
Bingyu (Spencer) Liu
|
dcf8b07d39
|
[Core] Cleanup Omni connector runtime and transfer backends (#5096)
Signed-off-by: spencerr221 <liubingyu62@gmail.com>
|
2026-07-22 09:44:15 +08:00 |
|
|
|
4fbbdfd250
|
[Refactor] Migrate Legacy Stage Configs to the Pipeline Registry (#5031)
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
Co-authored-by: zwhzzz0821 <zwhzzz0821@users.noreply.github.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-07-18 09:34:33 +00:00 |
|
|
Hongsheng Liuandhsliu_ustc
|
625892032b
|
[Doc] Standardize serving names and identifiers (#5081)
Signed-off-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Co-authored-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
|
2026-07-13 23:59:42 +08:00 |
|
|
|
ff6f0da271
|
[Core] Composable parallel: Phase 1 strategy overlay (TP/DP/stage-replica) (RFC #4084) (#4281)
Signed-off-by: Kushan A. <kahmadian@nvidia.com>
Signed-off-by: kushanam <kushanam@users.noreply.github.com>
Signed-off-by: Kushan A <kahmadian@nvidia.com>
Signed-off-by: kahmadian <kahmadian@users.noreply.github.com>
Co-authored-by: kushanam <kushanam@users.noreply.github.com>
Co-authored-by: kahmadian <kahmadian@users.noreply.github.com>
|
2026-07-10 21:29:24 -06:00 |
|
|
amy-why-3459
|
9a44e7e019
|
[Refactor][Phase 1]Remove redundant functions and logs (#4986)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-07-10 15:13:35 +08:00 |
|
|
JiangJie ZhangandSamit
|
c45ac74d43
|
[Core][Frontend] Support request-level batching for diffusion pipelines (#4079)
Signed-off-by: jader <yjader@foxmail.com>
Co-authored-by: Samit <285365963@qq.com>
|
2026-06-29 18:09:19 +02:00 |
|
|
Isaac Hung
|
e9d4931781
|
[Core] Remove dead custom_process_input_func hooks in stage input processors (#4531)
Signed-off-by: Isaac Hung <manhei5001@gmail.com>
|
2026-06-29 05:17:25 +02:00 |
|
|
amy-why-3459
|
0470e96771
|
[Docs] Modify Qwen3-Omni's recipe (#3109)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-04-27 21:41:13 +08:00 |
|
|
amy-why-3459
|
e375b12680
|
[Refactor] Remove the default value "mp" from distributed_executor_backend. (#3007)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-04-25 11:48:03 +08:00 |
|
|
wuhang
|
2e067bbc24
|
[Docs] CLI Docs updates (#2978)
Signed-off-by: wuhang <wuhang6@huawei.com>
|
2026-04-24 11:25:22 +08:00 |
|
|
|
a3903810fe
|
[Config Refactor][2/N] Pipeline + Deploy Config Schema (#2383)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: xiaohajiayou <75477391+xiaohajiayou@users.noreply.github.com>
Co-authored-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-04-19 14:36:00 +12:00 |
|
|
Nick CaoandClaude
|
f2edb81a59
|
[Cleanup] Remove dead runtime.defaults config parameters (#2343)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-04-17 23:36:41 +08:00 |
|
|
Didan Deng
|
911be0d426
|
[skip ci][Doc] Refine the Diffusion Features User Guide (#1928)
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
|
2026-03-30 14:28:04 +08:00 |
|
|
Zhou Taichang
|
05d8de813e
|
[Bugfix] Remove duplicated config keyword max batch size (#1851)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
|
2026-03-20 16:13:24 +08:00 |
|
|
|
3158e9d28f
|
[Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring (#1908)
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn>
Signed-off-by: Peiqi Yin <yinpeiqi809@gmail.com>
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Signed-off-by: wuhang <whlbx@hotmail.com>
Signed-off-by: linyueqian <linyueqian@outlook.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn>
Co-authored-by: Peiqi Yin <yinpeiqi809@gmail.com>
Co-authored-by: wuhang <whlbx@hotmail.com>
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: lishunyang <lishunyang12@163.com>
|
2026-03-18 17:33:53 +08:00 |
|
|
Jinheng
|
88caaf182b
|
[Feature] Split #1303 Part 1: PD disaggregation scaffolding (#1863)
Signed-off-by: Jinheng Li <ahengljh@gmail.com>
|
2026-03-16 14:05:19 +08:00 |
|
|
汪志鹏
|
11d9ca8f41
|
[Feature]: Enable directly use OmniLLM init AR model (#1821)
|
2026-03-12 04:24:10 +00:00 |
|
|
Yuanheng Zhao
|
3b2b5012eb
|
[Doc] Fix links in the configuration doc (#1615)
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
|
2026-03-03 04:52:51 +00:00 |
|
|
汪志鹏andCursor
|
e37a89ffcb
|
[Feature]: Support cfg kv-cache transfer in multi-stage (#1422)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-03-02 05:06:28 +00:00 |
|
|
Yanick Schraner
|
97f4c5b1e7
|
[Bugfix] Add TTS configuration options (#1177)
Signed-off-by: Yanick Schraner <yanick.schraner@bs.ch>
|
2026-02-26 00:14:44 +08:00 |
|
|
Canlin Guo
|
c9392dff01
|
[Hardware] Support platforms and plugin system (#774)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-01-28 22:12:52 +08:00 |
|