amy-why-3459
|
5dd1d0a772
|
[BugFix] Fix prefix-caching issue (#3726)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-05-29 01:51:54 +00:00 |
|
Dakai An
|
bb9f21d0db
|
Fix Qwen3-omni accuracy degradation from deepstack inputs under torch.compile (#3885)
Signed-off-by: Dakai An <dakaian108@gmail.com>
|
2026-05-28 23:57:56 +08:00 |
|
 amy-why-3459andHongsheng Liu
|
748470c1fb
|
[BugFix] code2wav supports disabling CUDA graph. (#3732)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-05-24 00:05:55 +08:00 |
|
amy-why-3459
|
e7ee5de09f
|
[BugFix] Fix the issue of thinker requests being preempted, causing shape mismatch. (#3147)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-05-15 17:07:42 +08:00 |
|
 NATUREandHongsheng Liu
|
82a0b3a467
|
[2/5] [core]refactor communication layer: PR 2 of 5 Qwen3 Omni non async (#2677)
Signed-off-by: natureofnature <wzliu@connect.hku.hk>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-05-15 14:14:08 +08:00 |
|
 Nick CaoandClaude
|
bd4ede391b
|
[Perf] Remove dead audio_tower and visual from Qwen3-Omni talker stage (#3296)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-05-11 16:04:56 +00:00 |
|
 
|
b25ea13cb0
|
[BugFix] Fixed a precision issue with one-word answers. (#3385)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Canlin Guo <961750412@qq.com>
|
2026-05-07 06:21:00 +08:00 |
|
 Juan Pablo ZuluagaandYueqian Lin
|
19f8f42822
|
[Feat][Qwen3-Omni] Add CUDA graph support for Code2Wav decoder (#2376)
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-05-07 06:16:03 +08:00 |
|
 Alex BrooksandSYLAR
|
bede8e02d8
|
[Misc] Remove Entrypoint Hijack for vLLM / 0.20.0 Changes (#3082)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
|
2026-04-30 12:00:21 +00:00 |
|
 Zhou TaichangandYuanheng Zhao
|
7f2b1e9386
|
[Rebase] Rebase to vllm 0.20.0 (#3232)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com>
|
2026-04-30 09:56:59 +12:00 |
|
 
|
2390350533
|
[Refactor] Standardize data entry key names to {type}.{qualifier} format (#1829)
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-04-25 18:15:38 +08:00 |
|
 Liang LvandSYLAR
|
ee15f39ea7
|
[AutoRound] Support Qwen Omni W4A16 quantization model (#2670)
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
|
2026-04-22 19:54:45 +08:00 |
|
 GXINandgcanlin
|
9d1392dcfc
|
[NPU] Support code predictor NPU graph (#2695)
Signed-off-by: XIN GAO <1037396230@qq.com>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
|
2026-04-22 10:15:08 +00:00 |
|
Haco
|
ad7c966b1d
|
[BugFix] add missing subtalker sampling config to Qwen3-TTS deploy YAML (#2940)
Signed-off-by: xiaohajiayou <923390377@qq.com>
|
2026-04-21 14:47:22 +08:00 |
|
SYLAR
|
cd384d95f3
|
[Config Refactor 2.5/N] Centralize pipeline registry (#2915)
Signed-off-by: lishunyang <lishunyang12@163.com>
|
2026-04-20 01:18:03 +08:00 |
|
   
|
a3903810fe
|
[Config Refactor][2/N] Pipeline + Deploy Config Schema (#2383)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: xiaohajiayou <75477391+xiaohajiayou@users.noreply.github.com>
Co-authored-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-04-19 14:36:00 +12:00 |
|
ChenWenjing
|
4124a1f858
|
[Feature]Support audio streaming input and output-phase2 (#2581)
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>
|
2026-04-18 15:42:41 +08:00 |
|
Bingyu (Spencer) Liu
|
a5a4998ece
|
[Feature] Support Prefill-Decode disaggregation via vLLM KV transfer (#2220)
Signed-off-by: LiuBingyu <liubingyu62@gmail.com>
|
2026-04-17 18:43:17 +08:00 |
|
 Juan Pablo ZuluagaandHongsheng Liu
|
82f8c93343
|
[Feat][Qwen3-Omni] Shared code predictor module for Qwen3-TTS and Qwen3-Omni (#2375)
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-04-15 15:14:57 +08:00 |
|
 Yiyang "Ian" LiuandCopilot
|
53a9cf49a6
|
fix: do not apply FP8 quant config to vision/audio encoders for pre-quantized checkpoints (#2702)
Signed-off-by: Yiyang Liu <37043548+ianliuy@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
|
2026-04-14 13:52:32 +00:00 |
|
 ReidandHongsheng Liu
|
38dfe56fdf
|
[Bugfix] Validate speaker in chat endpoint and fix case-insensitive lookup (#2407)
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-04-12 00:14:16 -04:00 |
|
Zhou Taichang
|
2804a85e58
|
[Rebase] Rebase to vllm v0.19.0 (#2475)
|
2026-04-04 15:03:32 +08:00 |
|
 ChenWenjingandHongsheng Liu
|
728cf6d023
|
[Feature] add session based audio streaming input (#2208)
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-04-02 22:51:41 +08:00 |
|
rein yang
|
ca02351a1e
|
[skip ci][Bugfix] clean useless log (#2450)
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
|
2026-04-02 18:07:22 +08:00 |
|
Junhong Liu
|
a3e1322ad9
|
Qwen3-Omni][Bugfix] Replace vLLM fused layers with HF-compatible numerics in code predictor (#2291)
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
|
2026-03-28 23:02:44 +08:00 |
|
amy-why-3459
|
9f667ee151
|
[BugFix][Qwen3-Omni]Fixed the issue of incorrect answers for single words. (#2239)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-03-27 11:46:24 +08:00 |
|
amy-why-3459
|
029c85393a
|
[BugFix]Fix keyError: num_processed_tokens_delta (#2213)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-03-26 15:16:25 +08:00 |
|
Sy03
|
d15c91d6d2
|
[Bugfix] Fix qwen3-omni async thinker to talker decode alignment for #1758 (#2019)
|
2026-03-26 11:07:11 +08:00 |
|
SYLAR
|
6b93459826
|
[Core] Unified quantization framework (#1764)
|
2026-03-24 18:56:55 +08:00 |
|
rein yang
|
3cdf28828e
|
[Feature] support to change the speaker of qwen3-omni (#1963)
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
|
2026-03-24 13:53:24 +08:00 |
|
Alicia
|
b0efb6ede0
|
[Doc] Sync and fix. (#2110)
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
|
2026-03-24 03:20:50 +00:00 |
|
 Zhou Taichangandgcanlin
|
a90a7690b8
|
[Rebase] Rebase to vllm v0.18.0 (#2037)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-21 20:37:38 +08:00 |
|
Junhong Liu
|
6901ba426e
|
[Fixbug][Perf] Qwen3-omni: code predictor with re-prefill + SDPA and eliminate decode hot-path CPU round-trips (#2012)
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
|
2026-03-20 19:33:52 +08:00 |
|
rein yang
|
60a8c01a96
|
[Bugfix] revert PR#1758 which introduced the accuracy problem of qwen3-omni (#2009)
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
|
2026-03-19 17:34:01 +08:00 |
|
Canlin Guo
|
9718a9e369
|
[NPU] Upgrade to v0.17.0 (#1890)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-16 14:42:59 +08:00 |
|
Junhong Liu
|
2ee4a07adb
|
[Refactor][Perf] Qwen3-omni: code predictor with re-prefill + SDPA and eliminate decode hot-path CPU round-trips (#1758)
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
|
2026-03-11 07:52:21 +08:00 |
|
  
|
89b527e533
|
Dev/rebase v0170 (#1639)
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2026-03-09 17:29:38 +08:00 |
|
Ziming Huang
|
070ea0ddc3
|
[Optimize][Qwen3-Omni] Reduce inter-packet latency in async chunk (#1656)
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
|
2026-03-05 22:26:30 +08:00 |
|
Junhong Liu
|
742d845b8e
|
Make chunk_size and left_context_size configurable via YAML for async chunking (#1423)
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Signed-off-by: Junhong Liu <ljh_lbj@163.com>
|
2026-03-03 22:06:52 +08:00 |
|
 dsinghviandZhou Taichang
|
68764cc4f4
|
[Refactor]: Phase1 for rebasing_additional_info (#1394)
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk>
|
2026-03-02 10:19:41 +08:00 |
|
Zhou Taichang
|
fe0c02ee78
|
[Debug] Merge vllm pull 35368 (#1534)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-02-28 10:39:25 +08:00 |
|
 
|
e1337c89c7
|
[BugFix] Restore talker's config (#1524)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Canlin Guo <961750412@qq.com>
|
2026-02-27 06:44:11 +08:00 |
|
amy-why-3459
|
66c3e04263
|
[Performance]Qwen3-Omni performance optimization (#1378)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-02-26 21:21:36 +08:00 |
|
Canlin Guo
|
22c8cde328
|
[NPU] Upgrade to v0.16.0 (#1375)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-02-26 14:26:50 +08:00 |
|
Zhou Taichang
|
8e950daf6a
|
[Debug] Multi-Request for Qwen 3 Omni use_audio_in_video (#1433)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-02-26 09:26:25 +08:00 |
|
 Canlin GuoandHongsheng Liu
|
af11b02081
|
[Minor][Refactor] Pass seq_token_counts explicitly (#1425)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-02-24 14:10:00 +08:00 |
|
    
|
75770c9309
|
[Rebase] Rebase to vllm v0.16.0 (#1357)
ComfyUI Integration -- Publish to Comfy registry / Publish Custom Node to registry (push) Failing after 44s
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: ZJY0516 <zhu.jiangyun@foxmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
|
2026-02-13 18:05:07 +08:00 |
|
 
|
0b56fba7b3
|
[Pref] Support Qwen3 Omni code2wav batch infernce with async chunk (#1246)
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Signed-off-by: Ziming Huang <1520787127@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
|
2026-02-12 11:50:10 +08:00 |
|
rein yang
|
963b64e7ae
|
[Bugfix] fix precision issues of qwen3-omni when enable async_chunk without system prompt (#1288)
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
|
2026-02-11 10:03:41 +08:00 |
|
Canlin Guo
|
285d71b26a
|
[Refactor] Reuse upstream Qwen3MoeSparseMoeBlock (#1202)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-02-06 01:06:50 +00:00 |
|