 Daniel Huang
|
ac17431745
|
[Enhancement] Patch OmniStage.try_collect() with _proc alive checks (#1560)
Signed-off-by: Daniel Huang <daniel1.huang@intel.com>
|
2026-03-12 10:40:42 +08:00 |
|
|
Yueqian Lin
|
e1efcb7560
|
Fix duplicate get_supported_tasks definition in async_omni.py (#1825)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-11 19:43:37 -04:00 |
|
|
Yueqian Lin
|
f144f5effe
|
[Test] Add Qwen3-TTS nightly performance benchmark (#1700)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-12 01:07:47 +08:00 |
|
|
Yueqian Lin
|
a6b5519616
|
[Bugfix] Report supported tasks for omni models to skip unnecessary chat init (#1645)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-12 01:06:20 +08:00 |
|
|
Lancer
|
0f7c9c755d
|
[Bugfix] Expose base_model_paths property in _DiffusionServingModels (#1771)
Signed-off-by: Lancer <maruixiang6688@gmail.com>
|
2026-03-11 20:52:10 +08:00 |
|
|
JohnJanandwuzhongjian
|
4d89ebaa07
|
[Model]: add FLUX.2-dev model (#1629)
Co-authored-by: wuzhongjian <wuzhongjian@cmss.chinamobile.com>
|
2026-03-11 14:44:18 +08:00 |
|
|
NumberWan
|
617b1d6053
|
Add coordinator module and corresponding unit test (#1465)
Signed-off-by: Jeff Wan <wantszkin2003@gmail.com>
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
|
2026-03-11 14:36:48 +08:00 |
|
|
Didan DengandCanlin Guo
|
7543f2ff3b
|
[Bugfix]: SP attention not enabling when _sp_plan hooks are not applied (#1704)
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Canlin Guo <961750412@qq.com>
|
2026-03-11 10:49:42 +08:00 |
|
|
Ting FU
|
6ac85d4607
|
[Feat] Enable expert parallel for diffusion MoE layers (#1323)
Signed-off-by: Semmer2 <semmer@live.cn>
|
2026-03-11 10:45:36 +08:00 |
|
|
Junhong Liu
|
2ee4a07adb
|
[Refactor][Perf] Qwen3-omni: code predictor with re-prefill + SDPA and eliminate decode hot-path CPU round-trips (#1758)
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
|
2026-03-11 07:52:21 +08:00 |
|
|
Juan Pablo Zuluagaandpablo
|
1d0a97f0d1
|
[feat][Qwen3TTS] Simple dynamic TTFA based on Code2Wav load (#1714)
Signed-off-by: pablo <pablo@agigo.ai>
Co-authored-by: pablo <pablo@agigo.ai>
|
2026-03-10 21:02:33 +00:00 |
|
|
Baoyuan Qi
|
2fdc647ed7
|
[BUGFIX] Add compatibility for mimo-audio with vLLM 0.17.0 (#1752)
Signed-off-by: Baoyuan Qi <qibaoyuan@xiaomi.com>
|
2026-03-10 20:57:26 +00:00 |
|
|
Hongsheng Liu
|
4027534dbf
|
Revert "Add online serving to Stable Audio Diffusion and introduce v1/audio/generate endpoint" (#1789)
|
2026-03-10 22:40:48 +08:00 |
|
|
Ekagra Ranjan
|
7a560492a2
|
Add online serving to Stable Audio Diffusion and introduce v1/audio/generate endpoint (#1255)
|
2026-03-09 13:36:46 -04:00 |
|
|
Sy03
|
761eff930a
|
[Fix][Qwen3-TTS] Preserve ref_code decoder context for Base ICL (#1731)
|
2026-03-09 13:36:27 -04:00 |
|
|
Yuanheng Zhao
|
82f63a4403
|
[BugFix] Enable CPU offloading and Cache-DiT together on Diffusion Model (#1723)
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com>
|
2026-03-09 22:25:41 +08:00 |
|
|
汪志鹏
|
7271116973
|
[Bagel]: Support multistage img2img (#1669)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-03-09 22:23:50 +08:00 |
|
|
Samit
|
155856ff30
|
[Perf] Reduce IPC overhead for single-stage diffusion serving for Wan2.2 (#1715)
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
|
2026-03-10 00:03:51 +13:00 |
|
|
|
89b527e533
|
Dev/rebase v0170 (#1639)
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2026-03-09 17:29:38 +08:00 |
|
|
Canlin Guo
|
29357027b0
|
[Bugfix] Allow to enable HSDP alone (#1567)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-09 06:36:13 +00:00 |
|
|
Ding Zuhaoandprincepride
|
fb717a4071
|
[Bagel] Eliminate broadcast in CFG parallel denoising loop (#1695)
Signed-off-by: Ding Zuhao <e1583181@u.nus.edu>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
|
2026-03-09 03:26:21 +00:00 |
|
|
|
41964cb90a
|
feat(tts): add voice upload API for Qwen3-TTS (#1201)
Signed-off-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-03-09 11:02:11 +08:00 |
|
|
Shenghai Yuanandgcanlin
|
382bbd0a1f
|
[1/N] fix CP for Helios (#1729)
Signed-off-by: Shenghai Yuan <140951558+SHYuanBest@users.noreply.github.com>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-09 02:52:01 +00:00 |
|
|
knlnguyen1802andSamit
|
92e1a54419
|
[RL] Support collective rpc api to entrypoint && Support custom input output (#1646)
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Samit <285365963@qq.com>
|
2026-03-09 10:12:43 +08:00 |
|
|
Yueqian Lin
|
a9f694b08a
|
[Bugfix] Use upstream MediaConnector for ref_audio resolution (#1661)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-09 01:38:26 +00:00 |
|
|
Roman Koshkin
|
0e432e524c
|
[Bugfix] (qwen3_tts): enable batched offline inference by fixing tens… (#1417)
Signed-off-by: Roman Koshkin <roman.koshkin@sbintuitions.co.jp>
|
2026-03-09 09:17:10 +08:00 |
|
|
Canlin Guo
|
c3a59f10f3
|
[NPU] Support Helios-Mid / Distilled (#1648)
|
2026-03-08 17:24:25 +08:00 |
|
|
Canlin Guo
|
074af30a9b
|
Revert "[Profile] Adding metrics for Diffusion/DiT Single diffusion Pipeline (#668)" (#1724)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-08 00:11:47 +13:00 |
|
|
Didan Deng
|
30191ed112
|
[Feature]: Add vae-patch-parallel CLI argument in online serving (#1716)
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
|
2026-03-07 01:45:02 +08:00 |
|
|
erfgss
|
b7fcc9d07e
|
[Profile] Adding metrics for Diffusion/DiT Single diffusion Pipeline (#668)
Signed-off-by: Chen Yang <2082464740@qq.com>
Signed-off-by: erfgss <97771661+erfgss@users.noreply.github.com>
|
2026-03-06 15:39:19 +08:00 |
|
|
JohnJanandHongsheng Liu
|
92adcdeab4
|
[feature]: support flux2.klein cache_dit (#1209)
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-06 14:46:57 +08:00 |
|
|
Canlin Guo
|
846167b237
|
[1/N][Refactor] Clean up dead code in output processor (#1579)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-06 14:45:53 +08:00 |
|
|
Yueqian Lin
|
3bc89de0c0
|
Add non-async chunk support for Qwen3-TTS (#1678)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-06 14:45:32 +08:00 |
|
|
Baoyuan Qi
|
32fd084ae2
|
[MiMo-Audio] Bugfix tp lg than 1 (#1688)
Signed-off-by: 齐保元 <qibaoyuan@xiaomi.com>
|
2026-03-06 14:45:08 +08:00 |
|
|
Sy03
|
90ec499bd5
|
[Refactor][Perf] Qwen3-TTS: re-prefill Code Predictor with torch.compile + enable Code2Wav decoder CUDA Graph (#1617)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-03-06 18:21:55 +13:00 |
|
|
|
fd51841230
|
perf: replace per-element .item() GPU syncs with batch .tolist() in TTS code predictor (#1614)
Signed-off-by: dubin555 <dubin555@gmail.com>
Signed-off-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-03-06 12:22:01 +08:00 |
|
|
Ding Zuhaoand汪志鹏
|
128e6f4b97
|
[Feature][Bagel] Add CFG parallel mode (#1578)
Signed-off-by: Ding Zuhao <e1583181@u.nus.edu>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-03-06 09:55:54 +08:00 |
|
|
|
c0b714a8ac
|
[Feature] Support flexible task_type configuration for Qwen3-TTS models (#1197)
Signed-off-by: Jack Lee <695697442@qq.com>
Signed-off-by: jackleehal <695697442@qq.com>
Co-authored-by: google-labs-jules[bot] <161369871+google-labs-jules[bot]@users.noreply.github.com>
Co-authored-by: JackLeeHal <15664755+JackLeeHal@users.noreply.github.com>
|
2026-03-05 13:39:09 -05:00 |
|
|
zhanqiuhuandYueqian Lin
|
e643aaec15
|
[Bugfix] Fix all-silence TTS output: use float32 for speech tokenizer decoder (#1664)
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-03-06 00:04:26 +08:00 |
|
|
Canlin Guo
|
d5ddc190f9
|
[UX] Add progress bar for diffusion models (#1652)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-05 23:56:14 +08:00 |
|
|
Lidang Jiang
|
28c2200b47
|
[BugFix] Return proper HTTP status for ErrorResponse in create_speech (#1687)
Signed-off-by: Lidang-Jiang <lidangjiang@gmail.com>
|
2026-03-05 23:38:20 +08:00 |
|
|
WeiQing Chen
|
83fe7d005b
|
[Model] support LTX-2 text-to-video image-to-video (#841)
Signed-off-by: David Chen <530634352@qq.com>
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
|
2026-03-05 23:31:48 +08:00 |
|
|
Juan Pablo Zuluagaandpablo
|
6a45efb287
|
[Feat][Qwen3TTS] reduce TTFA with flexible initial phase (#1583)
Signed-off-by: pablo <pablo@agigo.ai>
Co-authored-by: pablo <pablo@agigo.ai>
|
2026-03-05 23:14:41 +08:00 |
|
|
Ziming Huang
|
070ea0ddc3
|
[Optimize][Qwen3-Omni] Reduce inter-packet latency in async chunk (#1656)
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com>
|
2026-03-05 22:26:30 +08:00 |
|
|
rongfu.leng
|
562136d390
|
[Misc] remove logits_processor_pattern this field, because vllm have … (#1675)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
|
2026-03-05 09:36:19 +00:00 |
|
|
Alex Brooks
|
fa944bd8e8
|
[BugFix] Fix LongCat Sequence Parallelism / Small Cleanup (#1631)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
|
2026-03-05 17:31:00 +08:00 |
|
|
zhou zhuoxin
|
58eb1c68db
|
[FP8 Quantization] Add FP8 quantization support for Flux transformer (#1640)
Signed-off-by: zhou zhuoxin <zhouzhuoxin1508@outlook.com>
|
2026-03-05 11:08:34 +08:00 |
|
|
|
5493e75877
|
[NPU] [Features] [Bugfix] Support mindiesd adaln (#1537)
Signed-off-by: jiangmengyu18 <451528648@qq.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
|
2026-03-05 09:01:19 +08:00 |
|
|
SYLAR
|
c316153b49
|
[Bugfix] Enable torch.compile for low noise model (transformer_2) (#1541)
Signed-off-by: lishunyang <lishunyang12@163.com>
|
2026-03-05 09:00:34 +08:00 |
|
|
dsinghviandHongsheng Liu
|
b63e7c7c9a
|
[Model] Fun cosy voice3-0.5-b-2512 (#498)
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-04 19:54:59 -05:00 |
|