 tzhouam
|
3c52432100
|
Merge branch 'main' into dev/vllm-align
|
2026-03-20 01:38:43 +00:00 |
|
|
Yuanheng Zhao
|
6ac7ba692d
|
[Feat] Support T5 Tensor Parallelism (#1881)
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com>
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
|
2026-03-20 08:49:01 +08:00 |
|
|
|
b766c4702c
|
Int8 Quantization Support for DiT (Z-Image & Qwen-Image) (#1470)
Signed-off-by: juboyu <767868009@qq.com>
Signed-off-by: JuboYu <767868009@qq.com>
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
|
2026-03-19 22:58:29 +08:00 |
|
|
tzhouam
|
367ce6328c
|
Merge remote-tracking branch 'remotes/origin/main' into dev/vllm-align
|
2026-03-19 09:38:17 +00:00 |
|
|
rongfu.leng
|
f9268822cd
|
[Bugfix] fix helios video generate use cpu device (#1915)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
|
2026-03-19 16:51:45 +08:00 |
|
|
Dnoob
|
48b3969717
|
[Bugfix] Fix Ovis Image crash when guidance_scale is set without negative_prompt (#1956)
Signed-off-by: Dnoob <dxpouo@gmail.com>
|
2026-03-19 16:51:02 +08:00 |
|
|
tzhouam
|
37e055ed9e
|
Merge remote-tracking branch 'remotes/origin/main' into dev/vllm-align
|
2026-03-19 08:49:35 +00:00 |
|
|
SamitandHongsheng Liu
|
5699fe7a96
|
[Bugfix] Fix config misalignment between offline and online diffusion inference (Wan2.2, Qwen-Image series) (#1979)
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-19 16:00:26 +08:00 |
|
|
tzhouam
|
22b6703773
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
|
2026-03-19 05:16:40 +00:00 |
|
|
tzhouam
|
034d579d77
|
Update vLLM precompiled wheel version and refactor various components for improved functionality and error handling. Changes include modifying the get_name method in DiffusionQuantizationConfig to use class-level attributes, enhancing metadata handling in StageEngineCoreClient, and adjusting the AsyncOmni class constructor for better parameter management. Additionally, improved error handling in omni_snapshot_download and optimized initial chunk size computation in talker2code2wav_async_chunk for dynamic load adaptation.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-19 05:14:34 +00:00 |
|
|
|
fde4808723
|
[Performance] diffusion timing (#1757)
Signed-off-by: dengyunyang <584797741@qq.com>
Signed-off-by: bjf-frz <frz123db@gmail.com>
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: bjf-frz <frz123db@gmail.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
|
2026-03-19 12:26:12 +08:00 |
|
|
Joshna-Medisettyandgcanlin
|
ca6c7ad2be
|
Fix OmniGen2 transformer config loading for HF models (#1934)
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-19 10:21:54 +08:00 |
|
|
SYLAR
|
53ebdd0b1d
|
[Bug]: fix CUDA OOM during diffusion post-processing (#1670)
Signed-off-by: lishunyang <lishunyang12@163.com>
|
2026-03-18 14:59:58 +00:00 |
|
|
Y. FisherandCanlin Guo
|
f52b51533a
|
[Feature] Add cache-dit support for HunyuanImage3 (#1848)
Signed-off-by: KexiongYu <yukexiong1@huawei.com>
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-03-18 10:18:27 +00:00 |
|
|
|
3158e9d28f
|
[Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring (#1908)
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn>
Signed-off-by: Peiqi Yin <yinpeiqi809@gmail.com>
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Signed-off-by: wuhang <whlbx@hotmail.com>
Signed-off-by: linyueqian <linyueqian@outlook.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn>
Co-authored-by: Peiqi Yin <yinpeiqi809@gmail.com>
Co-authored-by: wuhang <whlbx@hotmail.com>
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: lishunyang <lishunyang12@163.com>
|
2026-03-18 17:33:53 +08:00 |
|
|
Lancer
|
9aae75c3ee
|
[Feat] support HSDP for Flux family (#1900)
Signed-off-by: Lancer <maruixiang6688@gmail.com>
|
2026-03-15 22:48:12 +08:00 |
|
|
Lancer
|
2472c360aa
|
[Feat] support SP for FLUX.2-klein (#1250)
Signed-off-by: Lancer <maruixiang6688@gmail.com>
|
2026-03-15 12:18:12 +08:00 |
|
|
Lancer
|
af012babf8
|
[Bugfix] Fix cpu offload and quantization compatibility (#1473)
Signed-off-by: Lancer <maruixiang6688@gmail.com>
|
2026-03-14 18:55:30 +00:00 |
|
|
|
5377619c0b
|
fix: propagate parallel_config through create_default_diffusion (#1878)
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-14 17:07:13 +08:00 |
|
|
Alex Brooks
|
e17130090c
|
[BugFix] Fix Max Rank Handling in LoRA (#1397)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
|
2026-03-14 02:42:54 +00:00 |
|
|
dengyunyang
|
3e8cb6c631
|
[Diffusion] [Model] Dreamid omni (#1855)
Signed-off-by: dengyunyang <584797741@qq.com>
|
2026-03-13 21:53:06 +08:00 |
|
|
|
92f771d455
|
[Frontend] Rewrite video API for async job lifecycle (#1665)
Signed-off-by: Ian Eaves <ian.k.eaves@gmail.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Samit <285365963@qq.com>
Co-authored-by: Gao Han <gaohan19@huawei.com>
|
2026-03-13 17:11:06 +08:00 |
|
|
Lancer
|
53a3df7309
|
[Bugfix] fix layer-wise offload incompatible with cache-dit (#1786)
Signed-off-by: Lancer <maruixiang6688@gmail.com>
|
2026-03-13 15:28:13 +08:00 |
|
|
SYLAR
|
75056b2db2
|
[Bugfix] Fix SD3.5-medium attn2 uninitialized weights (#1659)
Signed-off-by: lishunyang <lishunyang12@163.com>
|
2026-03-13 14:58:17 +08:00 |
|
|
Alex BrooksandDidan Deng
|
c8cf8a799d
|
[Refactor] Use SP Plan for LongCat Sequence Parallelism (#1772)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
|
2026-03-13 11:13:34 +08:00 |
|
|
Du Bin
|
8ad8988e2b
|
[Bugfix] Fix Helios text_encoder embed_tokens all-zeros due to untied weights (#1728)
Signed-off-by: OSS Scout <scout@oss-scout.local>
|
2026-03-12 15:28:21 +00:00 |
|
|
|
28dd1a699d
|
[Model] Extend NPU support for HunyuanImage3 Diffusion Model (#1689)
Signed-off-by: ElleElleWu <1608928702@qq.com>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: skf1999 <13234016272@163.com>
Co-authored-by: Just-it <1161406585@qq.com>
Co-authored-by: Semmer2 <semmer@live.cn>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-12 20:49:17 +08:00 |
|
|
|
fe7e8770db
|
[Feature]: support Flux.2-dev cache_dit (#1814)
Co-authored-by: wuzhongjian <wuzhongjian@cmss.chinamobile.com>
Co-authored-by: Gao Han <gaohan19@huawei.com>
|
2026-03-12 19:53:47 +08:00 |
|
|
汪志鹏
|
a52867abde
|
[BugFix]: Revert #1582 (#1842)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
|
2026-03-12 19:19:57 +08:00 |
|
|
Vensen
|
3306fa6611
|
[Feat][Diffusion]: Implement Component-Level VRAM Quota and Resource Domain Isolation (#1582)
Signed-off-by: vensen <vensenmu@gmail.com>
|
2026-03-12 12:17:18 +08:00 |
|
|
JohnJanandwuzhongjian
|
4d89ebaa07
|
[Model]: add FLUX.2-dev model (#1629)
Co-authored-by: wuzhongjian <wuzhongjian@cmss.chinamobile.com>
|
2026-03-11 14:44:18 +08:00 |
|
|
Didan DengandCanlin Guo
|
7543f2ff3b
|
[Bugfix]: SP attention not enabling when _sp_plan hooks are not applied (#1704)
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Canlin Guo <961750412@qq.com>
|
2026-03-11 10:49:42 +08:00 |
|
|
Ting FU
|
6ac85d4607
|
[Feat] Enable expert parallel for diffusion MoE layers (#1323)
Signed-off-by: Semmer2 <semmer@live.cn>
|
2026-03-11 10:45:36 +08:00 |
|
|
Hongsheng Liu
|
4027534dbf
|
Revert "Add online serving to Stable Audio Diffusion and introduce v1/audio/generate endpoint" (#1789)
|
2026-03-10 22:40:48 +08:00 |
|
|
Ekagra Ranjan
|
7a560492a2
|
Add online serving to Stable Audio Diffusion and introduce v1/audio/generate endpoint (#1255)
|
2026-03-09 13:36:46 -04:00 |
|
|
Yuanheng Zhao
|
82f63a4403
|
[BugFix] Enable CPU offloading and Cache-DiT together on Diffusion Model (#1723)
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com>
|
2026-03-09 22:25:41 +08:00 |
|
|
汪志鹏
|
7271116973
|
[Bagel]: Support multistage img2img (#1669)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-03-09 22:23:50 +08:00 |
|
|
Samit
|
155856ff30
|
[Perf] Reduce IPC overhead for single-stage diffusion serving for Wan2.2 (#1715)
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
|
2026-03-10 00:03:51 +13:00 |
|
|
|
89b527e533
|
Dev/rebase v0170 (#1639)
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2026-03-09 17:29:38 +08:00 |
|
|
Canlin Guo
|
29357027b0
|
[Bugfix] Allow to enable HSDP alone (#1567)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-09 06:36:13 +00:00 |
|
|
Ding Zuhaoandprincepride
|
fb717a4071
|
[Bagel] Eliminate broadcast in CFG parallel denoising loop (#1695)
Signed-off-by: Ding Zuhao <e1583181@u.nus.edu>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
|
2026-03-09 03:26:21 +00:00 |
|
|
Shenghai Yuanandgcanlin
|
382bbd0a1f
|
[1/N] fix CP for Helios (#1729)
Signed-off-by: Shenghai Yuan <140951558+SHYuanBest@users.noreply.github.com>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-09 02:52:01 +00:00 |
|
|
knlnguyen1802andSamit
|
92e1a54419
|
[RL] Support collective rpc api to entrypoint && Support custom input output (#1646)
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: Samit <285365963@qq.com>
|
2026-03-09 10:12:43 +08:00 |
|
|
Canlin Guo
|
c3a59f10f3
|
[NPU] Support Helios-Mid / Distilled (#1648)
|
2026-03-08 17:24:25 +08:00 |
|
|
Canlin Guo
|
074af30a9b
|
Revert "[Profile] Adding metrics for Diffusion/DiT Single diffusion Pipeline (#668)" (#1724)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-08 00:11:47 +13:00 |
|
|
erfgss
|
b7fcc9d07e
|
[Profile] Adding metrics for Diffusion/DiT Single diffusion Pipeline (#668)
Signed-off-by: Chen Yang <2082464740@qq.com>
Signed-off-by: erfgss <97771661+erfgss@users.noreply.github.com>
|
2026-03-06 15:39:19 +08:00 |
|
|
JohnJanandHongsheng Liu
|
92adcdeab4
|
[feature]: support flux2.klein cache_dit (#1209)
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-06 14:46:57 +08:00 |
|
|
Ding Zuhaoand汪志鹏
|
128e6f4b97
|
[Feature][Bagel] Add CFG parallel mode (#1578)
Signed-off-by: Ding Zuhao <e1583181@u.nus.edu>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-03-06 09:55:54 +08:00 |
|
|
Canlin Guo
|
d5ddc190f9
|
[UX] Add progress bar for diffusion models (#1652)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-05 23:56:14 +08:00 |
|
|
WeiQing Chen
|
83fe7d005b
|
[Model] support LTX-2 text-to-video image-to-video (#841)
Signed-off-by: David Chen <530634352@qq.com>
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
|
2026-03-05 23:31:48 +08:00 |
|