wuhang
4bee33744f
[Bugfix] Use uds for zmq address if not set --stage-id ( #1522 )
...
Signed-off-by: wuhang <wuhang6@huawei.com >
2026-02-26 21:44:07 +08:00
zhumingjue138
c22019b93a
[CI] fixed CI timeout ( #1460 )
...
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
Signed-off-by: zhumingjue138 <zhumingjue@huawei.com >
2026-02-26 21:31:36 +08:00
Canlin Guo and Hongsheng Liu
f53152d340
[Feature] Support HSDP for diffusion models ( #1339 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-26 21:31:10 +08:00
amy-why-3459
66c3e04263
[Performance]Qwen3-Omni performance optimization ( #1378 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-02-26 21:21:36 +08:00
Zeyu Huang | 黃澤宇 and Samit
b44a615625
[Doc][Test][Misc] ComfyUI test, more screenshot, and code cleaning ( #1435 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-02-26 21:03:54 +08:00
knlnguyen1802 and Hongsheng Liu
5361353be5
[Bugfix] Race condition in MultiprocExecutor when concurent access to Scheduler ( #1448 )
...
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-26 21:03:38 +08:00
03c01e0415
[Qwen3TTS][Feat] Streaming output ( #1438 )
...
Signed-off-by: pablo <pablo@agigo.ai >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: pablo <pablo@agigo.ai >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-26 21:02:35 +08:00
Zeyu Huang | 黃澤宇 and Gao Han
c68be4dc4b
[Chore] remove unused logger in omni_diffusion ( #531 ) ( #1509 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Gao Han <gaohan19@huawei.com >
2026-02-26 20:30:35 +08:00
Kevin H. Luu
840559ad71
Revert gpu_1 job to use regular image ( #1521 )
...
Signed-off-by: Kevin H. Luu <khluu000@gmail.com >
2026-02-26 20:29:35 +08:00
Yan Ma
cf1f4c6338
[XPU] Enable FLASH_ATTN on XPU ( #1332 )
...
Signed-off-by: Yan Ma <yan.ma@intel.com >
2026-02-26 20:28:09 +08:00
WeiQing Chen
7b75c3993a
[Bugfix] fix offline text_to_image error from #1009 ( #1515 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-02-26 20:27:36 +08:00
TJian
881c675087
[ROCm] [CI] [Docker] Point to use the latest vLLM v0.16.0 stable version ( #1500 )
...
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
2026-02-26 19:16:14 +08:00
Kevin H. Luu
d05212cd5f
Use pull through cache image for H100 pool ( #1518 )
...
Signed-off-by: Kevin H. Luu <khluu000@gmail.com >
2026-02-26 19:09:42 +08:00
66457c39fa
[Bugfix][Qwen3TTS] ( #1289 )
...
Signed-off-by: pablo <juanz9312@gmail.com >
Co-authored-by: Gao Han <gaohan19@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-26 18:58:35 +08:00
Yupu
c9786c5c0c
[Model] Support OmniGen2 ( #513 )
...
Signed-off-by: Yupu <feng.yu.pu0330@gmail.com >
2026-02-26 10:34:28 +00:00
Junhong Liu
3eb3aa54ad
[Bugfix] fix record audio generated frame in offline infer ( #1312 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Signed-off-by: Junhong Liu <ljh_lbj@163.com >
2026-02-26 17:23:55 +08:00
Alex Brooks
bc26de834e
[Bugfix] Fix LoRA Scaling on Active Adapters ( #1421 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-02-26 17:22:35 +08:00
Yuanheng Zhao
ed08a216c1
[Misc] Migrate L1 tests to use pytest-mock ( #1315 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-02-26 17:08:39 +08:00
Canlin Guo
9913c00144
[Feature] Support Wan2.2 output with irregular shapes ( #1279 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-02-26 17:03:43 +08:00
Andy Zhou
a2d5b61703
[Doc] format lora related docs for the user's end ( #1009 )
...
Signed-off-by: AndyZhou952 <jzhoubc@connect.ust.hk >
Signed-off-by: Andy Zhou <46011930+AndyZhou952@users.noreply.github.com >
2026-02-26 16:48:29 +08:00
tzhouam
8d0c46487e
Merge origin/main into dev/vllm-align
...
Resolve conflicts:
- docker/Dockerfile.ci: Keep wheel install section, update hash to 6042e66cd5
- vllm_omni/platforms/npu/worker/npu_model_runner.py: Accept main's refactoring
Made-with: Cursor
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-26 08:19:53 +00:00
junuxyz and Hongsheng Liu
caed95fb45
[Bugfix] Fix tuple/list KV cache extraction crash ( #1405 )
...
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-26 15:20:40 +08:00
Yuanheng Zhao
904b97d5bd
[Fix][Chore] Qwen3-TTS Modeling Minor Code Sanity Improvements ( #1482 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-02-26 14:39:08 +08:00
Zhou Taichang
986b356077
[CI] Update Dockerfile for vllm-omni CI image and remove obsolete dep… ( #1491 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-26 14:36:03 +08:00
Canlin Guo
22c8cde328
[NPU] Upgrade to v0.16.0 ( #1375 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-02-26 14:26:50 +08:00
wangyu
1ae2e1e4c4
[Test] Reduce Perf test case and fix modify stage config ( #1449 )
...
Signed-off-by: yenuo26 <410167048@qq.com >
2026-02-26 14:20:57 +08:00
亦瑾
5e7974c15b
[Bugfix] Fix SDPA attention mask dtype and shape ( Fix #857 ) ( #1349 )
...
Signed-off-by: jader <yjader@foxmail.com >
2026-02-26 11:54:28 +08:00
Junhong Liu and Gao Han
919ad28da5
[BugFix] process request.num_cached_tokens if it equals to the initial value ( #1468 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Co-authored-by: Gao Han <gaohan19@huawei.com >
2026-02-26 10:59:18 +08:00
Sangchun Ha
315daeba8c
[Bugfix] Fix case-sensitive task_type matching in Qwen3TTSModelForGeneration ( #1455 )
...
Signed-off-by: Sangchun Ha <seomk9896@gmail.com >
2026-02-26 10:27:13 +08:00
Zhou Taichang
8e950daf6a
[Debug] Multi-Request for Qwen 3 Omni use_audio_in_video ( #1433 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-26 09:26:25 +08:00
Yanick Schraner
97f4c5b1e7
[Bugfix] Add TTS configuration options ( #1177 )
...
Signed-off-by: Yanick Schraner <yanick.schraner@bs.ch >
2026-02-26 00:14:44 +08:00
Dong W and Hongsheng Liu
1eebb374f1
[Model]Add new nextstep_1(Diffusion) model(only T2I) ( #612 )
...
Signed-off-by: Dong Wang <dongw2019@gmail.com >
Signed-off-by: sniper35 <dongw2019@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-26 00:09:11 +08:00
SHIJIN ZHANG
466a7f7a62
[Bugfix]: Fix merging updated additional information to ensure dict type ( #1296 )
...
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com >
2026-02-26 00:06:49 +08:00
Junhong Liu
43939df2a5
[Bugfix] Robust Audio Data Handling in _create_audio_choice ( #1222 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
2026-02-25 22:59:49 +08:00
tzhouam
a252918008
[Update] Upgrade vLLM wheel version and enhance metrics handling
...
- Updated the vLLM wheel to commit 24650715105a26b41c88f4164777b5e1a0f3200b in Dockerfile.ci.
- Modified the `calculate_metrics` function to handle `tokenizer` as optional (can be None) in metrics.py.
- Adjusted the `benchmark` function to accept `tokenizer` as optional in patch.py.
- Enhanced condition checks in OmniARScheduler to ensure valid token generation in omni_ar_scheduler.py.
- Updated input processing to include supported tasks in input_processor.py.
- Cleaned up unnecessary code in output_processor.py.
- Added support for SSL ciphers in the API server configuration in api_server.py.
- Enabled speculative decoding in GPU model runners for improved performance in gpu_generation_model_runner.py and gpu_model_runner.py.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-25 10:02:23 +00:00
tzhouam
22e01c416b
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-02-25 08:15:55 +00:00
Didan Deng
1e86404456
[Doc] Refine Diffusion Tutorial Documents ( #1305 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-02-25 15:43:08 +08:00
WeiQing Chen
bf9754a8b1
[Misc] update wechat image ( #1464 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-02-25 12:06:27 +08:00
Zhou Taichang
296d995ec2
[CI] Remove overwhelming debug log ( #1463 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-25 12:06:01 +08:00
Juan Pablo Zuluaga and pablo
4de077ea62
[Qwen3TTS][Feat] Code2Wav batched decoding ( #1426 )
...
Signed-off-by: pablo <pablo@agigo.ai >
Co-authored-by: pablo <pablo@agigo.ai >
2026-02-25 11:16:46 +13:00
汪志鹏
82e1bf2804
[Doc]: Add bagel single/multi node usage with mooncake document ( #1450 )
2026-02-24 15:54:57 +00:00
Junhong Liu and Hongsheng Liu
c0908dd3fa
[Bugfix] Forward all vllm-omni serve command parameters to model ( #985 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Signed-off-by: Junhong Liu <ljh_lbj@163.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-24 22:20:01 +08:00
Junhong Liu and Hongsheng Liu
a8cec43ce6
[Doc] Optimize vLLM-Omni metrics documentation ( #1311 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
Signed-off-by: Junhong Liu <ljh_lbj@163.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-24 20:27:29 +08:00
36b8f80266
[Feature] Support Stage Based Deployment CLI ( #939 )
...
Signed-off-by: wuhang <wuhang6@huawei.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: wuhang <whlbx@hotmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-02-24 16:55:23 +08:00
Nicolò Lucchesi and Hongsheng Liu
06d347b47f
[Misc] Extend Diffusion Benchmark script to other backends ( #875 )
...
Signed-off-by: NickLucche <nlucches@redhat.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-24 16:44:33 +08:00
tzhouam
81b9e40bbf
Enhance signature compatibility checks in OmniLLM tests
...
- Improved the test_overridden_method_signatures_compatible function to better handle missing parameters in method signatures.
- Added logic to account for VAR_KEYWORD parameters, ensuring more accurate detection of signature mismatches.
Signed-off-by: [Your Name] <your.email@example.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-24 07:56:47 +00:00
tzhouam
04ccb062fc
Add signature compatibility tests for OmniLLM class
...
- Introduced tests to ensure method signatures in OmniLLM match those of the base LLM class, preventing runtime TypeErrors due to parameter mismatches.
- Updated the _run_engine method in OmniLLM to include an optional output_type parameter.
Signed-off-by: [Your Name] <your.email@example.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-24 06:58:39 +00:00
Canlin Guo and Hongsheng Liu
af11b02081
[Minor][Refactor] Pass seq_token_counts explicitly ( #1425 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-24 14:10:00 +08:00
tzhouam
861698f88f
Update Dockerfile for vllm wheel version and enhance SHM connector tests
...
- Updated Dockerfile to use a new vllm wheel version.
- Modified test_put_get_inline to clarify that it always uses SHM and updated metadata assertions.
- Added handling for speculative configuration in GPU model runners to delay clearing connector metadata.
- Refactored payload decoding in OmniGPUModelRunner for better clarity and maintainability.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-24 05:45:48 +00:00
tzhouam
e22ae62396
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-02-24 03:23:20 +00:00