 tzhouam
|
034d579d77
|
Update vLLM precompiled wheel version and refactor various components for improved functionality and error handling. Changes include modifying the get_name method in DiffusionQuantizationConfig to use class-level attributes, enhancing metadata handling in StageEngineCoreClient, and adjusting the AsyncOmni class constructor for better parameter management. Additionally, improved error handling in omni_snapshot_download and optimized initial chunk size computation in talker2code2wav_async_chunk for dynamic load adaptation.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-19 05:14:34 +00:00 |
|
|
tzhouam
|
4f75cccacc
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
|
2026-03-19 03:11:40 +00:00 |
|
|
Joshna-Medisettyandgcanlin
|
ca6c7ad2be
|
Fix OmniGen2 transformer config loading for HF models (#1934)
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-19 10:21:54 +08:00 |
|
|
tzhouam
|
342a209924
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-19 02:06:26 +00:00 |
|
|
Chendi.XueandHongsheng Liu
|
e1ac1826cd
|
[CI]init intel ci dispatch in buildkite folder (#1721)
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-19 09:50:31 +08:00 |
|
|
TJian
|
c85acb1773
|
[CI] [ROCm] Bugfix device environment issue (#1984)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2026-03-19 05:11:28 +08:00 |
|
|
|
fc5e8f825e
|
[Optim][Qwen3TTS] big boost model throughput+latency high concurrency (#1852)
Signed-off-by: pablo <pablo@agigo.ai>
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com>
Co-authored-by: pablo <pablo@agigo.ai>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-03-18 12:22:05 -04:00 |
|
|
Taichang Zhou
|
dc6f2fb81f
|
Enhance cu_seqlens computation in Qwen3Omni_VisionTransformer by switching to tensor operations for improved performance and compatibility. Added error handling to fallback on a vectorized implementation if necessary. This update aligns with upstream changes and optimizes the handling of sequence lengths during attention execution.
|
2026-03-18 23:27:55 +08:00 |
|
|
Taichang Zhou
|
7a68bd37b7
|
Refactor cu_seqlens handling in Qwen3Omni_VisionTransformer to align with upstream vLLM changes. The sequence length helper now retains cu_seqlens in numpy format and converts it for attention execution, improving compatibility and performance.
|
2026-03-18 23:23:41 +08:00 |
|
|
SYLAR
|
53ebdd0b1d
|
[Bug]: fix CUDA OOM during diffusion post-processing (#1670)
Signed-off-by: lishunyang <lishunyang12@163.com>
|
2026-03-18 14:59:58 +00:00 |
|
|
Alicia
|
4a44f6ee5c
|
[CI] Nightly Benchmark - Add an HTML generator, Update the EXCEL generator. (#1831)
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
|
2026-03-18 20:13:57 +08:00 |
|
|
汪志鹏
|
61e170c69a
|
[Feature]: Remove some useless hf_overrides in yaml (#1898)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
|
2026-03-18 19:46:44 +08:00 |
|
|
Y. FisherandCanlin Guo
|
f52b51533a
|
[Feature] Add cache-dit support for HunyuanImage3 (#1848)
Signed-off-by: KexiongYu <yukexiong1@huawei.com>
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-03-18 10:18:27 +00:00 |
|
|
Canlin Guo
|
d636c32ff9
|
[Bugfix] Set PREEMPTED status when moving requests from running to waiting queue (#1893)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-18 17:56:13 +08:00 |
|
|
|
3158e9d28f
|
[Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring (#1908)
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn>
Signed-off-by: Peiqi Yin <yinpeiqi809@gmail.com>
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Signed-off-by: wuhang <whlbx@hotmail.com>
Signed-off-by: linyueqian <linyueqian@outlook.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn>
Co-authored-by: Peiqi Yin <yinpeiqi809@gmail.com>
Co-authored-by: wuhang <whlbx@hotmail.com>
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: lishunyang <lishunyang12@163.com>
|
2026-03-18 17:33:53 +08:00 |
|
|
WeiQing Chenanddavid6666666
|
6a66a1fe36
|
[skip ci][Docs] Update WeChat QR code (fix filename case) (#1976)
Signed-off-by: david6666666 <david6666666@users.noreply.github.com>
Co-authored-by: david6666666 <david6666666@users.noreply.github.com>
|
2026-03-18 15:17:27 +08:00 |
|
|
WeiQing Chenanddavid6666666
|
1a5d25a0ba
|
[Docs] Update WeChat QR code for community support (#1974)
Signed-off-by: david6666666 <david6666666@users.noreply.github.com>
Co-authored-by: david6666666 <david6666666@users.noreply.github.com>
|
2026-03-18 13:55:51 +08:00 |
|
|
Yueqian Lin
|
fe786f1a19
|
Fix Base voice clone streaming quality and stop-token crash (#1945)
Signed-off-by: linyueqian <linyueqian@outlook.com>
|
2026-03-18 06:54:12 +08:00 |
|
|
Taichang Zhou
|
8a31e7865d
|
Increase timeout for Diffusion Model Test and Diffusion Images API LoRA E2E in Buildkite configurations to 30 minutes. Also, introduce a new timeout constant for diffusion initialization in relevant test files to enhance stability during testing. Update OmniServer initialization to utilize the new timeout settings.
|
2026-03-17 23:43:46 +08:00 |
|
|
tzhouam
|
004c60a031
|
Refactor shutdown and cleanup logic in OmniRunner and OmniStage to improve process termination and resource management. The changes ensure that stage workers are stopped before closing queues, preventing potential orphaned subprocesses. Additionally, enhanced error handling during process termination provides clearer logging for failed shutdown attempts. This update aims to increase the reliability and stability of the shutdown process across the application.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-17 09:33:28 +00:00 |
|
|
tzhouam
|
cc4ade4ba7
|
Refactor shutdown logic in OmniLLM and stage worker to ensure proper engine closure. The shutdown method now checks for the presence of engine_core before invoking shutdown, enhancing resource management. Additionally, the stage worker now explicitly calls stage_engine.close() upon receiving a shutdown signal. This improves the overall stability and reliability of the shutdown process.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-17 08:19:56 +00:00 |
|
|
tzhouam
|
35b3dd638a
|
Refactor Dockerfile.ci to install vLLM from a dynamically retrieved precompiled wheel URL, improving the installation process by ensuring compatibility with PEP 440 local version identifiers. This change enhances the reliability of vLLM installations. Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-17 06:08:59 +00:00 |
|
|
tzhouam
|
83effe39ac
|
Update Dockerfile.ci to include an additional extra index URL for pip installation, enhancing package resolution for vLLM. This change ensures compatibility with both precompiled wheels and packages from PyPI.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-17 04:07:50 +00:00 |
|
|
tzhouam
|
b7a36d16d4
|
Merge branch 'dev/vllm-align' of https://github.com/vllm-project/vllm-omni into dev/vllm-align
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-17 03:54:31 +00:00 |
|
|
tzhouam
|
722ad6bbae
|
rebase: align vllm-omni with vLLM 0a0a1a198be8
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-17 03:26:42 +00:00 |
|
|
Zhou Taichang
|
ac937b82e6
|
Refactor Dockerfile to install vLLM from source
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
|
2026-03-17 11:08:45 +08:00 |
|
|
tzhouam
|
0eccb77c4f
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
|
2026-03-17 02:48:50 +00:00 |
|
|
tzhouam
|
b0e36f9f5d
|
Update Dockerfile.ci to force reinstall vLLM from a precompiled wheel, ensuring the latest version is used. This change enhances the installation process by guaranteeing that any existing installations are replaced. Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-17 02:04:51 +00:00 |
|
|
tzhouam
|
83b05ce3e4
|
Refactor Dockerfile.ci to install vLLM using a precompiled wheel from a specified commit, replacing the previous source installation method. This update simplifies the installation process and ensures correct dependency management. Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-17 01:35:12 +00:00 |
|
|
Juan Pablo Zuluaga
|
cf328eb8e8
|
[Bug][Qwen3TTS][Streaming] remove dynamic initial chunk and only compute on initial request (#1930)
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com>
|
2026-03-16 15:23:09 -04:00 |
|
|
rongfu.leng
|
4036cd547c
|
[Misc] removed qwen3_tts.py as it is out-dated (#1926)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
|
2026-03-16 13:09:04 -04:00 |
|
|
Zhou Taichang
|
22a2bd3406
|
Upgrade flashinfer-cubin and flashinfer-jit-cache versions
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
|
2026-03-16 19:31:03 +08:00 |
|
|
tzhouam
|
8e81e60d32
|
Refactor Dockerfile.ci to install vLLM from source using precompiled artifacts at a specified commit. This change replaces the previous wheel installation method and ensures the correct versioning of dependencies. Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-16 10:01:18 +00:00 |
|
|
tzhouam
|
57ac7eb155
|
rebase: align vllm-omni with vLLM 2754231ba3a7
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-16 09:28:56 +00:00 |
|
|
tzhouam
|
de6bcc734c
|
Update Dockerfile.ci to use a new vllm wheel URL and refactor MooncakeConnector import logic in monkey_patch.py for improved compatibility. Adjust OpenAIServingChat to call the harmony request method from the correct context.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-16 08:33:28 +00:00 |
|
|
tzhouam
|
a26e568dfc
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
|
2026-03-16 07:30:43 +00:00 |
|
|
Canlin Guo
|
9718a9e369
|
[NPU] Upgrade to v0.17.0 (#1890)
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
|
2026-03-16 14:42:59 +08:00 |
|
|
tzhouam
|
9c22e3afb0
|
Refactor import statement for OpenAIServingEmbedding in api_server.py to use aliasing for clarity
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-16 06:13:07 +00:00 |
|
|
Jinheng
|
88caaf182b
|
[Feature] Split #1303 Part 1: PD disaggregation scaffolding (#1863)
Signed-off-by: Jinheng Li <ahengljh@gmail.com>
|
2026-03-16 14:05:19 +08:00 |
|
|
Roger Wang
|
6a5fa588c6
|
Update latest news section in README.md (#1909)
Signed-off-by: Roger Wang <hey@rogerw.io>
|
2026-03-15 22:50:42 -07:00 |
|
|
|
1deb4fdf92
|
Add Governance section (#1889)
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: Samit <285365963@qq.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-03-15 22:47:42 -07:00 |
|
|
tzhouam
|
aae101f495
|
Refactor import statement for OpenAIServingEmbedding in api_server.py
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-16 03:39:51 +00:00 |
|
|
tzhouam
|
3a508d7b7a
|
rebase: align vllm-omni with vLLM e9163b536e72
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-03-16 02:32:39 +00:00 |
|
|
tzhouam
|
f137a1e3ad
|
Merge remote-tracking branch 'origin/main' into dev/vllm-align
|
2026-03-16 01:49:46 +00:00 |
|
|
Lancer
|
9aae75c3ee
|
[Feat] support HSDP for Flux family (#1900)
Signed-off-by: Lancer <maruixiang6688@gmail.com>
|
2026-03-15 22:48:12 +08:00 |
|
|
汪志鹏
|
284575ab82
|
[CI]: Add/Fix bagel e2e online/offline test (#1895)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-03-15 18:27:07 +08:00 |
|
|
Lancer
|
2472c360aa
|
[Feat] support SP for FLUX.2-klein (#1250)
Signed-off-by: Lancer <maruixiang6688@gmail.com>
|
2026-03-15 12:18:12 +08:00 |
|
|
Lancer
|
af012babf8
|
[Bugfix] Fix cpu offload and quantization compatibility (#1473)
Signed-off-by: Lancer <maruixiang6688@gmail.com>
|
2026-03-14 18:55:30 +00:00 |
|
|
Wu JIAZHEN
|
4de0c8d41b
|
[skip CI][Docs][Benchmark]: clarify vbench parameter behavior and add t2v example (#1497)
Signed-off-by: asuka <1311722138@qq.com>
|
2026-03-14 23:31:18 +08:00 |
|
|
Gao Han
|
365dfd5f8e
|
[CI pipeline] Re-enable Diffusion Tensor Parallelism Test in pipeline (#1892)
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-03-14 22:56:43 +08:00 |
|