tzhouam and Claude Fable 5.1
8e912db6c8
[Edge][WP6] Slim the AR/TTS import path and add an edge dependency set
...
* diffusers is no longer imported by vllm_omni.diffusion.data (annotation only);
vllm_omni.diffusion.io_support (diffusion registry + distributed state) is
imported lazily by config_factory and async_omni_engine, so constructing a
Qwen3-TTS pipeline config / AsyncOmni no longer loads diffusers,
x_transformers or whisper (guarded by tests/config/test_import_guard.py).
* requirements/common.txt = core.txt (AR/speech runtime) + media.txt
(diffusion/video/extra audio); VLLM_OMNI_EDGE_BUILD=1 makes setup.py use
requirements/<device>-edge.txt (core only); `edge` extra adds websockets and
sounddevice for on-device clients.
Measured on this host (CUDA venv): `import vllm` 7.0-7.9 s, `import vllm_omni`
adds ~20 s of which ~17 s is transformers' own import (transformers.utils.import_utils)
pulled in by vllm_omni.patch / vllm_omni.version; that floor is not
vLLM-Omni's and is unchanged. Guard test: no diffusion module loaded on the TTS path.
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com >
2026-09-09 11:14:50 +08:00
b6a4baa659
[Feature] Support text encoder Disaggregation for H3 ( #5885 )
...
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com >
Signed-off-by: lishunyang12 <lishunyang12@163.com >
Signed-off-by: yuanwu <yuan.wu@intel.com >
Co-authored-by: lishunyang12 <lishunyang12@163.com >
Co-authored-by: yuanwu <yuan.wu@intel.com >
2026-08-28 14:27:05 +08:00
Gao Han
7439ed41c2
Revert "[Bugfix] Restore name-based model detection for HF cache snapshot paths" ( #6642 )
2026-08-26 15:02:47 +08:00
Yueqian Lin
7ba5e8a146
[Bugfix] Restore name-based model detection for HF cache snapshot paths ( #6624 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-08-25 23:27:35 -07:00
bjf-frz and Hongsheng Liu
072bfc02dd
[FEAT]Add FastVideo VSA backend for Wan2.2 ( #4820 )
...
Signed-off-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-24 14:48:31 +08:00
Ma1oneZhang
6f36fd3b78
[Bugfix] Preserve object storage URIs during model resolution ( #5036 )
...
Signed-off-by: Ziyang Zhang <hafuhafu@qq.com >
2026-08-15 14:11:48 +08:00
9b0df3909a
[Feature] timestamps for TTS via a forced-aligner pooling ( #4795 )
...
Signed-off-by: wjinxu <1299461899@qq.com >
Co-authored-by: xurui <xurui1@modelbest.onaliyun.com >
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-08-12 05:33:34 +00:00
5014fea4a0
[New Model] support nemotron Audex ( #4976 )
...
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-07-28 03:58:22 +00:00
Yukim1 and Hongsheng Liu
793d3e9ab7
[Config] Return VllmOmniConfig from create_from_model ( #4818 )
...
Signed-off-by: zwhzzz0821 <2831474076@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-18 09:21:07 +00:00
ff6f0da271
[Core] Composable parallel: Phase 1 strategy overlay (TP/DP/stage-replica) (RFC #4084 ) ( #4281 )
...
Signed-off-by: Kushan A. <kahmadian@nvidia.com >
Signed-off-by: kushanam <kushanam@users.noreply.github.com >
Signed-off-by: Kushan A <kahmadian@nvidia.com >
Signed-off-by: kahmadian <kahmadian@users.noreply.github.com >
Co-authored-by: kushanam <kushanam@users.noreply.github.com >
Co-authored-by: kahmadian <kahmadian@users.noreply.github.com >
2026-07-10 21:29:24 -06:00
Alex Brooks
b7d08fe5f6
[Core / Bugfix] Add Mechanism for Endpoint Rejection ( #4762 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-07-08 09:00:47 -06:00
Zhou Taichang
a560ed184d
[Rebase] Rebase to vllm v0.24.0 ( #4709 )
2026-06-30 19:41:06 +08:00
Yuanheng Zhao
580a0efe40
[Bugfix] Add back resolving from deploy config written pipeline in StageConfigFactory ( #4729 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
2026-06-25 22:11:49 -06:00
rein yang
8c33793ffc
[Bugfix]Unified import of PretrainedConfig ( #4692 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
2026-06-25 13:48:03 +08:00
Alex Brooks
465f1464d2
[Feat] Support Pipeline Resolution Based on HF Config & Make Pipeline Registry Eager ( #3760 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-06-24 11:02:29 +08:00