tzhouam
9869ea007e
Update vLLM wheel version in Dockerfile and enhance input processing for omni models. Added functionality to reinject omni-specific fields into processed prompts and improved handling of multimodal audio extraction in serving_chat.py. Adjusted SharedMemoryConnector logic for payload size checks and refined input preprocessing methods for better compatibility with multimodal data.
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-20 08:34:53 +00:00
tzhouam
b867bacd24
rebase 2025/02/16
...
Qwen3 Omni offline/online passed
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-16 03:21:21 +00:00
tzhouam
279b6b5050
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-02-11 01:44:54 +00:00
dongbo910220 and hsliuustc0106
43e8747c00
[Feat]: support VAE patch parallelism ( #756 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: hsliuustc0106 <liuhongsheng4@huawei.com >
2026-02-10 17:36:10 +08:00
tzhouam
7e4a604d4d
reabse 2025/2/9
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-09 03:07:43 +00:00
tzhouam
24b04f58a0
rebase 2026/2/5
2026-02-05 10:52:28 +00:00
Zhou Taichang and 汪志鹏
70ef548448
Dev/rebase v0.15.0 ( #1159 )
...
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-02-03 12:24:45 +08:00
tzhouam
6568a78a26
Remove unused tokenizer argument from OmniInputProcessor class docstring
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-02 03:12:43 +00:00
tzhouam
52d0122fb5
[Enhancement] Refactor OmniInputProcessor and related classes for improved prompt handling
...
- Updated OmniInputProcessor to streamline input processing, including enhanced handling of prompt embeddings and additional information.
- Introduced OmniTextPrompt and OmniEmbedsInputs to support new input structures with optional metadata.
- Modified input preprocessing methods to accommodate new prompt types and ensure compatibility with multimodal inputs.
- Improved error handling and type checking for data parallel configurations.
Signed-off-by: [Your Name] <your.email@example.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-01-28 15:42:05 +08:00
5037af1033
[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment ( #758 )
...
Signed-off-by: AndyZhou952 <jzhoubc@connect.ust.hk >
Signed-off-by: Andy Zhou <jzhoubc@connect.ust.hk >
Signed-off-by: dongbo910220 <1275604947@qq.com >
Signed-off-by: Andy Zhou <46011930+AndyZhou952@users.noreply.github.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-01-27 10:22:40 +08:00
Gao Han
a54c323952
[Model] Support Qwen3-TTS model series ( #895 )
...
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk >
2026-01-22 16:57:37 +08:00
8939eb835d
[Rebase] Rebase to vllm 0.12.0 ( #335 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2025-12-19 16:42:02 +08:00
tzhouam