tzhouam
bf69cd94bb
Rebase 2026/02/23
...
Update Dockerfile for vllm wheel version and enhance input processing in Omni models. Added decoding for byte messages in async requests, included new metrics in benchmarks, and improved pause state handling in the scheduler. Refined input and output processing methods for better multimodal support and error handling.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-23 03:36:01 +00:00
tzhouam
9869ea007e
Update vLLM wheel version in Dockerfile and enhance input processing for omni models. Added functionality to reinject omni-specific fields into processed prompts and improved handling of multimodal audio extraction in serving_chat.py. Adjusted SharedMemoryConnector logic for payload size checks and refined input preprocessing methods for better compatibility with multimodal data.
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-20 08:34:53 +00:00
tzhouam
b867bacd24
rebase 2025/02/16
...
Qwen3 Omni offline/online passed
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-16 03:21:21 +00:00
tzhouam
279b6b5050
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-02-11 01:44:54 +00:00
dongbo910220 and hsliuustc0106
43e8747c00
[Feat]: support VAE patch parallelism ( #756 )
...
Signed-off-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: hsliuustc0106 <liuhongsheng4@huawei.com >
2026-02-10 17:36:10 +08:00
tzhouam
7e4a604d4d
reabse 2025/2/9
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-09 03:07:43 +00:00
tzhouam
24b04f58a0
rebase 2026/2/5
2026-02-05 10:52:28 +00:00
Zhou Taichang and 汪志鹏
70ef548448
Dev/rebase v0.15.0 ( #1159 )
...
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-02-03 12:24:45 +08:00
tzhouam
6568a78a26
Remove unused tokenizer argument from OmniInputProcessor class docstring
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-02 03:12:43 +00:00
tzhouam
52d0122fb5
[Enhancement] Refactor OmniInputProcessor and related classes for improved prompt handling
...
- Updated OmniInputProcessor to streamline input processing, including enhanced handling of prompt embeddings and additional information.
- Introduced OmniTextPrompt and OmniEmbedsInputs to support new input structures with optional metadata.
- Modified input preprocessing methods to accommodate new prompt types and ensure compatibility with multimodal inputs.
- Improved error handling and type checking for data parallel configurations.
Signed-off-by: [Your Name] <your.email@example.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-01-28 15:42:05 +08:00
5037af1033
[Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment ( #758 )
...
Signed-off-by: AndyZhou952 <jzhoubc@connect.ust.hk >
Signed-off-by: Andy Zhou <jzhoubc@connect.ust.hk >
Signed-off-by: dongbo910220 <1275604947@qq.com >
Signed-off-by: Andy Zhou <46011930+AndyZhou952@users.noreply.github.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: dongbo910220 <1275604947@qq.com >
Co-authored-by: Samit <285365963@qq.com >
2026-01-27 10:22:40 +08:00
Gao Han
a54c323952
[Model] Support Qwen3-TTS model series ( #895 )
...
Signed-off-by: Gaohan123 <hgaoaf@connect.ust.hk >
2026-01-22 16:57:37 +08:00
8939eb835d
[Rebase] Rebase to vllm 0.12.0 ( #335 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2025-12-19 16:42:02 +08:00
tzhouam