Ziming Huang and Hongsheng Liu
1ae0c64fe0
Support Qwen3 Omni thinker cuda graph ( #523 )
...
Signed-off-by: ZeldaHuang <hzm414167@alibaba-inc.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2025-12-30 23:46:13 +13:00
Zhou Taichang
59ae174bba
[Debug] Debug qwen3 mix modality output empty string ( #431 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2025-12-30 15:32:15 +08:00
dsinghvi and Hongsheng Liu
abde501dfa
[Misc] Fix type interface mismatch ( #478 )
...
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2025-12-26 15:28:49 +08:00
Canlin Guo
e1f9691120
[Clean] Remove the redundant decoding payloads logic ( #404 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2025-12-26 04:48:34 +13:00
Peiqi Yin
e9e6b3711c
[Core] customize process between stages, remove the need of "request_ids" in model forward, rebase to 0.12.0 ( #458 )
...
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
2025-12-24 13:26:33 +00:00
8939eb835d
[Rebase] Rebase to vllm 0.12.0 ( #335 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2025-12-19 16:42:02 +08:00
Lancer
01549fb953
[Diffusion] fix warning in diffusion stage ( #332 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
2025-12-16 09:07:16 +00:00
Cyrus Leung
c091a03d82
[Chore] Bump Python version and apply formatting changes for v0.12 release ( #126 )
...
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk >
2025-12-16 15:19:40 +08:00
Zhou Taichang
228f4e5070
[Bug-fix] Fix Bugs in Qwen3/Qwen2.5 Omni Rebased Support ( #114 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2025-11-30 18:15:10 +08:00
R2-Y and Rein
0a4e5a8710
[Feature] add support for Qwen3-omni ( #55 )
...
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Rein <rein@Reins-MacBook-Air.local >
2025-11-30 04:44:01 +08:00
Gao Han
db81ee9f69
[Docs] optimize and supplement docs system ( #86 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-28 11:03:52 +08:00
Gao Han
598b4ddb51
[Feature] support multimodal inputs with multiple requests ( #76 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-24 16:02:44 +08:00
Jiangyun Zhu
5707fc78d5
[CI] fix ci and format existing code ( #71 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2025-11-18 20:54:26 +08:00
Gao Han
c5a89302f1
[Feature] Support online inference ( #64 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-17 14:44:10 +08:00
Gaohan123
6e1478222e
Dependency refractored to vLLM v0.11.0
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-04 22:06:41 +08:00
Gaohan123
171f3c1ea7
fix conflicts
2025-10-24 16:49:19 +08:00
tzhouam
ee4822327b
Remove unnecessary numpy imports and update return type in extract_multimodal_outputs method in OmniGPUModelRunner
...
- Eliminated redundant numpy import statements to streamline the code.
- Changed the return type of extract_multimodal_outputs from dict to tuple for better clarity on output structure.
2025-10-24 11:08:42 +08:00
tzhouam
4609afa613
Refactor sampled_token_ids assignment in OmniGPUModelRunner
...
- Simplified the assignment of sampled_token_ids by removing the conditional check for "model_stage".
- Ensured consistent handling of sampled_token_ids for improved clarity and maintainability.
2025-10-22 17:42:29 +08:00
tzhouam
54977bd590
Add OmniGPUModelRunner and OmniModelInputForGPU classes
...
- Introduced OmniGPUModelRunner for enhanced GPU model execution with state management.
- Added OmniModelInputForGPU and its builder to support additional information in model inputs.
- Implemented methods for updating request states and handling multimodal inputs.
- Enhanced input preparation for CUDA graph execution and LoRA integration.
2025-10-22 15:33:11 +08:00
