tzhouam
473d3ecd29
Update vLLM wheel version and adjust GPU memory utilization in CI configuration
...
- Updated the vLLM wheel commit hash in Dockerfile.ci to a60985b07eaf0fefa4c353ad2309b745707591ed.
- Modified the mock shared memory handle name in test_basic_connectors.py for clarity.
- Increased GPU memory utilization to 0.9 and adjusted max_num_batched_tokens to 4096 in qwen2_5_omni_ci.yaml to enable testing on H800.
- Refactored GPU model runner classes to remove deprecated activate_lora parameter and ensure compatibility with num_active_loras.
- Enhanced request handling in the OmniGPUModelRunner class to improve streaming request updates.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-02 03:08:45 +00:00
tzhouam
26744bcb35
Merge origin/main into dev/vllm-align
...
Resolved conflicts:
- vllm_omni/inputs/preprocess.py: took origin/main's elif mm_processor_kwargs branch, fixed undefined mm_uuids reference
- vllm_omni/model_executor/models/qwen3_tts/qwen3_tts_code_predictor_vllm.py: took origin/main's NPU support
Made-with: Cursor
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-02 02:10:32 +00:00
Sy03
0cc3481acf
[Feat] : Support Async chunk cleanup ( #1087 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
2026-02-27 14:39:33 +08:00
amy-why-3459
66c3e04263
[Performance]Qwen3-Omni performance optimization ( #1378 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-02-26 21:21:36 +08:00
Yuanheng Zhao
ed08a216c1
[Misc] Migrate L1 tests to use pytest-mock ( #1315 )
...
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-02-26 17:08:39 +08:00
tzhouam
8d0c46487e
Merge origin/main into dev/vllm-align
...
Resolve conflicts:
- docker/Dockerfile.ci: Keep wheel install section, update hash to 6042e66cd5
- vllm_omni/platforms/npu/worker/npu_model_runner.py: Accept main's refactoring
Made-with: Cursor
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-26 08:19:53 +00:00
junuxyz and Hongsheng Liu
caed95fb45
[Bugfix] Fix tuple/list KV cache extraction crash ( #1405 )
...
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-26 15:20:40 +08:00
tzhouam
861698f88f
Update Dockerfile for vllm wheel version and enhance SHM connector tests
...
- Updated Dockerfile to use a new vllm wheel version.
- Modified test_put_get_inline to clarify that it always uses SHM and updated metadata assertions.
- Added handling for speculative configuration in GPU model runners to delay clearing connector metadata.
- Refactored payload decoding in OmniGPUModelRunner for better clarity and maintainability.
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-02-24 05:45:48 +00:00
NATURE
1589931fa6
[Feature] vLLM-Omni RDMA connector ( #1019 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-02-24 11:13:52 +08:00
ab1acb27ff
[Feature]async scheduling to overlap chunk IO and compute ( #951 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
Co-authored-by: Bhanu068 <voutharoja.bhanu06@gmail.com >
Co-authored-by: Gao Han <gaohan19@huawei.com >
2026-02-12 16:05:02 +08:00
Alicia and Hongsheng Liu
d3ea94309d
[CI] Add pytest markers to current tests and update the doc. ( #577 )
...
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-09 16:49:45 +08:00
汪志鹏
741f7e2826
[Core]: KV Cache Transfer Encapsulation ( #979 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-01-28 23:12:45 +08:00
Zeyu Huang | 黃澤宇
d64bbde561
[Frontend][Model] Support batch request with refined OmniDiffusionReq… ( #797 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
2026-01-28 16:07:42 +08:00
汪志鹏 and wzliu
7f821be57b
Support Bagel Model ( #726 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: wzliu <wzliu@connect.hku.hk >
2026-01-22 23:09:55 +13:00
Canlin Guo
97a5860681
[Security][Feature] Use Msgpack in OmniSerializer instead of pickle ( #310 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2025-12-22 13:21:16 +13:00
NATURE
f995211da0
[Feature] Omni Connector + ray supported ( #215 )
...
Signed-off-by: wzliu <wzliu@connect.hku.hk >
2025-12-10 20:15:03 +08:00
tzhouam