vllm-omni

0 Fork 0

Files

T

tzhouam 473d3ecd29 Update vLLM wheel version and adjust GPU memory utilization in CI configuration

- Updated the vLLM wheel commit hash in Dockerfile.ci to a60985b07eaf0fefa4c353ad2309b745707591ed.
- Modified the mock shared memory handle name in test_basic_connectors.py for clarity.
- Increased GPU memory utilization to 0.9 and adjusted max_num_batched_tokens to 4096 in qwen2_5_omni_ci.yaml to enable testing on H800.
- Refactored GPU model runner classes to remove deprecated activate_lora parameter and ensure compatibility with num_active_loras.
- Enhanced request handling in the OmniGPUModelRunner class to improve streaming request updates.

Signed-off-by: tzhouam <tzhouam@connect.ust.hk>

2026-03-02 03:08:45 +00:00

benchmarks

[CI] Modify some CI test cases to run on L4 environment to reduce H100 resource usage. (#1543 )

2026-02-28 14:41:51 +08:00

comfyui

[Doc][Test][Misc] ComfyUI test, more screenshot, and code cleaning (#1435 )

2026-02-26 21:03:54 +08:00

diffusion

[Feature]: Native GGUF Quantization Support for DiT (#1285 )

2026-02-27 11:39:14 +08:00

distributed/omni_connectors

Update vLLM wheel version and adjust GPU memory utilization in CI configuration