tzhouam dd0c893e79 Align dev/vllm-align with upstream vLLM changes ...

- Update Dockerfile.ci to install vLLM from specific commit wheel,
  add flashinfer/cublas/numpy dependencies
- Fix worker_type leak in omni_stage by using pop instead of get

Made-with: Cursor

Signed-off-by: tzhouam <tzhouam@connect.ust.hk>

2026-03-10 01:46:53 +00:00

..

cli

[Feature]: Add vae-patch-parallel CLI argument in online serving (#1716)

2026-03-07 01:45:02 +08:00

openai

Add online serving to Stable Audio Diffusion and introduce v1/audio/generate endpoint (#1255)

2026-03-09 13:36:46 -04:00

__init__.py

[Core] Supports stage abstraction in the diffusion model (#391)

2025-12-27 01:59:33 +13:00

async_omni_diffusion.py

[Model] support LTX-2 text-to-video image-to-video (#841)

2026-03-05 23:31:48 +08:00

async_omni_llm.py

Dev/rebase v0170 (#1639)

2026-03-09 17:29:38 +08:00

async_omni.py

[Perf] Reduce IPC overhead for single-stage diffusion serving for Wan2.2 (#1715)

2026-03-10 00:03:51 +13:00

cfg_companion_tracker.py

[Feature]: Support cfg kv-cache transfer in multi-stage (#1422)

2026-03-02 05:06:28 +00:00

chat_utils.py

[Rebase] Rebase to vllm v0.16.0 (#1357)

2026-02-13 18:05:07 +08:00

client_request_state.py

[Feature] Opt metrics structure (#891)

2026-02-09 19:17:32 +08:00

omni_diffusion.py

[Perf] Reduce IPC overhead for single-stage diffusion serving for Wan2.2 (#1715)

2026-03-10 00:03:51 +13:00

omni_llm.py

Add online serving to Stable Audio Diffusion and introduce v1/audio/generate endpoint (#1255)

2026-03-09 13:36:46 -04:00

omni_stage.py

Align dev/vllm-align with upstream vLLM changes

2026-03-10 01:46:53 +00:00

omni.py

[Perf] Reduce IPC overhead for single-stage diffusion serving for Wan2.2 (#1715)

2026-03-10 00:03:51 +13:00

stage_utils.py

[RL] Support collective rpc api to entrypoint && Support custom input output (#1646)

2026-03-09 10:12:43 +08:00

utils.py

Add online serving to Stable Audio Diffusion and introduce v1/audio/generate endpoint (#1255)

2026-03-09 13:36:46 -04:00

zmq_utils.py

[Feature] Support Stage Based Deployment CLI (#939)

2026-02-24 16:55:23 +08:00