Hongsheng Liu 23ab14a15b [Diffusion] Register runtime cache for direct DLO H2D ...

Avoid recurrent mmap-to-pinned packing in no-AllGather DLO by registering transform-complete runtime-cache mappings under an explicit per-worker budget. Copy mapped tensors directly into the rotating device buffers while preserving bounded-staging fallback and ordered shutdown cleanup.

Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>

2026-08-19 11:21:28 +08:00

..

attention

[Perf] Fuse MiniMax H3 modulation with FP32 accumulation (#6281)

2026-08-18 20:13:54 -07:00

cache

[Perf] Fuse MiniMax H3 modulation with FP32 accumulation (#6281)

2026-08-18 20:13:54 -07:00

diffusion_kv

[Diffusion] Add native KV cache initialization and Scheduler-managed block allocation (#6094)

2026-08-18 07:00:24 +00:00

distributed

[Bugfix] Fix Wan spatial reshard boundary (#6062)

2026-08-12 11:36:24 +08:00

executor

[Diffusion] Add native KV cache initialization and Scheduler-managed block allocation (#6094)

2026-08-18 07:00:24 +00:00

hooks

[Refactor][Misc] Remove unused code in diffusion hooks/model_loader (#5270)

2026-07-22 09:45:17 +08:00

layers

[Perf] Fuse MiniMax H3 SwiGLU activation (#6283)

2026-08-18 20:12:10 -07:00

lora

[ROCm] [CI] Fix circular import for rocm due to patch (#6287)

2026-08-18 09:45:05 +00:00

model_loader

[Diffusion] Register runtime cache for direct DLO H2D

2026-08-19 11:21:28 +08:00

models

[Perf] Fuse MiniMax H3 modulation with FP32 accumulation (#6281)

2026-08-18 20:13:54 -07:00

offloader

[Diffusion] Register runtime cache for direct DLO H2D

2026-08-19 11:21:28 +08:00

postprocess

[Bugfix] Fix RIFE device selection for CPU-transported videos (#2876)

2026-04-17 19:19:34 +08:00

profiler

[Bugfix] Report stepwise Qwen-Image profiler metrics (#4517)

2026-07-03 04:32:22 +00:00

quantization

[Bugfix] Fix HSDP compatibility with the new online FP8 linear method (#5677)

2026-08-14 15:45:55 +08:00

sched

[Diffusion] Add native KV cache initialization and Scheduler-managed block allocation (#6094)

2026-08-18 07:00:24 +00:00

utils

[Bugfix] Prevent DiffusionResultPump crash on cancelled futures (#5793) (#5983)

2026-08-15 16:19:45 +00:00

worker

[Diffusion] Register runtime cache for direct DLO H2D

2026-08-19 11:21:28 +08:00

__init__.py

[Diffusion] Qwen image support (#82)

2025-11-28 14:22:11 +08:00

compile.py

[Rebase] Rebase to vllm 0.27.0 (#5976)

2026-08-11 15:23:46 +00:00

config.py

[Diffusion][Attention] Support per-role attention backend via CLI (#2681)

2026-05-10 11:59:05 +08:00

data.py

[Diffusion] Register runtime cache for direct DLO H2D

2026-08-19 11:21:28 +08:00

diffusion_engine.py

[Diffusion] Add native KV cache initialization and Scheduler-managed block allocation (#6094)

2026-08-18 07:00:24 +00:00

envs.py

[Refactor] Extract has_flash_attn_pkg in OmniPlatform (#3068)

2026-04-27 04:07:34 +00:00

forward_context.py

[Attention] Refine TRTLLM attention support for MiniMax H3 (#5779)

2026-08-06 09:38:17 +00:00

inline_stage_diffusion_client.py

[Diffusion] Fix DLO DP concurrent request execution (#5864)

2026-08-08 08:24:42 +08:00

io_support.py

[Diffusion] Add native KV cache initialization and Scheduler-managed block allocation (#6094)

2026-08-18 07:00:24 +00:00

ipc.py

[Bugfix] Fix lost async diffusion outputs in request-level batching (#6023)

2026-08-15 18:27:51 +08:00

model_metadata.py

[Bugfix] Fix image num check error (#5838)

2026-08-07 08:50:24 +00:00

output_formatter.py

[Metrics] Add Diffusion Metrics (#4755)

2026-08-13 06:59:13 +00:00

prompt_update.py

[Frontend] Add midway prompt update for streaming video generation (#4652)

2026-07-27 14:07:43 +08:00

registry.py

Add π0 VLA model support (#4222)

2026-08-17 14:29:17 +08:00

request.py

[Diffusion] Add native KV cache initialization and Scheduler-managed block allocation (#6094)

2026-08-18 07:00:24 +00:00

stage_diffusion_client.py

[Frontend] Add midway prompt update for streaming video generation (#4652)

2026-07-27 14:07:43 +08:00

stage_diffusion_proc.py

[Refact] Refactor diffusion output streaming (#5166)

2026-07-23 10:06:08 +08:00

vllm_config.py

[Bugfix | Model] Fix SenseNova & Use Well-defined Model Configs (#5877)

2026-08-18 16:43:05 +00:00