anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity

[Refact] Refactor diffusion output streaming (#5166)

Browse Source 
Signed-off-by: bjf-frz <frz123db@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
This commit is contained in:
bjf-frzandHongsheng Liu authored and GitHub committed 2026-07-23 10:06:08 +08:00
1 parent 7d5376f215
commit be667a8067
27 files changed
+628 -394
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/design/feature/diffusion_continuous_batching.md
+2 -1
View File
@@ -139,7 +139,8 @@ compatibility gating and runner-side `StepInputBatch` packing.
## Current Limitations
- Experimental feature; use `max_num_seqs=1` for the older conservative path.
- Experimental feature; use `max_num_seqs=1` for the conservative single-request
step path.
- Only native pipelines that already support `step_execution=True`.
- Only homogeneous batches keyed by `StepBatchSamplingParamsKey` are supported.
- `cache_backend`, KV transfer, and other request-mode extras are not wired