anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity

Refactor StageDiffusionClient and StageEngineCoreClient (#2006)

Browse Source
This commit is contained in:
chickeyton authored and GitHub committed 2026-04-03 08:05:19 +00:00
1 parent 7fb86d51cd
commit 563f73b78a
19 files changed
+1107 -769
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/design/module/async_omni_architecture.md
+2 -2
View File
@@ -69,7 +69,7 @@
[5] Orchestrator._orchestration_loop (loop)
-> poll stage output
- llm stage: await get_output_async()
- diffusion stage: get_diffusion_output_async()
- diffusion stage: get_diffusion_output_nowait()
-> (llm stage) output_processors[i].process_outputs(...)
-> _route_output(...)
-> if finished and not final_stage and non-async-chunk:
@@ -112,7 +112,7 @@ sequenceDiagram
ORCH->>S0: add_request_async
loop poll route forward
ORCH->>S0: get_output_async / get_diffusion_output_async
ORCH->>S0: get_output_async / get_diffusion_output_nowait
ORCH->>ORCH: _route_output
alt need forward to next stage
ORCH->>SN: add_request_async