evanchuenganddavid6666666 744c65b730 [Feature] Distributed layerwise offload with DP multi-concurrency + mmap weight… (#5397) ...

Signed-off-by: evanchueng <evanchueng@outlook.com>
Signed-off-by: david6666666 <530634352@qq.com>
Co-authored-by: david6666666 <530634352@qq.com>

2026-07-30 13:35:38 +00:00

..

__init__.py

[Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo (#3907)

2026-07-23 16:45:18 +08:00

arg_utils.py

[Feature] Distributed layerwise offload with DP multi-concurrency + mmap weight… (#5397)

2026-07-30 13:35:38 +00:00

async_engine_utils.py

[Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo (#3907)

2026-07-23 16:45:18 +08:00

async_omni_engine.py

[Feature] Distributed layerwise offload with DP multi-concurrency + mmap weight… (#5397)

2026-07-30 13:35:38 +00:00

cfg_companion_tracker.py

[Model] Add Ming-flash-omni-2.0 Image Generation (Diffusion) Stage (#2875)

2026-05-27 23:21:20 +08:00

membership_controller.py

[Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo (#3907)

2026-07-23 16:45:18 +08:00

messages.py

[Frontend] Add midway prompt update for streaming video generation (#4652)

2026-07-27 14:07:43 +08:00

mm_outputs.py

[Refactor][OutputProcessor 1/8]: clean up multimodal payload accumulation and move payload logic into MultimodalPayload & directory refactor (#4980)

2026-07-15 15:50:19 +08:00

orchestrator_monitor.py

[Core] Performance fix for orchestrator bottleneck: separates inter-stage from client outputs (#4527)

2026-06-29 17:43:36 +02:00

orchestrator.py

[Bugfix][Minicpm] Support full-duplex three-stage serving (#5380)

2026-07-29 01:58:34 +08:00

output_modality.py

[Refactor][OutputProcessor 1/8]: clean up multimodal payload accumulation and move payload logic into MultimodalPayload & directory refactor (#4980)

2026-07-15 15:50:19 +08:00

output_processor.py

[Refactor][OutputProcessor 1/8]: clean up multimodal payload accumulation and move payload logic into MultimodalPayload & directory refactor (#4980)

2026-07-15 15:50:19 +08:00

rpc_result_router.py

[Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo (#3907)

2026-07-23 16:45:18 +08:00

serialization.py

[Refactor] Standardize data entry key names to {type}.{qualifier} format (#1829)

2026-04-25 18:15:38 +08:00

stage_client.py

[Frontend] Add midway prompt update for streaming video generation (#4652)

2026-07-27 14:07:43 +08:00

stage_engine_core_client.py

[Refactor][Phase 1]Remove redundant functions and logs (#4986)

2026-07-10 15:13:35 +08:00

stage_engine_core_proc_manager.py

[Rebase] Rebase to vllm v0.24.0 (#4709)

2026-06-30 19:41:06 +08:00

stage_engine_core_proc.py

[New Model] support nemotron Audex (#4976)

2026-07-28 03:58:22 +00:00

stage_engine_startup.py

[Bugfix][Minicpm] Support full-duplex three-stage serving (#5380)

2026-07-29 01:58:34 +08:00

stage_init_utils.py

[New Model] support nemotron Audex (#4976)

2026-07-28 03:58:22 +00:00

stage_pool.py

fix(diffusion): convert caller sampling params instead of discarding … (#4115)

2026-07-29 13:24:51 +08:00

stage_runtime.py

[Config] Read stage metadata from VllmOmniConfig (#5343)

2026-07-27 22:44:06 +08:00