anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity

[Perf][Diffusion] Optimize HSDP startup via Rank-0 shared weight loading and accelerated LoRA delta computation (#7005)

Browse Source 
Signed-off-by: samithuang <285365963@qq.com>
This commit is contained in:
Samit authored and GitHub committed 2026-09-11 08:28:42 +00:00
1 parent bad50980c9
commit 96360ccb00
13 files changed
+637 -16
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

tests/engine/test_stage_engine_args.py
+1
View File
@@ -82,6 +82,7 @@ _OMNI_ONLY_LLM_STAGE_ENGINE_FIELDS = frozenset(
"custom_voice_dir",
"devices",
"disable_autocast",
"enable_broadcast_weight_load",
"enable_multithread_weight_load",
"env",
"has_sampling_extra_args",