[Refactor] Migrate replica-DP Wan2.2 example to --deploy-config (#5267)
Signed-off-by: lishunyang12 <lishunyang03@gmail.com> Co-authored-by: lishunyang12 <lishunyang03@gmail.com>
This commit is contained in:
1 parent
0034eaa9c3
commit
7924beef84
3 files changed
+19
-36
No files matched your search
@@ -30,4 +30,4 @@ echo "Serving ${MODEL}: num_replicas=${NUM_REPLICAS} devices=${DEVICES} (config
|
||||
vllm serve "$MODEL" --omni \
|
||||
--host "$HOST" \
|
||||
--port "$PORT" \
|
||||
--stage-configs-path "$CFG"
|
||||
--deploy-config "$CFG"
|
||||
Reference in new issue
Block a user