汪志鹏andSYLAR
37e5954acf
Signed-off-by: princepride <wangzhipeng628@gmail.com> Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com> Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
17 lines
534 B
YAML
17 lines
534 B
YAML
# BAGEL-7B-MoT think-mode deploy.
|
|
#
|
|
# Inherits all settings from bagel.yaml; only overrides the pipeline to
|
|
# bagel_think which uses expand_cfg_prompts_think and omits
|
|
# kv_transfer_criteria so the Thinker decodes <think> tokens before
|
|
# transferring KV to DiT.
|
|
#
|
|
# Select this topology via:
|
|
# python end2end.py --model ByteDance-Seed/BAGEL-7B-MoT --think
|
|
#
|
|
# Or explicitly:
|
|
# vllm serve ByteDance-Seed/BAGEL-7B-MoT --omni \
|
|
# --deploy-config vllm_omni/deploy/bagel_think.yaml
|
|
|
|
base_config: bagel.yaml
|
|
pipeline: bagel_think
|