Files
vllm-omni/docs/user_guide/examples/offline_inference/mammothmodal2_preview.md
T
2026-03-24 03:20:50 +00:00

1.3 KiB

MammothModa2-Preview

Source https://github.com/vllm-project/vllm-omni/tree/main/examples/offline_inference/mammothmodal2_preview.

Run examples (MammothModa2-Preview)

Download model

hf bytedance-research/MammothModa2-Preview --local-dir ./MammothModa2-Preview

Text-to-Image (T2I)

python examples/offline_inference/mammothmodal2_preview/run_mammothmoda2_t2i.py \
  --model ./MammothModa2-Preview \
  --stage-config ./vllm_omni/model_executor/stage_configs/mammoth_moda2.yaml \
  --prompt "A stylish woman riding a motorcycle in NYC, movie poster style" \
  --height 1024 \
  --width 1024 \
  --num-inference-steps 50 \
  --text-guidance-scale 4.0 \
  --out output.png

Image Summary

python examples/offline_inference/mammothmodal2_preview/run_mammothmoda2_image_summarize.py \
  --model ./MammothModa2-Preview \
  --stage-config ./vllm_omni/model_executor/stage_configs/mammoth_moda2_ar.yaml \
  --question "Summarize this image." \
  --image ./image.png

Example materials

??? abstract "run_mammothmoda2_image_summarize.py" py --8<-- "examples/offline_inference/mammothmodal2_preview/run_mammothmoda2_image_summarize.py" ??? abstract "run_mammothmoda2_t2i.py" py --8<-- "examples/offline_inference/mammothmodal2_preview/run_mammothmoda2_t2i.py"