anodyine/vllm-omni

0 Fork 0

Files

T

History

3158e9d28f [Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring (#1908 )

Signed-off-by: yinpe <11810305@mail.sustech.edu.cn>
Signed-off-by: Peiqi Yin <yinpeiqi809@gmail.com>
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
Signed-off-by: wuhang <whlbx@hotmail.com>
Signed-off-by: linyueqian <linyueqian@outlook.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: lishunyang <lishunyang12@163.com>
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn>
Co-authored-by: Peiqi Yin <yinpeiqi809@gmail.com>
Co-authored-by: wuhang <whlbx@hotmail.com>
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com>
Co-authored-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: lishunyang <lishunyang12@163.com>

2026-03-18 17:33:53 +08:00

README.md

add support for MammothModa2 model (#336 )

2026-03-04 22:52:56 +08:00

run_mammothmoda2_image_summarize.py

[Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring (#1908 )

2026-03-18 17:33:53 +08:00

run_mammothmoda2_t2i.py

[Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring (#1908 )

2026-03-18 17:33:53 +08:00

README.md

MammothModa2-Preview

Run examples (MammothModa2-Preview)

Download model

hf bytedance-research/MammothModa2-Preview --local-dir ./MammothModa2-Preview

Text-to-Image (T2I)

python examples/offline_inference/mammothmodal2_preview/run_mammothmoda2_t2i.py \
  --model ./MammothModa2-Preview \
  --stage-config ./vllm_omni/model_executor/stage_configs/mammoth_moda2.yaml \
  --prompt "A stylish woman riding a motorcycle in NYC, movie poster style" \
  --height 1024 \
  --width 1024 \
  --num-inference-steps 50 \
  --text-guidance-scale 4.0 \
  --out output.png

Image Summary

python examples/offline_inference/mammothmodal2_preview/run_mammothmoda2_image_summarize.py \
  --model ./MammothModa2-Preview \
  --stage-config ./vllm_omni/model_executor/stage_configs/mammoth_moda2_ar.yaml \
  --question "Summarize this image." \
  --image ./image.png