2025-11-28 11:03:52 +08:00
|
|
|
# Quickstart
|
|
|
|
|
|
|
|
|
|
This guide will help you quickly get started with vLLM-Omni to perform:
|
|
|
|
|
|
|
|
|
|
- Offline batched inference
|
|
|
|
|
- Online serving using OpenAI-compatible server
|
|
|
|
|
|
|
|
|
|
## Prerequisites
|
|
|
|
|
|
|
|
|
|
- OS: Linux
|
|
|
|
|
- Python: 3.12
|
|
|
|
|
|
|
|
|
|
## Installation
|
|
|
|
|
|
|
|
|
|
Please refer to [installation](installation/README.md)
|
|
|
|
|
|
|
|
|
|
## Offline Inference
|
|
|
|
|
|
2025-12-08 16:00:25 +08:00
|
|
|
Text-to-image generation quickstart with vLLM-Omni:
|
|
|
|
|
|
|
|
|
|
```python
|
|
|
|
|
from vllm_omni.entrypoints.omni import Omni
|
|
|
|
|
|
|
|
|
|
if __name__ == "__main__":
|
|
|
|
|
omni = Omni(model="Tongyi-MAI/Z-Image-Turbo")
|
|
|
|
|
prompt = "a cup of coffee on the table"
|
|
|
|
|
images = omni.generate(prompt)
|
|
|
|
|
images[0].save("coffee.png")
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
For more usages, please refer to [offline inference](../user_guide/examples/offline_inference/qwen2_5_omni.md)
|
2025-11-28 11:03:52 +08:00
|
|
|
|
|
|
|
|
## Online Serving with OpenAI-Completions API
|
|
|
|
|
|
2025-11-29 04:42:39 -08:00
|
|
|
Please refer to [online serving](../user_guide/examples/online_serving/qwen2_5_omni.md)
|
