anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity

[Doc] Reorganize available recipes into a table (#3671)

Browse Source 
Signed-off-by: hsliu <liuhongsheng4@huawei.com>
Co-authored-by: deepseek-v4-pro <noreply@anthropic.com>
This commit is contained in:
Hongsheng Liuanddeepseek-v4-pro authored and GitHub committed 2026-05-18 00:02:34 +08:00
1 parent 471ddfe025
commit c0e132d973
15 files changed
+52 -39
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

README.md
+1 -1
View File
@@ -9,7 +9,7 @@ Easy, fast, and cheap omni-modality model serving for everyone
</h3>
<p align="center">
| <a href="https://vllm-omni.readthedocs.io/en/latest/"><b>Documentation</b></a> | <a href="https://discuss.vllm.ai"><b>User Forum</b></a> | <a href="https://slack.vllm.ai"><b>Developer Slack</b></a> | <a href="docs/assets/WeChat.jpg"><b>WeChat</b></a> | <a href="https://arxiv.org/abs/2602.02204"><b>Paper</b></a> | <a href="https://docs.google.com/presentation/d/111-L8zF7A1j_YI_cR8JsblofdScdRr2f/edit?usp=sharing&ouid=110473603432222024453&rtpof=true&sd=true"><b>Slides</b></a> |
| <a href="https://vllm-omni.readthedocs.io/en/latest/"><b>Documentation</b></a> | <a href="https://deepwiki.com/vllm-project/vllm-omni"><b>DeepWiki</b></a> | <a href="https://discuss.vllm.ai"><b>User Forum</b></a> | <a href="https://slack.vllm.ai"><b>Developer Slack</b></a> | <a href="docs/assets/WeChat.jpg"><b>WeChat</b></a> | <a href="https://arxiv.org/abs/2602.02204"><b>Paper</b></a> | <a href="https://docs.google.com/presentation/d/111-L8zF7A1j_YI_cR8JsblofdScdRr2f/edit?usp=sharing&ouid=110473603432222024453&rtpof=true&sd=true"><b>Slides</b></a> |
</p>
recipes/Baidu/ERNIE-Image.md
+3 -1
View File
@@ -1,4 +1,6 @@
# ERNIE-Image for text-to-image generation
# ERNIE-Image
> Text-to-image online serving (ERNIE-Image 8B)
## Summary
recipes/LTX/LTX-2.3.md
+1 -1
View File
@@ -1,4 +1,4 @@
# LTX-2.3 Text-to-Video with Audio on 1x GPU (96GB VRAM)
# LTX-2.3
> 22B parameter text-to-video + audio generation model served via vLLM-Omni
recipes/LTX/LTX-2.md
+2 -2
View File
@@ -1,6 +1,6 @@
# LTX-2 T2V and I2V
# LTX-2
> LTX-2 for text-to-video & image-to-video on 1x H200 141GB
> Text-to-video and image-to-video serving
## Summary
recipes/Qwen/Qwen-Image.md
+3 -1
View File
@@ -1,4 +1,6 @@
# Qwen-Image for text-to-image serving with optional continuous batching on 1x A100 80GB
# Qwen-Image
> Text-to-image serving with optional step-wise continuous batching
## Summary
recipes/Qwen/Qwen3-Omni.md
+2
View File
@@ -1,5 +1,7 @@
# Qwen3-Omni
> Online serving for multimodal chat
## Summary
- Vendor: Qwen
recipes/Qwen/Qwen3-TTS.md
+3 -1
View File
@@ -1,4 +1,6 @@
# Qwen3-TTS for text-to-speech
# Qwen3-TTS
> Text-to-speech serving (CustomVoice / VoiceDesign / Base)
## Summary
recipes/README.md
+18 -24
View File
@@ -19,34 +19,28 @@ recipes/
Qwen/
Qwen3-Omni.md
Qwen3-TTS.md
Tencent-Hunyuan/
HunyuanVideo.md
Tencent/
Covo-Audio-Chat.md
```
## Available Recipes
- [`Qwen/Qwen-Image.md`](./Qwen/Qwen-Image.md): text-to-image serving recipe for
Qwen-Image on `1x A100 80GB`, including optional step-wise continuous batching replay
- [`Qwen/Qwen3-Omni.md`](./Qwen/Qwen3-Omni.md): online serving recipe for
multimodal chat on `1x A100 80GB`
- [`Tencent/Covo-Audio-Chat.md`](./Tencent/Covo-Audio-Chat.md): online
serving recipe for audio chat on `1x A100 80GB`
- [`Qwen/Qwen3-TTS.md`](./Qwen/Qwen3-TTS.md): text-to-speech serving recipe
for Qwen3-TTS (CustomVoice / VoiceDesign / Base) on `1x H100/A100 80GB`
- [`LTX/LTX-2.md`](./LTX/LTX-2.md): text-to-video and image-to-video serving
recipe for LTX-2 on `1x H200 141GB`
- [`Wan-AI/Wan2.2-I2V.md`](./Wan-AI/Wan2.2-I2V.md): image-to-video serving
recipe for Wan2.2 14B on `8x Ascend NPU (A2/A3)`
- [`Tencent-Hunyuan/HunyuanImage-3.0-Instruct.md`](./Tencent-Hunyuan/HunyuanImage-3.0-Instruct.md):
DiT-only text-to-image serving and benchmark recipe for HunyuanImage-3.0-Instruct
on `4x H100/H800 80GB`
- [`inclusionAI/Ming-flash-omni-2.0.md`](./inclusionAI/Ming-flash-omni-2.0.md):
online serving recipe for multimodal chat (`4x H100 80GB`) and standalone TTS (`1x H100 80GB`)
- [`Baidu/ERNIE-Image.md`](./Baidu/ERNIE-Image.md): text-to-image serving
online serving recipe for ERNIE-Image 8B on `1x RTX 4090 24GB` or `2x RTX 4090 24GB`
- [`fishaudio/Fish-Speech-S2-Pro.md`](./fishaudio/Fish-Speech-S2-Pro.md): online serving recipe for TTS on `1x A800 80GB`
- [`audiox/AudioX.md`](./audiox/AudioX.md): offline + online recipe for AudioX
unified text/video→audio diffusion on `1x L4 24GB`
| Recipe | Task | Hardware |
|--------|------|----------|
| [`audiox/AudioX.md`](./audiox/AudioX.md) | Offline + online unified text/video→audio diffusion | 1x L4 24GB |
| [`Baidu/ERNIE-Image.md`](./Baidu/ERNIE-Image.md) | Text-to-image online serving (ERNIE-Image 8B) | 1x or 2x RTX 4090 24GB |
| [`fishaudio/Fish-Speech-S2-Pro.md`](./fishaudio/Fish-Speech-S2-Pro.md) | Online serving for TTS | 1x A800 80GB |
| [`inclusionAI/Ming-flash-omni-2.0.md`](./inclusionAI/Ming-flash-omni-2.0.md) | Online serving for multimodal chat + standalone TTS | 4x H100 / 1x H100 80GB |
| [`LTX/LTX-2.md`](./LTX/LTX-2.md) | Text-to-video and image-to-video serving | 1x H200 141GB |
| [`LTX/LTX-2.3.md`](./LTX/LTX-2.3.md) | Text-to-video with audio generation (22B) | 1x GPU (96GB VRAM) |
| [`Qwen/Qwen-Image.md`](./Qwen/Qwen-Image.md) | Text-to-image serving with step-wise continuous batching replay | 1x A100 80GB |
| [`Qwen/Qwen3-Omni.md`](./Qwen/Qwen3-Omni.md) | Online serving for multimodal chat | 1x A100 80GB |
| [`Qwen/Qwen3-TTS.md`](./Qwen/Qwen3-TTS.md) | Text-to-speech serving (CustomVoice / VoiceDesign / Base) | 1x H100/A100 80GB |
| [`SenseNova/SenseNova-U1.md`](./SenseNova/SenseNova-U1.md) | Unified image generation and understanding | 1x H200 (144GB) |
| [`Tencent/Covo-Audio-Chat.md`](./Tencent/Covo-Audio-Chat.md) | Online serving for audio chat | 1x A100 80GB |
| [`Tencent/HunyuanImage-3.0-Instruct.md`](./Tencent/HunyuanImage-3.0-Instruct.md) | DiT-only text-to-image serving and benchmark | 4x H100/H800 80GB |
| [`Wan-AI/Wan2.2-I2V.md`](./Wan-AI/Wan2.2-I2V.md) | Image-to-video serving (Wan2.2 14B) | 8x Ascend NPU (A2/A3) |
| [`Wan-AI/Wan2.2-S2V.md`](./Wan-AI/Wan2.2-S2V.md) | Speech-to-video serving (Wan2.2 14B) | 2x A100/H100 80GB |
Within a single recipe file, include different hardware support sections such
as `GPU`, `ROCm`, and `NPU`, and add concrete tested configurations like
recipes/SenseNova/SenseNova-U1.md
+3 -1
View File
@@ -1,4 +1,6 @@
# SenseNova-U1 for unified image generation and understanding
# SenseNova-U1
> Unified image generation and understanding
## Summary
recipes/Tencent/Covo-Audio-Chat.md
+3 -1
View File
@@ -1,4 +1,6 @@
# Covo-Audio-Chat for audio chat on 1x A100 80GB
# Covo-Audio-Chat
> Online serving for audio chat
## Summary
recipes/Tencent-Hunyuan/HunyuanImage-3.0-Instruct.md → recipes/Tencent/HunyuanImage-3.0-Instruct.md
+2 -3
View File
@@ -1,7 +1,6 @@
# HunyuanImage-3.0-Instruct DiT Image Generation on 4x GPU
# HunyuanImage-3.0-Instruct
> DiT-only text-to-image recipe for HunyuanImage-3.0-Instruct with FP8,
> tensor parallelism, sequence parallelism, and CFG parallelism.
> DiT-only text-to-image serving and benchmark
## Summary
recipes/Wan-AI/Wan2.2-I2V.md
+3 -1
View File
@@ -1,4 +1,6 @@
# Wan2.2 Image To Video
# Wan2.2 Image-to-Video
> Image-to-video serving (Wan2.2 14B)
## Summary
recipes/Wan-AI/Wan2.2-S2V.md
+3 -1
View File
@@ -1,4 +1,6 @@
# Wan2.2 Speech To Video
# Wan2.2 Speech-to-Video
> Speech-to-video serving (Wan2.2 14B)
## Summary
recipes/fishaudio/Fish-Speech-S2-Pro.md
+2
View File
@@ -1,5 +1,7 @@
# Fish Speech S2 Pro
> Online serving for TTS
## Summary
- Vendor: FishAudio
recipes/inclusionAI/Ming-flash-omni-2.0.md
+3 -1
View File
@@ -1,4 +1,6 @@
# Ming-flash-omni 2.0 for omni-speech chat and standalone TTS
# Ming-flash-omni 2.0
> Online serving for multimodal chat + standalone TTS
## Summary