anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity

[Bugfix] Fix bug of online serving for qwen2.5-omni (#118)

Browse Source 
Signed-off-by: Gaohan123 <gaohan19@huawei.com>
This commit is contained in:
Gao Han authored and GitHub committed 2025-11-30 21:30:17 +08:00
1 parent 0d110312df
commit bfd3cad5ee
9 files changed
+50 -62
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/api/README.md
+2
View File
@@ -104,6 +104,8 @@ Worker classes and model runners for distributed inference.
- [vllm_omni.diffusion.worker.gpu_worker.GPUWorker][]
- [vllm_omni.diffusion.worker.gpu_worker.WorkerProc][]
- [vllm_omni.diffusion.worker.npu.npu_worker.NPUWorker][]
- [vllm_omni.diffusion.worker.npu.npu_worker.NPUWorkerProc][]
- [vllm_omni.worker.gpu_ar_model_runner.GPUARModelRunner][]
- [vllm_omni.worker.gpu_ar_worker.GPUARWorker][]
- [vllm_omni.worker.gpu_diffusion_model_runner.GPUDiffusionModelRunner][]
docs/user_guide/examples/online_serving/qwen3_omni.md
+2 -2
View File
@@ -26,12 +26,12 @@ cd examples/online_serving
Send request via python
```bash
python openai_chat_completion_client_for_multimodal_generation.py --query-type mixed_modalities
python openai_chat_completion_client_for_multimodal_generation.py --query-type use_image
```
Send request via curl
```bash
bash run_curl_multimodal_generation.sh mixed_modalities
bash run_curl_multimodal_generation.sh use_image
```
### FAQ