1 parent
e2b803fbe6
commit
1aa5ae61cb
4 files changed
+2
-52
No files matched your search
@@ -73,10 +73,3 @@ Modify PYTHONPATH in run.sh as your path of vllm_omni. Then run.
|
||||
bash run.sh
|
||||
```
|
||||
The output audio is saved in ./output_audio
|
||||
|
||||
## To-do list
|
||||
- [x] Offline inference example for Qwen2.5-omni with single request
|
||||
- [x] Adaptation from current vllm branch to stable vllm v0.11.0
|
||||
- [ ] Offline inference example for Qwen2.5-omni with streaming multiple requests
|
||||
- [ ] Online inference support
|
||||
- [ ] Support for other models
|
||||
Reference in new issue
Block a user