tzhouam
342a209924
Merge remote-tracking branch 'origin/main' into dev/vllm-align
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-19 02:06:26 +00:00
3158e9d28f
[Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring ( #1908 )
...
Signed-off-by: yinpe <11810305@mail.sustech.edu.cn >
Signed-off-by: Peiqi Yin <yinpeiqi809@gmail.com >
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Signed-off-by: wuhang <whlbx@hotmail.com >
Signed-off-by: linyueqian <linyueqian@outlook.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: lishunyang <lishunyang12@163.com >
Signed-off-by: Chenguang ZHENG <645327136@qq.com >
Signed-off-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: yinpe <11810305@mail.sustech.edu.cn >
Co-authored-by: Peiqi Yin <yinpeiqi809@gmail.com >
Co-authored-by: wuhang <whlbx@hotmail.com >
Co-authored-by: Peiqi Yin <60515999+yinpeiqi@users.noreply.github.com >
Co-authored-by: linyueqian <linyueqian@outlook.com >
Co-authored-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: lishunyang <lishunyang12@163.com >
2026-03-18 17:33:53 +08:00
tzhouam
de6bcc734c
Update Dockerfile.ci to use a new vllm wheel URL and refactor MooncakeConnector import logic in monkey_patch.py for improved compatibility. Adjust OpenAIServingChat to call the harmony request method from the correct context.
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-16 08:33:28 +00:00
tzhouam
9c22e3afb0
Refactor import statement for OpenAIServingEmbedding in api_server.py to use aliasing for clarity
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-16 06:13:07 +00:00
tzhouam
aae101f495
Refactor import statement for OpenAIServingEmbedding in api_server.py
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-16 03:39:51 +00:00
tzhouam
3a508d7b7a
rebase: align vllm-omni with vLLM e9163b536e72
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-16 02:32:39 +00:00
tzhouam
97899c6c98
Merge remote-tracking branch 'origin/main' into dev/vllm-align
2026-03-13 19:03:57 +00:00
Yueqian Lin
cebf78ba3e
[Bugfix] Restore voice upload API and profiler endpoints reverted by #1719 ( #1879 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-03-14 04:37:08 +13:00
92f771d455
[Frontend] Rewrite video API for async job lifecycle ( #1665 )
...
Signed-off-by: Ian Eaves <ian.k.eaves@gmail.com >
Signed-off-by: Samit <285365963@qq.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: Gao Han <gaohan19@huawei.com >
2026-03-13 17:11:06 +08:00
汪志鹏
e0b71056ba
[BugFix]: Fix bagel online inference bug ( #1804 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
2026-03-13 08:58:44 +00:00
tzhouam
d3db476f2d
Merge branch 'main' into dev/vllm-align
2026-03-13 06:51:22 +00:00
tzhouam
e17fb0e97e
Refactor OpenAI serving components and enhance multimodal handling
...
- Updated import for OpenAIServingEmbedding in api_server.py.
- Enhanced omni_init_app_state to initialize renderer for engine_client.
- Added handle_oov_mm_token parameter to multiple model classes for better multimodal token handling.
- Improved comments for clarity in various model files.
- Adjusted GPUARModelRunner to ensure proper handling of late interaction runner attributes.
Signed-off-by: [Your Name] <[Your Email]>
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-13 01:55:17 +00:00
Yueqian Lin
366b3368ea
Add Fish Speech S2 Pro support with online serving and voice cloning ( #1798 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-03-12 16:20:52 -04:00
rongfu.leng
7c5159037f
[Feat] add wav response_format when stream is true in /v1/audio/speec… ( #1819 )
...
Signed-off-by: rongfu.leng <lenronfu@gmail.com >
2026-03-12 17:45:13 +08:00
5d28b6a40c
[Feat][Qwen3-TTS] Support streaming audio output for websocket ( #1719 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Signed-off-by: linyueqian <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: linyueqian <linyueqian@outlook.com >
2026-03-11 23:48:41 -04:00
Yueqian Lin
a6b5519616
[Bugfix] Report supported tasks for omni models to skip unnecessary chat init ( #1645 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-03-12 01:06:20 +08:00
Lancer
0f7c9c755d
[Bugfix] Expose base_model_paths property in _DiffusionServingModels ( #1771 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
2026-03-11 20:52:10 +08:00
tzhouam
08a2673c66
rebase: align vllm-omni with vLLM 84e436ed1c94
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
2026-03-11 07:29:52 +00:00
Juan Pablo Zuluaga and pablo
1d0a97f0d1
[feat][Qwen3TTS] Simple dynamic TTFA based on Code2Wav load ( #1714 )
...
Signed-off-by: pablo <pablo@agigo.ai >
Co-authored-by: pablo <pablo@agigo.ai >
2026-03-10 21:02:33 +00:00
Hongsheng Liu
4027534dbf
Revert "Add online serving to Stable Audio Diffusion and introduce v1/audio/generate endpoint" ( #1789 )
2026-03-10 22:40:48 +08:00
Ekagra Ranjan
7a560492a2
Add online serving to Stable Audio Diffusion and introduce v1/audio/generate endpoint ( #1255 )
2026-03-09 13:36:46 -04:00
Sy03
761eff930a
[Fix][Qwen3-TTS] Preserve ref_code decoder context for Base ICL ( #1731 )
2026-03-09 13:36:27 -04:00
Samit
155856ff30
[Perf] Reduce IPC overhead for single-stage diffusion serving for Wan2.2 ( #1715 )
...
Signed-off-by: samithuang <285365963@qq.com >
Signed-off-by: Samit <285365963@qq.com >
2026-03-10 00:03:51 +13:00
89b527e533
Dev/rebase v0170 ( #1639 )
...
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com >
2026-03-09 17:29:38 +08:00
41964cb90a
feat(tts): add voice upload API for Qwen3-TTS ( #1201 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
Co-authored-by: linyueqian <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-03-09 11:02:11 +08:00
Yueqian Lin
a9f694b08a
[Bugfix] Use upstream MediaConnector for ref_audio resolution ( #1661 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-03-09 01:38:26 +00:00
Canlin Guo
846167b237
[1/N][Refactor] Clean up dead code in output processor ( #1579 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-03-06 14:45:53 +08:00
Lidang Jiang
28c2200b47
[BugFix] Return proper HTTP status for ErrorResponse in create_speech ( #1687 )
...
Signed-off-by: Lidang-Jiang <lidangjiang@gmail.com >
2026-03-05 23:38:20 +08:00
WeiQing Chen
83fe7d005b
[Model] support LTX-2 text-to-video image-to-video ( #841 )
...
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
2026-03-05 23:31:48 +08:00
Juan Pablo Zuluaga and pablo
6a45efb287
[Feat][Qwen3TTS] reduce TTFA with flexible initial phase ( #1583 )
...
Signed-off-by: pablo <pablo@agigo.ai >
Co-authored-by: pablo <pablo@agigo.ai >
2026-03-05 23:14:41 +08:00
Yueqian Lin
35bd3ff7d2
[Bugfix] Add TTS request validation to prevent engine crashes ( #1641 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-03-04 14:27:02 +08:00
rongfu.leng
a4b2e48718
[Bugfix] Import InputPreprocessor into Renderer ( #1566 )
...
Signed-off-by: rongfu.leng <lenronfu@gmail.com >
2026-03-02 21:54:15 +08:00
Yueqian Lin
37775ffe60
fix(qwen3-tts): fix Base ICL voice clone producing corrupted audio ( #1554 )
...
Signed-off-by: linyueqian <linyueqian@outlook.com >
2026-02-28 11:49:47 +08:00
eaef3a31a4
[Profiler] Support online profiling ( #1136 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: Canlin Guo <961750412@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com >
2026-02-27 14:41:20 +08:00
4146095623
[Perf] GLM Image ( #920 )
...
Signed-off-by: JaredforReal <w13431838023@gmail.com >
Signed-off-by: Jared Wen <w13431838023@gmail.com >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-27 10:29:14 +08:00
03c01e0415
[Qwen3TTS][Feat] Streaming output ( #1438 )
...
Signed-off-by: pablo <pablo@agigo.ai >
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: pablo <pablo@agigo.ai >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-26 21:02:35 +08:00
Yanick Schraner
97f4c5b1e7
[Bugfix] Add TTS configuration options ( #1177 )
...
Signed-off-by: Yanick Schraner <yanick.schraner@bs.ch >
2026-02-26 00:14:44 +08:00
Junhong Liu
43939df2a5
[Bugfix] Robust Audio Data Handling in _create_audio_choice ( #1222 )
...
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com >
2026-02-25 22:59:49 +08:00
Sy03 and Hongsheng Liu
efbe4116ff
[Feature] : Support disaggregated inference pipeline for Qwen3_TTS ( #1161 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-02-21 07:36:44 +08:00
75770c9309
[Rebase] Rebase to vllm v0.16.0 ( #1357 )
...
ComfyUI Integration -- Publish to Comfy registry / Publish Custom Node to registry (push) Failing after 44s
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Isotr0py <Isotr0py@outlook.com >
Co-authored-by: ZJY0516 <zhu.jiangyun@foxmail.com >
Co-authored-by: youkaichao <youkaichao@gmail.com >
2026-02-13 18:05:07 +08:00
Samit and Flora Feng
9c00852d85
[Feature] Support Wan2.2 T2V and I2V Online Serving with OpenAI /v1/videos API ( #1073 )
...
Signed-off-by: samithuang <285365963@qq.com >
Signed-off-by: Samit <285365963@qq.com >
Signed-off-by: SamitHuang <285365963@qq.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
2026-02-12 14:28:32 +08:00
Junhong Liu
82fd2c3637
Fix yield token metrics and opt metrics record stats ( #1292 )
2026-02-12 00:52:05 +08:00
Canlin Guo
e192b0a6c5
[Misc] Add per-request generator_device to online image gen and edit ( #1183 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-02-10 18:47:08 +08:00
amy-why-3459
ee624d0686
[BugFix] Fixed the issue where ignore_eos was not working. ( #1286 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-02-10 16:08:20 +08:00
ApsarasX
87847a214a
[Bugfix] Ensure seed=0 is correctly handled in image edit ( #1248 )
...
Signed-off-by: ApsarasX <apsarax@outlook.com >
2026-02-07 07:09:54 +08:00
Zhou Taichang and 汪志鹏
70ef548448
Dev/rebase v0.15.0 ( #1159 )
...
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
2026-02-03 12:24:45 +08:00
ceanna93 and anna
df3b347cd9
[Misc] Align error handling with upstream vLLM v0.14.0 ( #1122 )
...
Signed-off-by: anna <lee.anna@navercorp.com >
Co-authored-by: anna <lee.anna@navercorp.com >
2026-02-01 21:59:08 +08:00
dengyunyang
70a5de9dd4
[FEATURE] /v1/images/edit interface ( #1101 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-01-31 14:13:36 +08:00
2e6895ff0e
[Bugfix][Qwen3TTS] Load speaker_id/voices from model configuration ( #1079 )
...
Signed-off-by: pablo <juanz9312@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
2026-01-31 10:42:09 +08:00
Jiangyun Zhu and Hongsheng Liu
8ad39570b8
[Bugfix] fix request_id of image generation in api server ( #1112 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-01-31 00:05:34 +08:00
tzhouam