fcf1085395
[Refactor][OutputProcessor 2/8]: OmniRequestOutput should inherit RequestOutput and no nested wrap-up ( #5146 )
...
Signed-off-by: Boao Shi <aoibosh@connect.hku.hk >
Signed-off-by: bowieshi <aoibosh@connect.hku.hk >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Signed-off-by: Shi Boao Bowie <aoibosh@connect.hku.hk >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: ruirui(rein) yang <73573651+R2-Y@users.noreply.github.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-08-12 22:58:23 +08:00
9b0df3909a
[Feature] timestamps for TTS via a forced-aligner pooling ( #4795 )
...
Signed-off-by: wjinxu <1299461899@qq.com >
Co-authored-by: xurui <xurui1@modelbest.onaliyun.com >
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-08-12 05:33:34 +00:00
Sy03 and Yueqian Lin
58007c0084
[New Model] Support IndexTTS 2.5 ( #5957 )
...
Signed-off-by: Sysy <1370724210@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-08-11 23:00:35 +00:00
rein yang and Sy03
ad3a162eb8
[perf] Minicpm o4.5 optimization ( #5228 )
...
Signed-off-by: R2-Y <ruiruyang2@gmail.com >
Co-authored-by: Sy03 <1370724210@qq.com >
2026-07-24 17:20:39 +08:00
05b794f29b
[Full Duplex] Feat: Support Full-Duplex realtime runtime & add MiniCPM-o 4.5 demo ( #3907 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: lishunyang12 <lishunyang03@gmail.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: lishunyang12 <lishunyang03@gmail.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: StormMelody <22371184@zju.edu.cn >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-07-23 16:45:18 +08:00
amy-why-3459
9ceca4ec85
[Bugfix] Fix full-payload mm splitting for dual hidden/scheduled batch axes ( #4870 follow-up) ( #4910 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-07-06 15:08:05 +08:00
Jun Hee Yoo and Claude Opus 4.8
9d8089095e
[Bugfix] Support append/extend/count actions in TrackingArgumentParser ( #4639 )
...
Signed-off-by: Junhee Yoo <junhee.yoo@navercorp.com >
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-07-02 23:29:24 +00:00
504698dec8
[Core] Performance fix for orchestrator bottleneck: separates inter-stage from client outputs ( #4527 )
...
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com >
Co-authored-by: Chenguang ZHENG <645327136@qq.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-06-29 17:43:36 +02:00
amy-why-3459
f6894f4308
[BugFix] Delete unnecessary log printing ( #4566 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-06-24 09:40:07 +08:00
ad07f98b73
[Feat] Streaming TTS word-level timestamps via forced aligner ( #4034 )
...
Signed-off-by: wjinxu <1299461899@qq.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-06-22 04:51:45 +00:00
8f869c8ea5
[Refactor] Output Processor Phase 2: separate multimodal output channel ( #1601 ) ( #2744 )
...
Signed-off-by: Megha Agarwal <agarwalmegha1308@gmail.com >
Signed-off-by: meghaagr13 <divyanshsinghvi@gmail.com >
Signed-off-by: Taichang Zhou <tzhouam@connect.ust.hk >
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: meghaagr13 <divyanshsinghvi@gmail.com >
Co-authored-by: Boao Shi <aoibosh@connect.hku.hk >
Co-authored-by: Taichang Zhou <tzhouam@connect.ust.hk >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-12 15:19:14 +08:00
Alex Brooks
12e75c6618
[Core] Integrate TrackingArgumentParser ( #3369 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-06-02 21:56:24 +08:00
LHXuuu and vraiti
41a795b5d6
[Metrics] Add audio SLOs + cross-stage transfer families + per-(stage, replica) wrap for upstream vllm:* ( #3576 )
...
Signed-off-by: vraiti <vraiti@redhat.com >
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com >
Co-authored-by: vraiti <vraiti@redhat.com >
2026-06-01 20:20:48 +08:00
d4c139508f
[Feature] Add precomputed custom voices and Qwen3-TTS ref-context cache ( #3492 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Dan250124 <416947747@qq.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-31 17:51:24 +00:00
Yueqian Lin and Rein Yang
e996723bc9
[Bugfix] Fix Qwen3-TTS Stage 0 prefix-caching correctness ( #3665 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
the ci failure case is irrelavent to this PR and occurs rarely
2026-05-25 23:09:38 +08:00
dsinghvi
e40076e872
[Refactor] msgspec standardisation for data entry key names and improved type checks ( #3149 )
...
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
2026-05-12 14:30:13 +08:00
Juan Pablo Zuluaga and JuanPZuluaga
b64ab05d09
[TTS][SpeakerCacheManager] A global speaker cache manager for Voice Cloning ( #2630 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com >
2026-05-05 10:53:45 -04:00
Nick Cao and Claude
1e3bb36521
[Refactor] Remove sox from dependencies ( #2745 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-17 01:24:47 +00:00
Alex Brooks
f1e3f03726
[feature] Hidden State Prefix Caching ( #2164 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-04-15 17:01:45 +00:00
Nick Cao and Claude
2bc183f6f0
[Refactor] Remove dependency on librosa ( #2273 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-11 02:11:31 +08:00
+11
f50c5a413f
[Qwen3TTS] [TTS] [Feat] Refactor voice cache manager ( #2108 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com >
Signed-off-by: yiliu30 <yi4.liu@intel.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: Binh Tang <tangbinhna@gmail.com >
Signed-off-by: Binh Tang <binht@netflix.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
Signed-off-by: vraiti <vraiti@redhat.com >
Signed-off-by: Songrui625 <songrui625@gmail.com >
Signed-off-by: Lidang Jiang <lidangjiang@gmail.com >
Signed-off-by: Lidang-Jiang <lidangjiang@gmail.com >
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: Yi Liu <yi4.liu@intel.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
Co-authored-by: Binh Tang <tangbinhna@gmail.com >
Co-authored-by: Binh Tang <binht@netflix.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: rein yang <73573651+R2-Y@users.noreply.github.com >
Co-authored-by: zhumingjue138 <zhumingjue@huawei.com >
Co-authored-by: ChenWenjing <54166744+Shirley125@users.noreply.github.com >
Co-authored-by: vraiti <vraiti@redhat.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: Sy03 <1370724210@qq.com >
Co-authored-by: chickeyton <ngton2014@gmail.com >
Co-authored-by: Jerry Song <46962917+Songrui625@users.noreply.github.com >
Co-authored-by: Lidang Jiang <119769478+Lidang-Jiang@users.noreply.github.com >
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com >
Co-authored-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: linyueqian <linyueqian@outlook.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-04-03 16:51:58 -04:00
Canlin Guo
c9392dff01
[Hardware] Support platforms and plugin system ( #774 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-01-28 22:12:52 +08:00
汪志鹏
36c28767cd
[Core]Add GPU Diffusion Runner ( #822 )
...
Signed-off-by: princepride <wangzhipeng628@gmail.com >
2026-01-17 19:49:13 +08:00
TJian and Hongxia Yang
13584fd98e
[ROCm] [CI] Add ROCm Dockerfile and AMD CI (vllm v0.12.0) ( #280 )
...
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
Co-authored-by: Hongxia Yang <hongxia.yang@amd.com >
2025-12-21 11:51:37 +08:00
Gao Han
bfd3cad5ee
[Bugfix] Fix bug of online serving for qwen2.5-omni ( #118 )
...
Signed-off-by: Gaohan123 <gaohan19@huawei.com >
2025-11-30 21:30:17 +08:00
Canlin Guo
ec9e04027d
[Feat] Add NPU Backend support for vLLM-Omni ( #89 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2025-11-30 20:39:06 +08:00
hsliu
154d9ca4ff
Initial vLLM-omni repository structure
...
- Add complete directory structure for multimodal and non-autoregressive processing
- Include AsyncLLM, OmniEngine, and DiffusionEngine modules
- Add processors, schedulers, executors, and output processors
- Add API interfaces for Higress, Gradio, and ComfyUI
- Add configuration management and CLI interface
- Add comprehensive test structure and documentation
- Add pyproject.toml with dependencies and project configuration
- Add examples and documentation structure
2025-09-11 14:32:51 +08:00
