 JungleandCodex
|
67d21b5fff
|
[Core] Add token_ids output type and enforce canonical names (#7843)
Signed-off-by: Jungle430 <junglece430@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-10-05 16:49:03 +08:00 |
|
|
Zhou Taichang
|
0b0d2d7009
|
[Rebase] Align vLLM-Omni with vLLM v0.31.0 (#8459)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
|
2026-10-05 14:11:01 +08:00 |
|
|
Scott Ye
|
1f47fa2f29
|
[Model][Core] Avoid unused CosyVoice3 payloads and redundant AR output work (#8473)
Signed-off-by: Sorbett <sorbet111@163.com>
|
2026-10-05 04:52:19 +00:00 |
|
|
汪志鹏
|
5ca23106fd
|
[Model] Add SheetSage2 preprocessing and YuE2 score handoff (#8371)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
|
2026-10-05 11:09:37 +08:00 |
|
|
|
bbd539d2b6
|
[feature] Enable multi-node inference through Ray backend (#7938)
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Co-authored-by: Bartosz Stefaniak <bstefaniak@nvidia.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-10-05 02:53:36 +00:00 |
|
|
bcsdhjew
|
f781f7bb08
|
[Core][Frontend] Bound duplex output delivery and reject cancelled audio (#7644)
Signed-off-by: Nolen Liang <nliang@nvidia.com>
Signed-off-by: bcsdhjew <nliang@nvidia.com>
|
2026-10-04 14:06:04 -07:00 |
|
|
SunandOpenAI Codex
|
3f20252151
|
[Model] Fuse MammothModa2 QK norm and RoPE (#7969)
Signed-off-by: levius <2114377220@qq.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
|
2026-10-05 02:44:45 +08:00 |
|
|
hurukawa
|
c9c478dd07
|
[Perf] Support TeaCache for MammothModa2 (#5357)
Signed-off-by: nagisa-kun <1434936049@qq.com>
Signed-off-by: nagisa <1434936049@qq.com>
|
2026-10-05 01:25:56 +08:00 |
|
|
Rahul SteigerandRahul Steiger
|
4934741df9
|
[Bugfix] Add TRTLLM attention custom op and execution contract (#7214)
Signed-off-by: Rahul Steiger <rsteiger@aws-cmh-slurm-1-vscode-04.cm.cluster>
Signed-off-by: Rahul Steiger <rsteiger@nvidia.com>
Co-authored-by: Rahul Steiger <rsteiger@aws-cmh-slurm-1-vscode-04.cm.cluster>
|
2026-10-04 09:33:51 +00:00 |
|
|
Sy03
|
dd765fbf64
|
[Model] Select CosyVoice3 streaming defaults by device capability (#8433)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-03 21:59:36 -07:00 |
|
|
Sy03andYueqian Lin
|
3bc3f1a7d0
|
[Model] Optimize MOSS Local 1.5 MRV2 serving and progressive chunks (#8213)
Signed-off-by: Sy03 <1370724210@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-10-02 18:03:14 +00:00 |
|
|
Zheng Wengangandamy-why-3459
|
eb1699bfca
|
[FEAT][Fronted] Support incremental prefill for realtime video streaming (#5894)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: Zheng Wengang <zwg0606@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-10-02 22:18:51 +08:00 |
|
|
Sy03
|
e84014dffb
|
[Model] Add single-stage Qwen3-TTS with in-Talker streaming codec decode (#8259)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-02 21:34:30 +10:00 |
|
|
Rahul Steiger
|
596487fe62
|
[Core] Prototype diffusion attention execution contracts with FA4 (#7379)
|
2026-10-02 17:58:47 +08:00 |
|
|
MaciejBalaNVand汪志鹏
|
97d6c693a6
|
[feature] Add HSDP pre-sharded option (#7948)
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
|
2026-10-02 09:35:09 +00:00 |
|
|
Sy03
|
d93e1a8e09
|
[Model] Optimize Qwen3-Omni MRv2 handoff, code prediction and audio decoding (#8223)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-10-01 22:22:54 -07:00 |
|
|
Youyuan Liandprincepride
|
423f34326e
|
[Model] Add YuE2-3B text-to-music (model + /v1/audio/speech adapter) (#7886)
Signed-off-by: Youyuan Li <105433145+Darcy-Lee@users.noreply.github.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
|
2026-10-01 18:04:31 +08:00 |
|
|
WeiQing Chen
|
e34f8c4f42
|
[Doc] Update vLLM-Omni WeChat QR code (#8301)
Signed-off-by: David Chen <530634352@qq.com>
|
2026-09-30 11:39:05 +08:00 |
|
|
Mu GuanLinandHongsheng Liu
|
3a82c85880
|
[Experimental][Perf] Eliminate redundant host copies from generated-video transport (#7355)
Signed-off-by: mglyn <1203789601@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-30 11:37:57 +08:00 |
|
|
|
35cf6ac355
|
[Feat][Perf][AuK]Support Online Serving and DiT CUDAGraph (#7469)
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-09-30 00:18:38 +00:00 |
|
|
Sy03
|
5af3a16526
|
[Model] Add MiniCPM-o 4.5 turn-mode MRv2 and batched audio inference (#8222)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-29 11:41:39 -07:00 |
|
|
Sy03
|
001f8a80b9
|
[Core] Extend the shared multi-stage execution framework for mixed V1/MRv2 pipelines (#8184)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-29 07:40:57 -07:00 |
|
|
|
7d6904aa94
|
SeedVR2: bounded long-video restoration (#8102)
Signed-off-by: 0z5a <Dezhen.lu@student.uni-tuebingen.de>
Signed-off-by: 0z5a <dezhen.lu@uni-tuebingen.de>
Signed-off-by: 0z5a <dezhen.lu@student.uni-tuebingen.de>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: 0z5a <dezhen.lu@uni-tuebingen.de>
Co-authored-by: princepride <wangzhipeng628@gmail.com>
|
2026-09-29 11:33:50 +00:00 |
|
|
Canlin Guo
|
235c430326
|
[Frontend] Tune reference cache limits and registered MOSS voice requests (#7883)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
|
2026-09-29 04:10:17 +00:00 |
|
|
BeatSeat
|
3e62bba3cb
|
[Performance][MiniCPM-o] Whole-Euler CUDA graphs for Code2Wav with a shared attention arena (#8007)
|
2026-09-29 09:14:12 +10:00 |
|
|
RuQing Xu
|
0173cb3748
|
[Kernel] Improve 2 backends importing FlashInfer: FLASHINFER_ATTN and TRTLLM_ATTN (#7431)
Signed-off-by: Ruqing Xu <7891482+xrq-phys@users.noreply.github.com>
|
2026-09-28 21:21:58 +00:00 |
|
|
vraiti
|
d31dbc5b0a
|
[Frontend] OpenAI-compliant fullduplex /v1/realtime with Qwen3-Omni support (#7285)
Signed-off-by: vraiti <vraiti@redhat.com>
|
2026-09-28 20:14:05 +00:00 |
|
|
vOv
|
a07384b953
|
[Bugfix] Raise when a diffusion stage fails sleep or wake_up (#7811)
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
|
2026-09-29 00:12:34 +08:00 |
|
|
DMANandHongsheng Liu
|
79a46a4f54
|
[Perf][Diffusion] support Sensenova online fp8 (#7955)
Signed-off-by: Dmaner <2663515256@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-28 23:17:37 +08:00 |
|
|
Ding Zuhao
|
1b97ff1188
|
[Model] Support SenseNova-U1-A3B-MoT (MoE) (#8172)
Signed-off-by: Ding Zuhao <e1583181@u.nus.edu>
|
2026-09-27 08:48:08 +00:00 |
|
|
|
798d52ce55
|
[Core][Model] Fit PersonaPlex into the Unified Full-duplex Framework (RFC #7181 PR 2) (#7695)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-09-27 03:02:24 +00:00 |
|
|
Hongsheng Liuandhsliu_ustc
|
7ab582ae25
|
[Doc] Update README and docs for v0.30.0 (#8175)
Signed-off-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Co-authored-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
|
2026-09-27 10:07:58 +08:00 |
|
|
R0CKSTAR
|
6715c57b2d
|
feat: configure Torch Dynamo recompile limit from environment (#7243)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
|
2026-09-26 22:54:47 +08:00 |
|
|
Sy03
|
e1303e5067
|
[Model] Optimize Qwen3-TTS streaming throughput and first audio on CUDA (#8163)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-26 22:51:04 +08:00 |
|
|
Anjie HouandHongsheng Liu
|
8a49c65bf9
|
[Core][Diffusion] Add byte backpressure to chunk transfers (#7916)
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-26 17:48:32 +08:00 |
|
|
Joshna-Medisetty
|
62ebad2d7c
|
Add Intel Arc BMG recipes for validated P0 diffusion models. (#7537)
Signed-off-by: Joshna-Medisetty <joshna.medisetty@intel.com>
|
2026-09-25 15:42:08 -05:00 |
|
|
Sy03
|
d31a2a3ba8
|
[Bugfix] Fix Nemotron VoiceChat duplex nightly handshake (#7884)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-25 17:25:15 +00:00 |
|
|
Gao Han
|
69de153f6e
|
[Bugfix] Stop cancelled MiniMax-H3 requests at denoising boundaries (#7844)
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-25 13:36:09 +08:00 |
|
|
|
9e7e3a802c
|
[Bugfix] Compensate cancelled duplex open, append and resume; fix serving README drift (#7636 Issues 1, 2, 3, 21) (#7785)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com>
|
2026-09-24 19:23:08 -07:00 |
|
|
Isotr0py
|
7b4dc7633b
|
[Doc] Announce PR limitation to avoid agent spam (#8131)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-09-24 09:58:57 -07:00 |
|
|
|
535bd35b42
|
[Perf] Add reusable exact projection caching with MiniMax-H3 integration (#7987)
Signed-off-by: lishunyang12 <lishunyang12@users.noreply.github.com>
Signed-off-by: Armaan Amatya <armaanamatya2014@gmail.com>
Co-authored-by: lishunyang12 <lishunyang12@users.noreply.github.com>
Co-authored-by: Armaan Amatya <38102001+armaanamatya@users.noreply.github.com>
|
2026-09-24 23:30:42 +08:00 |
|
|
ZacheryAUandGao Han
|
926ba72793
|
[Frontend][Benchmark] Add judger and accuracy metrics for OmniInterac… (#7317)
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-24 08:34:23 +00:00 |
|
|
Haozhe Jiang
|
dbd6a35dd2
|
[Bugfix] Reject partially bound diffusion LoRA adapters (#8008)
Signed-off-by: Haozhe Jiang <162801044+provoke210@users.noreply.github.com>
|
2026-09-24 15:28:00 +08:00 |
|
|
Honghan ZhuandGao Han
|
67aa30c966
|
[Bugfix] Align MiniMax-H3 inference steps with denoiser evaluations (#7219)
Signed-off-by: zhuhh97 <zhuhonghan@huawei.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
|
2026-09-24 03:56:38 +00:00 |
|
|
Yukim1
|
205aa01c7b
|
[Diffusion][HunyuanImage3] Add request paged prefix caching (#7719)
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
|
2026-09-23 15:34:56 +00:00 |
|
|
Weiming Liao
|
81bc7116c1
|
[NPU] upgrade to v0.30.0 (#8027)
Signed-off-by: Weiming Liao <liaowm5@gmail.com>
|
2026-09-23 14:59:29 +00:00 |
|
|
Yuan WuandHongsheng Liu
|
cb5f508212
|
[Feature] Transfer AR-to-diffusion payloads over NIXL (#6264)
Signed-off-by: yuanwu <yuan.wu@intel.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-23 18:26:53 +08:00 |
|
|
Yueqian Lin
|
3f473a358b
|
[Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752)
|
2026-09-22 17:10:15 -07:00 |
|
|
MaciejBalaNV
|
7d6e2ade6c
|
[bugfix] Fix FP8 Quack kernels when using Context Parallelism and reduce number of recompilations (#7458)
Signed-off-by: Maciej Bala <mbala@nvidia.com>
|
2026-09-22 11:38:17 -07:00 |
|
|
MaciejBalaNV
|
c482626450
|
[optimization] Added Wan 2.2 VAE decode optimizations (#7056)
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Signed-off-by: MaciejBalaNV <mbala@nvidia.com>
|
2026-09-22 11:37:49 -07:00 |
|