 Sy03
|
4200768f59
|
[Frontend] Scale Omni serving across API processes (#6923)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-16 22:29:31 -07:00 |
|
|
maithilijoshi20
|
f1a6e7ce2a
|
[Core] Retain structured configs through runtime startup (#6849)
Signed-off-by: maithilijoshi20 <97733343+maithilijoshi20@users.noreply.github.com>
|
2026-09-16 20:47:38 -07:00 |
|
|
Linze Shi
|
c8b3a17bd3
|
[Frontend] Allow explicit turn-based serving (#7675)
Signed-off-by: Linze-Shi <linzeshi0@gmail.com>
|
2026-09-16 17:29:57 -07:00 |
|
|
Aman
|
c32aaeb2da
|
[Bugfix] Fix Qwen3-TTS word timestamps with async chunking (#7544)
Signed-off-by: bezdarnost <amanurumbekov@gmail.com>
|
2026-09-16 15:07:52 -07:00 |
|
|
akshatvishu
|
a8434a60da
|
[BugFix][TTS] Fix MOSS Realtime serving and generation (#5661)
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
|
2026-09-16 11:39:51 -07:00 |
|
|
shiyichuanandmershi
|
c97b5fc741
|
[Bugfix][Frontend] Route synthetic aborts through final stage (#7006)
Signed-off-by: mershi <mershi@tencent.com>
Co-authored-by: mershi <mershi@tencent.com>
|
2026-09-16 11:38:45 -07:00 |
|
|
chickeytonandClaude Opus 5
|
99ff4f3070
|
[Core][Frontend] Unified Full-duplex Framework (#7413)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-16 15:35:36 +08:00 |
|
|
Zheng Wengangandwuli666
|
275720b378
|
[Bugfix] Keep async video jobs queued until inference and abort on delete (#6759)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: wuli666 <421774554@qq.com>
Co-authored-by: wuli666 <421774554@qq.com>
|
2026-09-15 20:43:30 -07:00 |
|
|
psv666
|
7bceb1a76b
|
[Bugfix] Align video frame consumption reporting with prompt sampling (#7329)
|
2026-09-16 02:49:07 +00:00 |
|
|
Clodagh Walsh
|
a1a234a0b4
|
[Voxtral] Raise BadRequest for ref_audio (#7012)
Signed-off-by: Clodagh Walsh <clodaghwalsh17@gmail.com>
|
2026-09-15 18:26:08 -07:00 |
|
|
Mengjie ZhaoandCursor
|
c17126c219
|
[Model] Add Gepard-1.0 OpenAI /v1/audio/speech serving (#7499)
Signed-off-by: Mengjie Zhao <zmj0129@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-15 14:56:51 -07:00 |
|
|
Alex Brooks
|
01f4479138
|
[Bugfix] Don't shutdown Engine on py_generator=True (#6334)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
|
2026-09-14 18:33:38 -04:00 |
|
|
ZacheryAU
|
f062124ba4
|
[Frontend][Benchmark] Add duplex performance metrics for OmniInteract and Omni-DuplexEval benchmark (#7242)
|
2026-09-14 15:25:59 -07:00 |
|
|
Zhichao Zhang
|
27f0e8c1ea
|
[Bugfix][Qwen3-TTS] Gate async-chunk Code2Wav on non_streaming_mode (#4371) (#6898)
Signed-off-by: Zhichao Zhang <60429419+smartDream-chao@users.noreply.github.com>
|
2026-09-14 15:25:51 -07:00 |
|
|
Ethan ZHUandZhu Shihao
|
9f85b3722e
|
[Model] Stop MiniCPM-o Thinker at TTS boundaries (#7463)
Signed-off-by: Zhu Shihao <zhushihao@bytedance.com>
Co-authored-by: Zhu Shihao <zhushihao@bytedance.com>
|
2026-09-14 15:25:00 -07:00 |
|
|
Nick Cao
|
fb23e8807a
|
[BugFix] Fix importing renamed module vllm.entrypoints.openai.engine.… (#7531)
Signed-off-by: Nick Cao <ncao@redhat.com>
|
2026-09-14 13:15:27 -06:00 |
|
|
heyuanliu-intel
|
40f8e94400
|
[Model][MiniMax-H3] Multi-GPU serving fixes and layer-wise offload component selection (#7047)
Signed-off-by: heyuanliu-intel <heyuan.liu@intel.com>
|
2026-09-14 10:02:30 -07:00 |
|
|
|
ea1a416a17
|
[Model] Add Breeze-TTS-2 two-stage AR TTS support (talker + codec, streaming) (#7084)
Signed-off-by: noname <liuzhiwei08@kuaishou.com>
Signed-off-by: noname <133508552+lzwnoname@users.noreply.github.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: noname <liuzhiwei08@kuaishou.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
|
2026-09-14 09:55:53 -07:00 |
|
|
bcsdhjew
|
e0c4f97f32
|
[Bugfix][Frontend] Preserve duplex chat audio format and duration (#7316)
Signed-off-by: Nolen Liang <nliang@nvidia.com>
|
2026-09-14 09:05:55 -07:00 |
|
|
psv666
|
446c2b5474
|
[Bugfix] Forward Qwen3-Omni streaming video sampling parameters (#7325)
Signed-off-by: psv666 <2693925048@qq.com>
|
2026-09-14 19:29:50 +08:00 |
|
|
|
8e738ce21b
|
[P0][RFC #3747] RL rollout serving: session management + world_model_env (#4770)
Signed-off-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk>
|
2026-09-14 09:26:44 +08:00 |
|
|
|
e284d907b5
|
[Perf][Frontend] Chunk in-memory image file responses (#7459)
Signed-off-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-13 20:33:10 +08:00 |
|
|
Hongsheng Liuandamy-why-3459
|
01a2f93256
|
[Bugfix][Frontend] Honor output_compression on the image generations route (#7447)
Signed-off-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-13 10:05:56 +08:00 |
|
|
|
7e520f9cc4
|
[3/N] Encode streamed video on the worker with bounded batching (#7018)
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-12 20:58:11 +08:00 |
|
|
longguo
|
68294066e3
|
[Bugfix] Require a model for vllm serve --omni (fixes #4158) (#4167)
Signed-off-by: abinggo <107740309+abinggo@users.noreply.github.com>
|
2026-09-12 04:03:16 +00:00 |
|
|
Nick CaoandCodex
|
d3493384cf
|
[BugFix] Fix leftovers of the legacy OpenAI realtime API event names (#7426)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-09-11 22:28:55 +08:00 |
|
|
GXINandHongsheng Liu
|
33fff2155e
|
[Feature][TTS] Add Speech API streaming metrics (#6853)
Signed-off-by: XIN GAO <1037396230@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-11 21:22:15 +08:00 |
|
|
|
a7ab91fb85
|
[Example] Migrate HunyuanImage-3.0 to model_extras + shared task examples (#5559)
Signed-off-by: suyanli220 <suyanli220@gmail.com>
Signed-off-by: suyan.li <suyan.li@bytedance.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: suyan.li <suyan.li@bytedance.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-11 16:47:25 +08:00 |
|
|
Nick CaoandClaude Sonnet 5
|
498c41b8d6
|
[Realtime] Emit current (non-beta) OpenAI audio/transcript event names (#7339)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
|
2026-09-11 08:50:12 +08:00 |
|
|
summerandHongsheng Liu
|
5a386d789f
|
[Bugfix] Fix host-memory leak on aborted /v1/images/generations (#6462) (#6561)
Signed-off-by: summer <128961079+zhang-keliang@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-11 00:04:08 +00:00 |
|
|
MaciejBalaNVandHongsheng Liu
|
05ab509269
|
Cosmos3 action policy improvements (#6460)
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Signed-off-by: MaciejBalaNV <mbala@nvidia.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
|
2026-09-10 22:32:50 +08:00 |
|
|
psv666
|
c8bef008eb
|
[Bugfix] Fix video prewarm cache retention and cancel-restart delay (#7363)
Signed-off-by: psv666 <2693925048@qq.com>
|
2026-09-10 14:16:57 +00:00 |
|
|
|
a2486dd00b
|
[Core][Diffusion] Add a typed pre-D2H video media contract (#6615)
Signed-off-by: NancyFyong <NancyFyong@users.noreply.github.com>
Signed-off-by: Samit <285365963@qq.com>
Co-authored-by: NancyFyong <NancyFyong@users.noreply.github.com>
Co-authored-by: Samit <285365963@qq.com>
|
2026-09-10 09:50:54 +00:00 |
|
|
LHXuuuandamy-why-3459
|
a7c295d544
|
[CI] Stabilize Qwen3-Omni Server VAD E2E (#7356)
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
|
2026-09-10 07:40:49 +00:00 |
|
|
herotai214
|
bbac4df7d3
|
[Refactor] P0.2: Migrate API server helpers out of api_server (#5453)
Signed-off-by: herotai214 <herotai214@gmail.com>
|
2026-09-10 15:03:21 +08:00 |
|
|
Zhou TaichangandClaude Opus 5
|
aff7d64948
|
[Rebase] Rebase to vLLM 0.29.0 (#7230)
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-10 12:08:28 +08:00 |
|
|
Sy03
|
b02862beee
|
[Model] Optimize MOSS-TTS Local batched execution and streaming codec (#7202)
Signed-off-by: Sy03 <1370724210@qq.com>
|
2026-09-09 13:02:12 -07:00 |
|
|
wangyu
|
09b720b0d2
|
[CI] Skip Qwen3-Omni Server VAD multi-turn realtime test (#7279) (#7314)
Signed-off-by: wangyu <410167048@qq.com>
|
2026-09-09 12:23:29 +08:00 |
|
|
Allen WuandTRAE CLI
|
f2e30f46b6
|
[Bugfix][TTS] Isolate shared Higgs v3 reference encode from request cancellation (#7076)
Signed-off-by: Allen Wu <allenwu2795@gmail.com>
Co-authored-by: TRAE CLI <traecli@bytedance.com>
|
2026-09-08 20:32:05 -07:00 |
|
|
Jim Ban
|
358b7d79c1
|
[Bugfix][Frontend] Enforce image pixel limits for video input references (#6963)
Signed-off-by: BANANASJIM <bananasjim1@gmail.com>
|
2026-09-08 20:31:54 -07:00 |
|
|
Ziming Wang
|
43b697541a
|
[Bugfix][Frontend] Clear the P0 multimodal cache through the renderer (#7003)
Signed-off-by: ZenAlexa <zimingwang945@gmail.com>
|
2026-09-08 20:31:42 -07:00 |
|
|
|
2bae550c04
|
[Frontend] Opt-in WebSocket TTS split_granularity and session seed (#7046)
Signed-off-by: rk9595 <rakesh.kariya@somaiya.edu>
Signed-off-by: Rakesh Kariya <rakesh.kariya@somaiya.edu>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-08 19:15:59 -07:00 |
|
|
zhengjiaandCursor
|
81c1c460b3
|
[Bugfix][Frontend] Accept the msgpack-numpy package's numpy markers on the OpenPI endpoint (#6051)
Signed-off-by: zjli2013 <leezhengjiang@126.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-08 19:15:48 -07:00 |
|
|
NancyFyongandNancyFyong
|
e74fe3c6e8
|
[Model] Add Audio8 TTS Preview 0.6B (DualAR, 44.1 kHz codec) (#6157)
Signed-off-by: NancyFyong <NancyFyong@users.noreply.github.com>
Co-authored-by: NancyFyong <NancyFyong@users.noreply.github.com>
|
2026-09-08 19:00:25 -07:00 |
|
|
boatman
|
cdf027874c
|
[Feat][OmniVoice]Support Varlen Attn, Request-Batch and Step-Execution (#6408)
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
|
2026-09-08 18:58:38 -07:00 |
|
|
liangmenghuangandClaude Fable 5.1
|
7a80b79698
|
[Bugfix][Model] GR00T-N1.7: honor the per-request seed for flow-matching noise (#7253)
Signed-off-by: liangmengh <liangmengh@nvidia.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-08 15:53:20 +00:00 |
|
|
LHXuuu
|
c9c25b33c3
|
[Frontend] Add server-side VAD for turn-based omni models (#6618)
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
|
2026-09-08 03:17:00 -07:00 |
|
|
Chenguang Zheng
|
f3fabe4145
|
[Bugfix] Keep --disable-log-stats out of stage config resolution (#7237)
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
|
2026-09-08 16:19:07 +08:00 |
|
|
Chenguang Zheng
|
087ac46318
|
[Refactor 1/N] Centralize Omni config resolution (#5140)
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
|
2026-09-08 10:30:26 +08:00 |
|
|
ZacheryAU
|
b1ec136bd7
|
[Frontend] Add omni benchmark support for image and video endpoints (#4728)
|
2026-09-08 09:28:21 +08:00 |
|