Commit Graph
307 Commits
Author SHA1 Message Date
vraiti d31dbc5b0a [Frontend] OpenAI-compliant fullduplex /v1/realtime with Qwen3-Omni support (#7285)
Signed-off-by: vraiti <vraiti@redhat.com>
2026-09-28 20:14:05 +00:00
vOv a07384b953 [Bugfix] Raise when a diffusion stage fails sleep or wake_up (#7811)
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
2026-09-29 00:12:34 +08:00
Shaun WalshandClaude Opus 4.6 e823f0d909 [BugFix] Add field constraints to /v1/omni/sleep and /v1/omni/wakeup (#4740)
Signed-off-by: Shaun Walsh <shaunwalsh24@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-09-28 09:30:30 -06:00
Clodagh Walsh 9c688aeba0 [TTS] Improve voice delete error message (#7795)
Signed-off-by: Clodagh Walsh <clodaghwalsh17@gmail.com>
2026-09-28 09:42:34 -04:00
513dba842a [BugFix] Add modalities and logprobs validation for /v1/chat/completions (#4743)
Signed-off-by: Shaun Walsh <shaunwalsh24@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Alex Brooks <albrooks@redhat.com>
2026-09-24 18:09:19 -06:00
28c87cde19 [Bugfix] Replace hardcoded Vivian speaker default with config-ordered default (#5814)
Signed-off-by: khairulkabir1661 <khairulkabir1661@users.noreply.github.com>
Co-authored-by: khairulkabir1661 <khairulkabir1661@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Alex Brooks <albrooks@redhat.com>
2026-09-24 09:10:01 -07:00
z2z23n0andCanlin Guo 3b02e5338a [Bugfix][Frontend] Return 500 for unexpected speech failures (#6487)
Signed-off-by: z2z23n0 <51999056+z2z23n0@users.noreply.github.com>
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com>
2026-09-24 01:38:05 -07:00
wangyuandCursor 3d43571b94 [CI/Build] Cut L3 entrypoint BAGEL cold starts via L4 small-model sleep suites (#6851) (#7359)
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: [Your Name] <your.email@example.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-23 22:06:58 -07:00
Yueqian Lin 3f473a358b [Model] Accelerate Breeze-TTS-2 non-streaming inference (#7752) 2026-09-22 17:10:15 -07:00
Sicheng Hua d2aa07159c [Bugfix][Qwen3-TTS] Ignore voice labels for inline Base cloning (#6974)
Signed-off-by: sc-hua <sc_hua@qq.com>
2026-09-22 16:19:37 -07:00
shiyichuanandmershi 8422887d9f [Bugfix] Merge audio final output into the matching text choice (#7376) (#7879)
Signed-off-by: mershi <mershi@tencent.com>
Co-authored-by: mershi <mershi@tencent.com>
2026-09-22 10:23:26 -07:00
Deep Shah b44cf97b31 [Bugfix] Preserve all video-stream audio deltas (#7532)
Signed-off-by: Deep Shah <deep@socratic.co>
2026-09-22 10:19:16 -07:00
Clodagh Walsh 7af2c3d351 [CI][Voxtral] Resolve failing test_prepare_speech_generation_awaits_voxtral_async (#7601)
Signed-off-by: Clodagh Walsh <clodaghwalsh17@gmail.com>
2026-09-22 06:07:35 -07:00
Hoseung KimandHoseung Kim d4570afabf [Frontend] Reject built-in name collisions in voice upload and add VLLM_OMNI_SPEAKER_REGISTRATION_POLICY (#6848)
Signed-off-by: Hoseung Kim <hoseung.kim@navercorp.com>
Co-authored-by: Hoseung Kim <hoseung.kim@navercorp.com>
2026-09-21 18:35:07 -07:00
akshatvishu e01655f4a9 [BugFix] Fix diffusion TTS voice error responses (#7798)
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
2026-09-21 15:09:32 +00:00
Ding ZuhaoandCursor 154a1f25f5 [Bugfix] Honor the requested output canvas in BAGEL img2img (#7287)
Signed-off-by: Ding Zuhao <e1583181@u.nus.edu>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-21 07:29:24 +00:00
Sy03 a9e2117f5e [Core][Model] Enable Qwen3-TTS MRV2 and optimize the TTS pipeline (#7781)
Signed-off-by: Sy03 <1370724210@qq.com>
2026-09-20 23:03:08 -07:00
Zeyu Huang | 黃澤宇 e36babd48f [Core][Diffusion] Camera interaction for diffusion streaming generation (LingBot World 2 as example) (#7198)
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com>
2026-09-20 16:19:41 +00:00
DanaerLeeandzijianc2 16734bbdf3 [Bugfix] Route text-only chat as per-request comprehension in HunyuanImage3 AR sampler (#6111)
Signed-off-by: MrlixiangWE <mrdanaer@gmail.com>
Co-authored-by: zijianc2 <157244773+zijianc2@users.noreply.github.com>
2026-09-20 15:23:53 +00:00
psv666 2d0b03f717 [Bugfix] Fix Qwen3-Omni realtime playback interruption and conversation history (#7791)
Signed-off-by: psv666 <2693925048@qq.com>
2026-09-20 14:42:17 +00:00
Canlin Guo 4d877780d3 [Bugfix] Avoid waveform-list GC scans and release completed MOSS batches (#7885)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
2026-09-20 05:36:52 -07:00
wangyuandYueqian Lin 6a03e45c34 [Misc] Remove Dynin-Omni and dots.tts support (#7655)
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
2026-09-20 00:28:29 -07:00
xiaoyu-xyz 5a93ec1b4e [Model][Frontend] MiniMax-H3: Add latent-mask editing (#7465)
Signed-off-by: xiaoyu <1259084489@qq.com>
2026-09-20 03:54:44 +00:00
汪志鹏 8e10c3ee07 [Bugfix] Avoid multimodal cache collisions in multistage image editing (#7817)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
2026-09-20 11:27:06 +08:00
boatman f9f53f2bd8 [Bugfix]Include Reference Audio Cache Salt for HiggsAudio v2 (#7826)
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
2026-09-20 00:19:14 +08:00
amy-why-3459 882bf8bc95 [Frontend] Add a shared realtime web UI for MiniCPM-o and Qwen3-Omni (#7222) (#7585)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
2026-09-17 23:32:31 +08:00
Canlin Guo eb1abbadf8 [Feature][TTS] MOSS-TTS: place the reference-audio encoder on the code2wav stage's GPU (#7724)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
2026-09-17 05:51:26 -07:00
Chenchao Xu d0755b5716 [Model] Add π0.5 (Pi0.5) VLA model support (#6950)
Signed-off-by: chenchaox <chenchaox@nvidia.com>
2026-09-17 05:18:51 -07:00
Sy03 4200768f59 [Frontend] Scale Omni serving across API processes (#6923)
Signed-off-by: Sy03 <1370724210@qq.com>
2026-09-16 22:29:31 -07:00
maithilijoshi20 f1a6e7ce2a [Core] Retain structured configs through runtime startup (#6849)
Signed-off-by: maithilijoshi20 <97733343+maithilijoshi20@users.noreply.github.com>
2026-09-16 20:47:38 -07:00
Linze Shi c8b3a17bd3 [Frontend] Allow explicit turn-based serving (#7675)
Signed-off-by: Linze-Shi <linzeshi0@gmail.com>
2026-09-16 17:29:57 -07:00
Aman c32aaeb2da [Bugfix] Fix Qwen3-TTS word timestamps with async chunking (#7544)
Signed-off-by: bezdarnost <amanurumbekov@gmail.com>
2026-09-16 15:07:52 -07:00
akshatvishu a8434a60da [BugFix][TTS] Fix MOSS Realtime serving and generation (#5661)
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
2026-09-16 11:39:51 -07:00
chickeytonandClaude Opus 5 99ff4f3070 [Core][Frontend] Unified Full-duplex Framework (#7413)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-16 15:35:36 +08:00
Zheng Wengangandwuli666 275720b378 [Bugfix] Keep async video jobs queued until inference and abort on delete (#6759)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Signed-off-by: wuli666 <421774554@qq.com>
Co-authored-by: wuli666 <421774554@qq.com>
2026-09-15 20:43:30 -07:00
psv666 7bceb1a76b [Bugfix] Align video frame consumption reporting with prompt sampling (#7329) 2026-09-16 02:49:07 +00:00
Clodagh Walsh a1a234a0b4 [Voxtral] Raise BadRequest for ref_audio (#7012)
Signed-off-by: Clodagh Walsh <clodaghwalsh17@gmail.com>
2026-09-15 18:26:08 -07:00
Mengjie ZhaoandCursor c17126c219 [Model] Add Gepard-1.0 OpenAI /v1/audio/speech serving (#7499)
Signed-off-by: Mengjie Zhao <zmj0129@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-15 14:56:51 -07:00
ZacheryAU f062124ba4 [Frontend][Benchmark] Add duplex performance metrics for OmniInteract and Omni-DuplexEval benchmark (#7242) 2026-09-14 15:25:59 -07:00
Zhichao Zhang 27f0e8c1ea [Bugfix][Qwen3-TTS] Gate async-chunk Code2Wav on non_streaming_mode (#4371) (#6898)
Signed-off-by: Zhichao Zhang <60429419+smartDream-chao@users.noreply.github.com>
2026-09-14 15:25:51 -07:00
Nick Cao fb23e8807a [BugFix] Fix importing renamed module vllm.entrypoints.openai.engine.… (#7531)
Signed-off-by: Nick Cao <ncao@redhat.com>
2026-09-14 13:15:27 -06:00
heyuanliu-intel 40f8e94400 [Model][MiniMax-H3] Multi-GPU serving fixes and layer-wise offload component selection (#7047)
Signed-off-by: heyuanliu-intel <heyuan.liu@intel.com>
2026-09-14 10:02:30 -07:00
ea1a416a17 [Model] Add Breeze-TTS-2 two-stage AR TTS support (talker + codec, streaming) (#7084)
Signed-off-by: noname <liuzhiwei08@kuaishou.com>
Signed-off-by: noname <133508552+lzwnoname@users.noreply.github.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: noname <liuzhiwei08@kuaishou.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
2026-09-14 09:55:53 -07:00
bcsdhjew e0c4f97f32 [Bugfix][Frontend] Preserve duplex chat audio format and duration (#7316)
Signed-off-by: Nolen Liang <nliang@nvidia.com>
2026-09-14 09:05:55 -07:00
psv666 446c2b5474 [Bugfix] Forward Qwen3-Omni streaming video sampling parameters (#7325)
Signed-off-by: psv666 <2693925048@qq.com>
2026-09-14 19:29:50 +08:00
8e738ce21b [P0][RFC #3747] RL rollout serving: session management + world_model_env (#4770)
Signed-off-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk>
2026-09-14 09:26:44 +08:00
e284d907b5 [Perf][Frontend] Chunk in-memory image file responses (#7459)
Signed-off-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-13 20:33:10 +08:00
Hongsheng Liuandamy-why-3459 01a2f93256 [Bugfix][Frontend] Honor output_compression on the image generations route (#7447)
Signed-off-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
2026-09-13 10:05:56 +08:00
7e520f9cc4 [3/N] Encode streamed video on the worker with bounded batching (#7018)
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-12 20:58:11 +08:00
Nick CaoandCodex d3493384cf [BugFix] Fix leftovers of the legacy OpenAI realtime API event names (#7426)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-11 22:28:55 +08:00