anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
3,047 Commits 235 Branches 31 Tags
4a8ac297751b03fbe21f2d8a4550a027fe02e7cd
Commit Graph
269 Commits
Author SHA1 Message Date
ZacheryAU f062124ba4 [Frontend][Benchmark] Add duplex performance metrics for OmniInteract and Omni-DuplexEval benchmark (#7242) 2026-09-14 15:25:59 -07:00
Zhichao Zhang 27f0e8c1ea [Bugfix][Qwen3-TTS] Gate async-chunk Code2Wav on non_streaming_mode (#4371) (#6898) 
Signed-off-by: Zhichao Zhang <60429419+smartDream-chao@users.noreply.github.com>
 2026-09-14 15:25:51 -07:00
Nick Cao fb23e8807a [BugFix] Fix importing renamed module vllm.entrypoints.openai.engine.… (#7531) 
Signed-off-by: Nick Cao <ncao@redhat.com>
 2026-09-14 13:15:27 -06:00
heyuanliu-intel 40f8e94400 [Model][MiniMax-H3] Multi-GPU serving fixes and layer-wise offload component selection (#7047) 
Signed-off-by: heyuanliu-intel <heyuan.liu@intel.com>
 2026-09-14 10:02:30 -07:00
nonamenonameYueqian Lin
 		ea1a416a17 [Model] Add Breeze-TTS-2 two-stage AR TTS support (talker + codec, streaming) (#7084) 
Signed-off-by: noname <liuzhiwei08@kuaishou.com>
Signed-off-by: noname <133508552+lzwnoname@users.noreply.github.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: noname <liuzhiwei08@kuaishou.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
 2026-09-14 09:55:53 -07:00
bcsdhjew e0c4f97f32 [Bugfix][Frontend] Preserve duplex chat audio format and duration (#7316) 
Signed-off-by: Nolen Liang <nliang@nvidia.com>
 2026-09-14 09:05:55 -07:00
psv666 446c2b5474 [Bugfix] Forward Qwen3-Omni streaming video sampling parameters (#7325) 
Signed-off-by: psv666 <2693925048@qq.com>
 2026-09-14 19:29:50 +08:00
Srinivas Krovvidisrinivas_oo7Zhou Taichang
 		8e738ce21b [P0][RFC #3747] RL rollout serving: session management + world_model_env (#4770) 
Signed-off-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: Zhou Taichang <tzhouam@connect.ust.hk>
 2026-09-14 09:26:44 +08:00
Qi JiaQI JIACursor
 		e284d907b5 [Perf][Frontend] Chunk in-memory image file responses (#7459) 
Signed-off-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: QI JIA <qi.jia@shengshu.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-09-13 20:33:10 +08:00
Hongsheng Liuandamy-why-3459 01a2f93256 [Bugfix][Frontend] Honor output_compression on the image generations route (#7447) 
Signed-off-by: hsliu_ustc <hsliu_ustc@noreply.gitcode.com>
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-09-13 10:05:56 +08:00
Anjie HouClaude Sonnet 5Hongsheng Liu
 		7e520f9cc4 [3/N] Encode streamed video on the worker with bounded batching (#7018) 
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-09-12 20:58:11 +08:00
Nick CaoandCodex d3493384cf [BugFix] Fix leftovers of the legacy OpenAI realtime API event names (#7426) 
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-09-11 22:28:55 +08:00
GXINandHongsheng Liu 33fff2155e [Feature][TTS] Add Speech API streaming metrics (#6853) 
Signed-off-by: XIN GAO <1037396230@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-09-11 21:22:15 +08:00
SuyanLiClaude Opus 4.8suyan.liHongsheng Liu
 		a7ab91fb85 [Example] Migrate HunyuanImage-3.0 to model_extras + shared task examples (#5559) 
Signed-off-by: suyanli220 <suyanli220@gmail.com>
Signed-off-by: suyan.li <suyan.li@bytedance.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: suyan.li <suyan.li@bytedance.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-09-11 16:47:25 +08:00
Nick CaoandClaude Sonnet 5 498c41b8d6 [Realtime] Emit current (non-beta) OpenAI audio/transcript event names (#7339) 
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
 2026-09-11 08:50:12 +08:00
MaciejBalaNVandHongsheng Liu 05ab509269 Cosmos3 action policy improvements (#6460) 
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Signed-off-by: MaciejBalaNV <mbala@nvidia.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-09-10 22:32:50 +08:00
psv666 c8bef008eb [Bugfix] Fix video prewarm cache retention and cancel-restart delay (#7363) 
Signed-off-by: psv666 <2693925048@qq.com>
 2026-09-10 14:16:57 +00:00
LHXuuuandamy-why-3459 a7c295d544 [CI] Stabilize Qwen3-Omni Server VAD E2E (#7356) 
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-09-10 07:40:49 +00:00
herotai214 bbac4df7d3 [Refactor] P0.2: Migrate API server helpers out of api_server (#5453) 
Signed-off-by: herotai214 <herotai214@gmail.com>
 2026-09-10 15:03:21 +08:00
Zhou TaichangandClaude Opus 5 aff7d64948 [Rebase] Rebase to vLLM 0.29.0 (#7230) 
Signed-off-by: tzhouam <tzhouam@connect.ust.hk>
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-10 12:08:28 +08:00
Sy03 b02862beee [Model] Optimize MOSS-TTS Local batched execution and streaming codec (#7202) 
Signed-off-by: Sy03 <1370724210@qq.com>
 2026-09-09 13:02:12 -07:00
wangyu 09b720b0d2 [CI] Skip Qwen3-Omni Server VAD multi-turn realtime test (#7279) (#7314) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-09-09 12:23:29 +08:00
Allen WuandTRAE CLI f2e30f46b6 [Bugfix][TTS] Isolate shared Higgs v3 reference encode from request cancellation (#7076) 
Signed-off-by: Allen Wu <allenwu2795@gmail.com>
Co-authored-by: TRAE CLI <traecli@bytedance.com>
 2026-09-08 20:32:05 -07:00
Jim Ban 358b7d79c1 [Bugfix][Frontend] Enforce image pixel limits for video input references (#6963) 
Signed-off-by: BANANASJIM <bananasjim1@gmail.com>
 2026-09-08 20:31:54 -07:00
Rakesh KariyaCursorClaude Opus 5
 		2bae550c04 [Frontend] Opt-in WebSocket TTS split_granularity and session seed (#7046) 
Signed-off-by: rk9595 <rakesh.kariya@somaiya.edu>
Signed-off-by: Rakesh Kariya <rakesh.kariya@somaiya.edu>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-08 19:15:59 -07:00
zhengjiaandCursor 81c1c460b3 [Bugfix][Frontend] Accept the msgpack-numpy package's numpy markers on the OpenPI endpoint (#6051) 
Signed-off-by: zjli2013 <leezhengjiang@126.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-09-08 19:15:48 -07:00
NancyFyongandNancyFyong e74fe3c6e8 [Model] Add Audio8 TTS Preview 0.6B (DualAR, 44.1 kHz codec) (#6157) 
Signed-off-by: NancyFyong <NancyFyong@users.noreply.github.com>
Co-authored-by: NancyFyong <NancyFyong@users.noreply.github.com>
 2026-09-08 19:00:25 -07:00
boatman cdf027874c [Feat][OmniVoice]Support Varlen Attn, Request-Batch and Step-Execution (#6408) 
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
 2026-09-08 18:58:38 -07:00
liangmenghuangandClaude Fable 5.1 7a80b79698 [Bugfix][Model] GR00T-N1.7: honor the per-request seed for flow-matching noise (#7253) 
Signed-off-by: liangmengh <liangmengh@nvidia.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-08 15:53:20 +00:00
LHXuuu c9c25b33c3 [Frontend] Add server-side VAD for turn-based omni models (#6618) 
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
 2026-09-08 03:17:00 -07:00
ZacheryAU b1ec136bd7 [Frontend] Add omni benchmark support for image and video endpoints (#4728) 2026-09-08 09:28:21 +08:00
boatman 043f03d576 [Migrate]Move model-specific helpers out of serving_speech (#6697) 
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
 2026-09-08 08:59:45 +08:00
FredHuangNV 85b0bad2d3 [Frontend][Model] Add Cosmos3 control uploads to video API (#7027) 
Signed-off-by: Fred Huang <frhuang@nvidia.com>
 2026-09-07 01:38:56 -07:00
Mengjie ZhaoandCursor e8526cc552 [CI/Build] Stabilize Qwen3-TTS speaker-embedding tests against miss-EOS flake (#6924) 
Signed-off-by: Mengjie Zhao <zmj0129@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-09-06 07:44:23 +00:00
Samit 44d3ae100a [Bugfix][Diffusion] Fuse distilled LoRA weights before HSDP sharding (#6948) 
Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
 2026-09-06 01:29:59 +08:00
chickeytonClaude Fable 5Gao Han
 		5d7fdf9350 [Core] Graduate MiniCPM-o 4.5 and PersonaPlex full-duplex serving out of experimental (#6196) 
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
 2026-09-05 08:20:21 +00:00
Hongsheng Liu d4096e01fe [Model] Add native MAGI-2 Preview diffusion support (#5918) 
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com>
 2026-09-05 15:32:30 +08:00
BruceLoveDecimalandClaude Opus 5 1e74807c35 [Feature][Moss-TTS] Reference Audio Preprocessing (#4982) 
Signed-off-by: BruceLoveDecimal <39156883+BruceLoveDecimal@users.noreply.github.com>
Signed-off-by: liuqihao <liuqihao970610@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-09-04 16:36:26 -07:00
LOGO127 b6b992ac7b [Bugfix] Fix Higgs Audio v3 voice-clone token validation (#7065) 
Signed-off-by: luozijian <luozijian0924@gmail.com>
 2026-09-04 16:06:47 -07:00
boatman 348fd0fc07 [Feat][dots.tts] Add Online Serving Support (#6235) 
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
 2026-09-04 14:44:10 -07:00
Mu GuanLin 1dae537313 [Bugfix][LTX] Restore distilled two-stage video serving (#6847) 
Signed-off-by: mglyn <1203789601@qq.com>
 2026-09-03 18:48:43 +08:00
Eugene Zhao ec22c7ac06 [Bugfix] Restore Omni health route ownership (#6723) 
Signed-off-by: qujing226 <qujing226@gmail.com>
Signed-off-by: Eugene Zhao <113281545+qujing226@users.noreply.github.com>
 2026-09-03 00:54:36 -07:00
GXINandHongsheng Liu 3ab582c993 [Bugfix][Qwen3-TTS] Reject task mismatches before EngineCore dispatch (#6113) 
Signed-off-by: XIN GAO <1037396230@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-09-02 11:16:55 -07:00
wangyu d5fd9eb6bb [Bugfix][Diffusion] Register Sana I2V pipeline as video output (#6953) 
Signed-off-by: wangyu <410167048@qq.com>
 2026-09-02 23:16:58 +08:00
AuFlowandHongsheng Liu 49c6fc1540 [Frontend] Add configurable output sample rate to Speech API (#6553) 
Signed-off-by: 郑倩倩 <2458983186@qq.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-09-01 17:25:09 +08:00
Gao Han 705e781b0e [Bugfix][MiniCPM-o] Checkpoint playback before final input commit (#6821) 
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
 2026-08-31 15:18:29 +00:00
汪志鹏andHongsheng Liu 86b85c078b [Feature][MiniMax-H3] Fuse the FastH3 four-step adapter at load time (#6714) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-08-31 12:04:58 +08:00
akshatvishu f321cdbe16 [Bugfix] Use Seed-TTS reference audio with MiniCPM-o 4.5 (#6628) 
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
 2026-08-31 10:27:34 +08:00
SYLAR 759aa4ffeb [Diffusion][Performance] Optimize MiniMax-H3 video output transfer (#6824) 
Signed-off-by: lishunyang12 <lishunyang12@163.com>
 2026-08-31 07:07:34 +08:00
mokekeandmokashliu 1a9d598d2b [Frontend] Encode interleaved video frames in parallel (#6776) 
Signed-off-by: mokashliu <mokashliu@tencent.com>
Co-authored-by: mokashliu <mokashliu@tencent.com>
 2026-08-31 07:04:27 +08:00