anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
3,449 Commits 235 Branches 31 Tags
9482bf1e8c068e72cc778616edff5b6a0e7c0245
Commit Graph
74 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
amy-why-3459 9482bf1e8c [Model] MiniCPM-o 4.5: enable fused CFM body by default on CUDA (#8557) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-10-07 10:25:39 +08:00
amy-why-3459 9146284c16 [Perf] Add CUDA graphs for MiniCPM-o 4.5 input encoders (#8332) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-10-05 15:01:07 +00:00
amy-why-3459 4af28f33bd [Bugfix] Defer VoxCPM2 NPU patch to avoid platform import cycle (#8330) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-09-30 05:25:36 -07:00
amy-why-3459 9f5521351e [Benchmark][MiniCPM-o] Port Video-MME dataset support to Omni bench s… (#6987) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-09-20 17:15:53 +08:00
amy-why-3459 882bf8bc95 [Frontend] Add a shared realtime web UI for MiniCPM-o and Qwen3-Omni (#7222) (#7585) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-09-17 23:32:31 +08:00
amy-why-3459 da94c3ebe1 [Bugfix][MiniCPM-o] Bind omni-duplex video frames to the unit they close (#6404) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-28 16:58:20 +08:00
amy-why-3459 5de6f7c37a [Bugfix][MiniCPM-o] Serve native duplex from shipping YAMLs and fence… (#6619) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-26 10:56:51 +08:00
amy-why-3459 42059f19d5 [Bugfix][MiniCPM-o] Cap offline Talker generation at remaining context (#6458) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-22 12:42:49 +08:00
amy-why-3459 48e4f6a385 [Bugfix][MiniCPM-o][NPU] Skip Code2Wav dynamo unwrap when flow.encode… (#6397) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-20 16:24:08 +08:00
amy-why-3459andCursor 9c61d5b67b [Bugfix][MiniCPM-o] Stop Talker mid-utterance truncation and load cod… (#6346) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-08-20 11:50:07 +08:00
amy-why-3459 3c6648d8a5 [Bugfix][NPU] Break the pytest DiffusionOutput circular import (#6293) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-18 10:11:10 +08:00
amy-why-3459 7cd826d28c [Bugfix][MiniCPM-o] Align Daily-Omni offline loading and duplex soft-… (#6095) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-12 18:36:31 +08:00
amy-why-3459 b792578d89 [CI][MiniCPM-o] Add MiniCPM-o 4.5 perf coverage to the ready gate (#6079) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-12 11:32:36 +08:00
amy-why-3459 348cf95a89 [CI][MiniCPM-o] Align MiniCPM-o 4.5 online serving tests with minicpm… (#6056) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-08-11 21:11:39 +08:00
amy-why-3459andCursor 67aa6c55a4 [Bugfix][MiniCPM-o] Align Daily-Omni bench with MiniCPM interleaved A… (#5625) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-31 22:41:00 -07:00
amy-why-3459andCursor 64bcdc2186 [Example][MiniCPM-o] Add offline/online MiniCPM-o 4.5 examples (#5222) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-21 11:37:15 +08:00
amy-why-3459 74f2742ac2 [Hardware][Ascend][Model] Add NPU support for MiniCPM-o 4.5 talker/vo… (#5117) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-07-20 21:45:28 +08:00
amy-why-3459 cbd3939c3d [BugFix] Fix CI failures caused by stale test expectations after recent stage-payload / deploy-config changes. (#5015) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-07-10 18:02:17 +08:00
amy-why-3459 9a44e7e019 [Refactor][Phase 1]Remove redundant functions and logs (#4986) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-07-10 15:13:35 +08:00
amy-why-3459 5dc787d5e8 [Perf][Qwen3-TTS] Align talker MTP CUDA graph capture with Qwen3-Omni & Adapt to async output (#4923) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-07-10 11:11:29 +08:00
amy-why-3459 7d4decc1d8 docs(recipe): fix MiniCPM-o 4.5 curl TTS example and clarify chat_template_kwargs usage (#4950) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-07-08 17:45:02 +08:00
amy-why-3459 9ceca4ec85 [Bugfix] Fix full-payload mm splitting for dual hidden/scheduled batch axes (#4870 follow-up) (#4910) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-07-06 15:08:05 +08:00
amy-why-3459 20d43ce24d [BugFix] Adapt to pin_memory in vLLM v0.24.0 (#4860) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-07-03 21:35:26 +08:00
amy-why-3459 4024a8ccd6 [BugFix] Remove prefix-cache test cases (#4703) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-06-25 13:47:41 +08:00
amy-why-3459 f6894f4308 [BugFix] Delete unnecessary log printing (#4566) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-06-24 09:40:07 +08:00
amy-why-3459 f05e03aea8 [Perf][DreamZero]dreamzero supports CUDA graph, torch.compile, and DiT Caching. (#4213) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-06-19 14:24:37 +08:00
amy-why-3459 d897852258 [BugFix] Fix the issue of incorrect generated tokens (#4461) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-06-17 02:31:48 +00:00
amy-why-3459 fc7393e485 [Refactor]Refactoring audio_in_video implementation (#3566) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-06-08 14:14:02 +08:00
amy-why-3459 1e43656ab1 [Bugfix] Update the value of --max-seed-tts-mean-wer in the accuracy test. (#4160) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-06-05 11:39:07 +08:00
amy-why-3459 519cf3ecf1 [Refactor] [Qwen3-Omni]Modify the thinker's sampling parameters to align with transformers. (#4137) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-06-04 22:49:04 +08:00
amy-why-3459 4e1c13236e [Perf][Qwen3-Omni]Optimize TTFP using initial_codec_chunk_frames (#4054) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-06-04 09:08:13 +08:00
amy-why-3459 8949fdc440 [BugFix] Fix the issue of vllm failing to start. (#4105) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-06-03 15:44:46 +00:00
amy-why-3459 9bb4974198 [BugFix] Fix the issue of dataset names not being resolved (#4094) 2026-06-03 06:17:04 +00:00
amy-why-3459andHongsheng Liu 2696751003 [Perf] Qwen3-Omni performance optimization (#3878) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-05-29 22:15:23 +08:00
amy-why-3459 5dd1d0a772 [BugFix] Fix prefix-caching issue (#3726) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-05-29 01:51:54 +00:00
amy-why-3459andHongsheng Liu 748470c1fb [BugFix] code2wav supports disabling CUDA graph. (#3732) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-05-24 00:05:55 +08:00
amy-why-3459 309e5c38c6 [BugFix][CI]Fixing occasional CI failures (#3623) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-05-18 21:25:37 +08:00
amy-why-3459 d1c65bdffa [BugFix] fix ci (#3650) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-05-15 22:50:03 +08:00
amy-why-3459 e7ee5de09f [BugFix] Fix the issue of thinker requests being preempted, causing shape mismatch. (#3147) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-05-15 17:07:42 +08:00
amy-why-3459 2e8e3057bc [skip ci][Tests] Splitting Qwen3-omni's performance test cases (#3501) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-05-13 17:54:21 +08:00
amy-why-3459 ce621be29b [BugFix] Modify the splicing method of streaming audio output. (#3438) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-05-12 11:56:10 +08:00
amy-why-3459Hongsheng LiuCanlin Guo
 		b25ea13cb0 [BugFix] Fixed a precision issue with one-word answers. (#3385) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Canlin Guo <961750412@qq.com>
 2026-05-07 06:21:00 +08:00
amy-why-3459andGao Han 282e0b6642 [BugFix][CI] Change max_tokens from 150 to 2048 (#3376) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
 2026-05-06 20:42:56 +08:00
amy-why-3459andHongsheng Liu 01f500a5bf [perf]Qwen3-Omni performance optimization (#3203) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-05-01 22:47:24 +08:00
amy-why-3459 335e2eb9e4 [perf]Qwen3-Omni performance optimization (#3164) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-28 11:59:26 +08:00
amy-why-3459 0470e96771 [Docs] Modify Qwen3-Omni's recipe (#3109) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-27 21:41:13 +08:00
amy-why-3459 e375b12680 [Refactor] Remove the default value "mp" from distributed_executor_backend. (#3007) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-25 11:48:03 +08:00
amy-why-3459 b8bd6fbbdb [Refactor] Remove redundant benchmarks from Qwen3-Omni (#3108) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-24 21:22:03 +08:00
amy-why-3459 3aa84c4742 [Tests]Add accuracy benchmark L4 test cases (#2843) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-23 09:40:43 +08:00
amy-why-3459 9337bec9ad [Tests] Modify test cases (#2991) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-22 19:08:10 +08:00
amy-why-3459 c1ba86ab5b [BugFix] Fix the issue with stream=True (#2955) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-21 11:51:39 +08:00
amy-why-3459 0393c58533 [BugFix] Fixed the issue where --no-async-chunk was not working. (#2934) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-20 13:50:17 +08:00
amy-why-3459 b88d3ce75e [BugFix] Fixing occasional engine crashes caused by abort requests (#2871) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-17 09:15:35 +00:00
amy-why-3459 227bab3038 [Benchmark]Omni-modality model accuracy benchmark(Daily-Omni & seed-tts-eval) (#2558) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-15 11:07:35 +08:00
amy-why-3459 f03ab38783 [BugFix] Fix NoneType' object has no attribute 'detach' (#2797) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-14 10:26:55 -04:00
amy-why-3459 159d6558ea [Tests][Qwen3-Omni]Add test cases for long videos and long audios. (#2598) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-14 19:36:02 +08:00
amy-why-3459 a5b38b5d0d [BugFix] Remove stage_configs_path validation (#2741) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-14 17:32:00 +12:00
amy-why-3459 2a1d5060ab [skip ci][doc]Update async_chunk design diagram (#2420) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-13 20:43:40 +08:00
amy-why-3459 ef3f72b9ae [Tests][Qwen3-Omni]Modify Qwen3-Omni performance test cases (#2600) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-13 19:03:13 +08:00
amy-why-3459 2b70e89535 [Revert] Revert "[Log] Wire stat loggers into AsyncOmniEngine to match AsyncLL… (#2716) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-04-13 14:55:16 +08:00
amy-why-3459 eced989b40 [Docs] Modify the documentation description for streaming output (#2300) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-03-28 11:24:15 +00:00
amy-why-3459 93bb988422 [Tests][Qwen3-Omni] Add performance test cases (#2011) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-03-28 19:01:44 +08:00
amy-why-3459 9f667ee151 [BugFix][Qwen3-Omni]Fixed the issue of incorrect answers for single words. (#2239) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-03-27 11:46:24 +08:00
amy-why-3459 029c85393a [BugFix]Fix keyError: num_processed_tokens_delta (#2213) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-03-26 15:16:25 +08:00
amy-why-3459 46b7e0cf9f [Test][Qwen3-Omni]Modify Qwen3-Omni benchmark test cases (#1628) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-03-04 22:42:47 +08:00
amy-why-3459Hongsheng LiuCanlin Guo
 		e1337c89c7 [BugFix] Restore talker's config (#1524) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Canlin Guo <961750412@qq.com>
 2026-02-27 06:44:11 +08:00
amy-why-3459 66c3e04263 [Performance]Qwen3-Omni performance optimization (#1378) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-02-26 21:21:36 +08:00
amy-why-3459 ee624d0686 [BugFix] Fixed the issue where ignore_eos was not working. (#1286) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-02-10 16:08:20 +08:00
amy-why-3459 d1cf4c4c0f [Bugfix] async_chunk rebase v0.15.0 (#1195) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-02-04 20:50:09 +08:00
amy-why-3459 5304bc1e16 [Refactor] Refactor async chunk and fix the shape mismatch issue (#1151) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-02-04 00:00:56 +08:00
amy-why-3459andHongsheng Liu e6b9d52905 [BugFix] Modify max_tokens and modify the log and fix #1103 (#1097) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-01-31 01:50:23 +13:00
amy-why-3459andRein Yang dd518973de [BugFix] Fix the accuracy issue of multimodal input. (#1020) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
 2026-01-29 19:30:11 +08:00
amy-why-3459 d2b3a24af3 [BugFix] Modify the method of obtaining external_request_id (#961) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
 2026-01-27 20:56:02 +08:00
amy-why-3459Rein YangCHENHongsheng Liu
 		52bf1e2f40 [Feature]Support async computation and communication across stages by chunks (#727) 
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
Signed-off-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: Rein Yang <ruiruyang2@gmail.com>
Co-authored-by: CHEN <116010019@link.cuhk.edu.cn>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-01-26 11:21:24 +08:00