anodyine/vllm-omni
1
0 Fork 0
Code Issues 4 Pull Requests 2 Actions Packages Projects Releases Wiki Activity
1,775 Commits 235 Branches 31 Tags
c69ed4037dcbae7306cba9094cb42bf94de464f0
Commit Graph
52 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
汪志鹏 c7178d89bb [Bugfix] UnspecifiedOmniPlatform.get_device_count returns 0 instead o… (#3636) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-05-15 05:28:40 +00:00
汪志鹏 c9a8556c24 [New Model]: Add sensenova u1 support (#3319) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2026-05-11 22:19:00 +08:00
汪志鹏andHongsheng Liu e50a066548 [BugFix]: Fix async scheduer transfer exceed KV cache (#3318) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-05-03 20:02:22 +08:00
汪志鹏 2cd64cdccb [CI]Change pixels tolerance from 5 to 10 (#3289) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-05-01 15:06:37 +12:00
汪志鹏 77e1e5c01c [BugFix][Bagel]: Fix vLLM-Omni as rollout bug: number of trajectory_latents count less (#3258) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-05-01 00:15:16 +08:00
汪志鹏andSYLAR 37e5954acf [Config Refactor]: Remove bagel yaml (#2936) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com>
 2026-04-24 21:21:30 +08:00
汪志鹏 e1cdd0c23b [BugFix][CI]: Fix test_omni_sleep_mode ci bug (#3010) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-04-22 12:36:20 +08:00
汪志鹏andHongsheng Liu 768931e6a4 [BugFix]: Fix multi-stage cfg bug (#2801) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-04-18 09:43:22 +00:00
汪志鹏 2c67c30550 [Bagel]: Support think mode in single stage deployment of Bagel (#2650) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-04-13 11:15:49 +00:00
汪志鹏 9d87229a30 [MagiHuman] Fix audio sample rate and fps propagation for online serving (#2554) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-04-09 06:52:12 +00:00
汪志鹏 408365fa0d [Bagel]Fused gate_proj and up_proj (#2546) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-04-07 10:02:51 +00:00
汪志鹏 340cba7b04 [daVinci-MagiHuman][Doc][BugFix] Update model support for daVici-MagiHuman and fix media utils bug (#2542) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-04-07 17:16:12 +08:00
汪志鹏 8dd66ceb00 [BugFix] Continue decode if don't need transfer kv cache between two … (#2502) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-04-07 13:30:01 +12:00
汪志鹏 5b2c4f909d [BugFix] Add bagel text2text/img2text think mode support (#2503) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-04-07 13:29:26 +12:00
汪志鹏andDidan Deng 0059ec878c [Model Support]: Magihuman support (#2301) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
 2026-04-04 09:29:09 +00:00
汪志鹏 fa275fd1be [BAGEL] [Feature]: Add thinking mode in Bagel multi-stage serving (#2447) 2026-04-03 11:47:57 +08:00
汪志鹏 bf5bd0a4c0 [BugFix]: Fix bagel single-stage img2img fallback to text2img bug (#2397) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-04-01 02:29:02 -07:00
汪志鹏 369f301a1b [BugFix] Add BAGEL single-stage diffusion config and fix multiple <im_start><im_end> bug (#2381) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-04-01 09:19:13 +08:00
汪志鹏andDidan Deng 77d773ad47 [Bagel]: Support SP (#1903) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com>
 2026-03-23 21:52:50 +08:00
汪志鹏 1bd1d9d618 Remove mm_prefix_lm patch because vllm==0.18.0 already support (#2062) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-03-21 22:32:00 +08:00
汪志鹏 c2a5420d97 [CI] Change Bagel online test environment variable VLLM_TEST_CLEAN_GPU_MEMORY to 0 (#2032) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-03-20 12:13:21 +08:00
汪志鹏 81793f1918 [CI] Split BAGEL tests into dummy/real weight tiers (L2/L3) (#1998) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-03-19 15:32:48 +08:00
汪志鹏 61e170c69a [Feature]: Remove some useless hf_overrides in yaml (#1898) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-03-18 19:46:44 +08:00
汪志鹏 284575ab82 [CI]: Add/Fix bagel e2e online/offline test (#1895) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2026-03-15 18:27:07 +08:00
汪志鹏 e0b71056ba [BugFix]: Fix bagel online inference bug (#1804) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-03-13 08:58:44 +00:00
汪志鹏 a52867abde [BugFix]: Revert #1582 (#1842) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-03-12 19:19:57 +08:00
汪志鹏 11d9ca8f41 [Feature]: Enable directly use OmniLLM init AR model (#1821) 2026-03-12 04:24:10 +00:00
汪志鹏 7271116973 [Bagel]: Support multistage img2img (#1669) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2026-03-09 22:23:50 +08:00
汪志鹏andgcanlin f9ec07f0e2 [Model]: Helios support (#1604) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
 2026-03-04 14:17:15 +08:00
汪志鹏andCursor e37a89ffcb [Feature]: Support cfg kv-cache transfer in multi-stage (#1422) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-03-02 05:06:28 +00:00
汪志鹏 3d9fa8d53f [BugFix]: fix a lot of bug (#1565) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-02-28 16:26:56 +08:00
汪志鹏 82e1bf2804 [Doc]: Add bagel single/multi node usage with mooncake document (#1450) 2026-02-24 15:54:57 +00:00
汪志鹏 630e84ef93 [BugFix]: Revert utils change (#1369) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-02-13 17:54:09 +08:00
汪志鹏 8228b5a8fe [Bagel]: Support TP (#1293) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-02-11 00:17:44 +13:00
汪志鹏andHongsheng Liu de0a8b057b [CI]: Bagel E2E Smoked Test (#1074) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-01-31 22:08:22 +13:00
汪志鹏andHongsheng Liu 0f0e94760c [TeaCache]: Add Coefficient Estimation (#940) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2026-01-31 22:06:17 +13:00
汪志鹏 741f7e2826 [Core]: KV Cache Transfer Encapsulation (#979) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2026-01-28 23:12:45 +08:00
汪志鹏 06c9d9b463 [Bagel] Support TeaCache (#848) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2026-01-25 14:52:27 +08:00
汪志鹏andwzliu 7f821be57b Support Bagel Model (#726) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Co-authored-by: wzliu <wzliu@connect.hku.hk>
 2026-01-22 23:09:55 +13:00
汪志鹏 36c28767cd [Core]Add GPU Diffusion Runner (#822) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-01-17 19:49:13 +08:00
汪志鹏 0888520875 [Bagel] Support Cache-Dit (#736) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-01-17 15:21:49 +08:00
汪志鹏 0ec2da08de [BugFix] Fix assuming all stage model have talker (#730) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-01-11 01:36:37 +13:00
汪志鹏 e7eeb54e08 [BugFix]Fix text_to_image bagel command error (#644) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-01-05 23:22:15 +13:00
汪志鹏 d430beef76 [Bagel]Add image edit (#588) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2026-01-05 12:18:04 +08:00
汪志鹏wzliuHongsheng Liu
 		23bf317cc5 [New Model]Bagel model(Diffusion Only) (#319) 
Signed-off-by: wzliu <wzliu@connect.hku.hk>
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: wzliu <wzliu@connect.hku.hk>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
 2025-12-31 13:47:35 +08:00
汪志鹏 a97f979ec4 [CI]Wheel package compilation (#288) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2025-12-18 17:14:18 +08:00
汪志鹏 6c333161a4 [BugFix]Remove duplicate code (#309) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2025-12-15 01:42:55 +00:00
汪志鹏 71f9f9a9a7 [Bugfix] Remove debug code in AsyncOmni.del to fix resource leak (#260) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2025-12-09 23:23:01 +08:00
汪志鹏 08fb978c46 [Docs]Fix doc wrong link (#223) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2025-12-06 22:41:03 +13:00
汪志鹏 f3c69df419 [FixBug]online serving fails for high-resolution videos (#198) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2025-12-05 02:29:01 +00:00
汪志鹏 522ce30a85 [Doc]Fixed some spelling errors (#199) 
Signed-off-by: princepride <wangzhipeng628@gmail.com>
 2025-12-04 08:43:28 -08:00
汪志鹏andZhipeng Wang 598d26580e [Doc] change vllm_omni to vllm-omni (#177) 
Signed-off-by: Zhipeng Wang <zhipeng.wang@rakuten.com>
Co-authored-by: Zhipeng Wang <zhipeng.wang@rakuten.com>
 2025-12-03 17:43:59 +08:00