John Liu BUAA
e8658b55d1
[Test] Add performance tests for Qwen-Image-Layered model ( #2807 )
...
Signed-off-by: John Liu BUAA <liukecheng97@gmail.com >
2026-04-16 18:49:59 +08:00
fan2956 and gcanlin
f1cb4ebe4c
[PERF] Wan2.2 support rmsnorm fused op ( #2583 )
...
Signed-off-by: fan2956 <zhoufan53@huawei.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: gcanlin <canlinguosdu@gmail.com >
2026-04-16 03:21:34 -07:00
NATURE and Hongsheng Liu
4d816ff1de
[Feature] Bagel: Support tp+cfg parallel using mooncake transfer engine connector ( #2705 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-16 16:25:13 +08:00
WeiQing Chen
24e61f4d7b
[CI] add qwen image and layered accuracy test ( #2772 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-04-16 14:52:53 +08:00
Lancer and Didan Deng
b43c6c6663
[Feat] add GLM-Image SP support ( #1983 )
...
Signed-off-by: Lancer <maruixiang6688@gmail.com >
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
Co-authored-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-04-16 12:20:46 +08:00
c83f664fe1
[CI][Perf] Add nightly PR labels, consolidate pipeline, and switch benchmark flag to --test-config-file ( #2816 )
...
Signed-off-by: wangyu <410167048@qq.com >
Co-authored-by: Y. Fisher <yukexiong1@huawei.com >
Co-authored-by: inaniloquentee <inani_@stu.xjtu.edu.cn >
2026-04-16 11:13:41 +08:00
wangyu
880a758b1f
[CI] Skip test_thinker_prefix_caching in tests/e2e/online_serving/test_qwen3_omni.py ( #2836 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-16 10:15:39 +08:00
Didan Deng
e9581137e9
[Perf] Add Performance Test for Qwen-Image Step-Level Execution ( #2707 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-04-15 17:45:16 +00:00
Alex Brooks
f1e3f03726
[feature] Hidden State Prefix Caching ( #2164 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
2026-04-15 17:01:45 +00:00
Juan Pablo Zuluaga and Hongsheng Liu
82f8c93343
[Feat][Qwen3-Omni] Shared code predictor module for Qwen3-TTS and Qwen3-Omni ( #2375 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-15 15:14:57 +08:00
4bf4c63147
Add voxcpm model support. ( #2467 )
...
Signed-off-by: Celeste-jq <591998922@qq.com >
Signed-off-by: lyj-jjj <liuyingjun5@huawei.com >
Signed-off-by: IsleOfDawnlight <stellamou@qq.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: Celeste-jq <591998922@qq.com >
Co-authored-by: lyj-jjj <liuyingjun5@huawei.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
2026-04-15 15:04:58 +08:00
Zeyu Huang | 黃澤宇
133e2f9706
[hotfix] API connection error in CI ( #2810 )
2026-04-15 14:08:00 +08:00
TaffyOfficial
1ad726f495
[Fix] HunyuanImage-3.0: unify naming hunyuan_image_3 → hunyuan_image3 ( #2712 )
2026-04-14 21:53:47 -07:00
WeiQing Chen
6c6551dff8
[Feature] feat: add video frame interpolation postprocess ( #2555 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-04-15 11:52:20 +08:00
Samit
61a3cbdff5
[Perf] Eliminate Hop 3 IPC overhead for single-stage diffusion via inline execution ( #2736 )
...
Signed-off-by: samithuang <285365963@qq.com >
Signed-off-by: Samit <285365963@qq.com >
2026-04-15 11:46:06 +08:00
Zeyu Huang | 黃澤宇
0d020739a7
[CI] qwen image edit L4 accuracy test ( #2761 )
2026-04-15 11:13:11 +08:00
wangyu
a782ae4780
[Perf] Enhance benchmark script to support baseline thresholds and proved result handling ( #2789 )
2026-04-15 10:28:28 +08:00
Yueqian Lin
02e5dc747d
[Perf] VoxCPM2: streaming VAE + compile optimization (45% RTF reduction) ( #2758 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-04-15 09:58:25 +08:00
rongfu.leng
9e46a79c17
[Bugfix] Handle numpy array outputs when generate image ( #1680 )
...
Signed-off-by: rongfu.leng <lenronfu@gmail.com >
2026-04-15 08:52:32 +08:00
Yueqian Lin
45e8829f07
docs(moss-tts-nano): add e2e online serving test and user guide docs
...
- Add online serving e2e test (non-streaming, streaming, Chinese)
- Add online serving user guide doc (API, voices, Gradio, curl/Python)
- Add offline inference user guide doc
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-04-14 13:06:44 -04:00
Yueqian Lin
da6b1b5741
feat(moss-tts-nano): add single-stage MOSS-TTS-Nano TTS support
...
Integrates OpenMOSS-Team/MOSS-TTS-Nano (0.1B) as a single
GPUGenerationWorker stage. Both the AR LM and MOSS-Audio-Tokenizer-Nano
codec run inside MossTTSNanoForGeneration.forward(), removing the need for
an inter-stage connector.
Key design choices:
- Weights loaded in load_weights() not __init__ (avoids pre-CUDA alloc)
- trust_remote_code delegates to upstream HF model classes
- codec path read from config.audio_tokenizer_pretrained_name_or_path
- inference_stream() collects progressive audio chunks for low latency
- 48 kHz stereo output; voice clone + continuation modes supported
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-04-14 13:06:12 -04:00
amy-why-3459
f03ab38783
[BugFix] Fix NoneType' object has no attribute 'detach' ( #2797 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-04-14 10:26:55 -04:00
Yiyang "Ian" Liu and Copilot
53a9cf49a6
fix: do not apply FP8 quant config to vision/audio encoders for pre-quantized checkpoints ( #2702 )
...
Signed-off-by: Yiyang Liu <37043548+ianliuy@users.noreply.github.com >
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com >
2026-04-14 13:52:32 +00:00
Bvicii
4fb078a031
[Bugfix] Reject /v1/audio/speech for Qwen omni models ( #2763 )
...
Signed-off-by: Bvicii <yizhanhuang2002@gmail.com >
2026-04-14 12:53:06 +00:00
wangyu
5ce0a43492
[CI][Bugfix] Update thresholds for accuracy tests ( #2725 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-14 20:48:04 +08:00
n1ptune and neptune
bcd5f16321
[Misc] clean Temporary CI Configs ( #2784 )
...
Signed-off-by: neptune <neptune@hust.edu.cn >
Co-authored-by: neptune <neptune@hust.edu.cn >
2026-04-14 12:41:23 +00:00
amy-why-3459
159d6558ea
[Tests][Qwen3-Omni]Add test cases for long videos and long audios. ( #2598 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-04-14 19:36:02 +08:00
NATURE
6d01a8b506
[Omni Connector] Omni Transfer Engine Connector: Enable 1-receiver-to-N-senders to support Bagel TP/CFG parallel ( #2731 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-04-14 16:06:37 +08:00
Zhang Jian and Claude Opus 4.6
17acd0589a
[Test] Add Stable Audio offline e2e TeaCache Test ( #2377 )
...
Signed-off-by: Zhang <jianmusings@gmail.com >
Signed-off-by: Zhang Jian <jianmusings@gmail.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-14 15:05:12 +08:00
Samit
644edac0b6
[Perf] Optimize MP4 encoding latency in video generation ( #2735 )
...
Signed-off-by: samithuang <285365963@qq.com >
2026-04-14 14:20:38 +08:00
amy-why-3459
a5b38b5d0d
[BugFix] Remove stage_configs_path validation ( #2741 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-04-14 17:32:00 +12:00
Zeyu Huang | 黃澤宇
8d23549b29
[CI] Qwen image edit performance benckmark ( #2216 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
2026-04-14 11:35:56 +08:00
Chen-Yo Sun
c9e2e3e8d7
[Voxtral TTS] Correct decode steps param in Voxtral TTS ( #2524 )
...
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai >
2026-04-13 17:53:35 +00:00
Didan Deng
6b5a52ae31
[Bugfix] Update Flux2-dev & Dynin_omni L4 e2e test ( #2723 )
...
Signed-off-by: Didan Deng <33117903+wtomin@users.noreply.github.com >
2026-04-13 20:50:38 +08:00
Yuanheng Zhao
e0cdbe9a5d
[Misc] Cleanup: use consistent pytest-mock in unit tests ( #2698 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
2026-04-13 19:21:42 +08:00
amy-why-3459
ef3f72b9ae
[Tests][Qwen3-Omni]Modify Qwen3-Omni performance test cases ( #2600 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-04-13 19:03:13 +08:00
Chenguang Zheng
155583f49f
[Bugfix] Release stage launch lock before handshake ( #2717 )
...
Signed-off-by: Chenguang ZHENG <645327136@qq.com >
2026-04-13 18:35:59 +08:00
JohnJan and wuzhongjian
cd2761e15c
[Feature]: support Flux.2-dev tea_cache ( #1871 )
...
Co-authored-by: wuzhongjian <wuzhongjian@cmss.chinamobile.com >
2026-04-13 17:51:48 +08:00
NATURE and Hongsheng Liu
0d4e975e1b
[core]refactor communication layer: PR1(Added Refactor Infra Only) ( #1555 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-13 16:01:14 +08:00
amy-why-3459
2b70e89535
[Revert] Revert "[Log] Wire stat loggers into AsyncOmniEngine to match AsyncLL… ( #2716 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-04-13 14:55:16 +08:00
wangyu
22261430b4
[CI][Bugfix] Refactor the test case to add support for increasing init timeout and stage init timeout in order to resolve the CI timeout error. ( #2711 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-13 14:47:55 +08:00
Jiaqian Liu and Canlin Guo
8097747a5d
[Model] Adapt Wan2.2-I2V-A14B via LightX2V offline conversion path ( #2134 )
...
Signed-off-by: Celeste-jq <591998922@qq.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
2026-04-13 14:20:04 +08:00
Zhengyuan Su (苏政渊) and Claude Opus 4.6
eb1a801b21
[Feat] Override single stage CLI args when stage_configs_path is set in OmniEngineArgs ( #2684 )
...
Signed-off-by: Zhengyuan Su <su.zhengyuan@u.nus.edu >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-13 11:08:52 +08:00
Canlin Guo
95b5b2ee43
[Bugfix] Fix UT for the missing of log_stats in Engine ( #2706 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-04-12 22:14:43 +08:00
zhou zhuoxin
16041ab550
[Refactor] Extend CFG Parallel to support 3 or 4 branch dispatch across M GPUs ( #2423 )
2026-04-12 22:06:49 +08:00
Alex Brooks and SYLAR
ef230ac720
[Bugfix] Fix Incompatible Multihook Integration (TeaCache <-> CPU Offload) ( #2689 )
...
Signed-off-by: Alex Brooks <albrooks@redhat.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-12 21:44:06 +08:00
Canlin Guo
5d58abb11e
[Log] Wire stat loggers into AsyncOmniEngine to match AsyncLLM ( #2551 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-04-12 19:54:23 +08:00
Reid and Hongsheng Liu
38dfe56fdf
[Bugfix] Validate speaker in chat endpoint and fix case-insensitive lookup ( #2407 )
...
Signed-off-by: reidliu41 <reid201711@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-04-12 00:14:16 -04:00
c20cac86ce
[Bugfix] Restore user config/runtime stage init timeout ( #2519 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-12 00:48:47 +08:00
Juan Pablo Zuluaga
f7e8df9dbd
[TTS][OmniVoice] Add voice cloning support for OmniVoice TTS ( #2676 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmail.com >
2026-04-11 12:14:03 -04:00