tzhouam and Claude
9aed0e4eb8
test(accuracy): re-baseline HunyuanImage3 SSIM/PSNR for the vLLM rebase
...
HunyuanImage-3 (expert-parallel MoE) accuracy fails deterministically on
dev/vllm-align (SSIM 0.9490 vs 0.97, PSNR 26.21 vs 30 dB) while passing on
main's nightly. The align branch changes no hunyuan code; the drift comes
from the newer upstream vLLM (65a7b4628409, 585 commits past the v0.24.0
tag main tracks) shifting MoE kernel numerics. The image still renders
correctly and the mean/p99 pixel-diff checks pass — only the structural
metrics dip below a strict bar.
Per owner decision, re-baseline to the new stack: relax SSIM 0.97->0.94
and PSNR 30.0->25.0 (below the deterministic 0.9490 / 26.21, with margin).
The HunyuanImage CI job uploads no image artifact, so the reference PNG
cannot be auto-regenerated here; relaxing thresholds is the equivalent
re-baseline. main keeps the stricter bar.
Co-Authored-By: Claude <noreply@anthropic.com >
2026-07-11 14:21:17 +08:00
NumberWan and Cursor
bbc0476237
[CI] Lower Qwen-Image e2e SSIM threshold from 0.97 to 0.94 ( #4613 )
...
Signed-off-by: NumberWan <wantszkin2003@gmail.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-07-02 02:22:10 +00:00
3901ad8165
[feat] Streaming diffusion video generation output ( #3737 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-23 09:57:53 +00:00
Yuanheng Zhao
9177b37e2f
[NFC] Update misleading seed-tts-eval optional dependency guidance ( #4619 )
...
Signed-off-by: Yuanheng <jonathan.zhaoyh@gmail.com >
2026-06-22 16:35:42 -07:00
dengyunyang
a86c333c7e
[Perf][HunyuanImage] remove sync logic ( #4401 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-06-16 05:28:51 +08:00
Hongsheng Liu
aff0af9754
[Refactor] Extract diffusion output formatting boundary ( #4407 )
...
Signed-off-by: hsliuustc0106 <liuhongsheng4@huawei.com >
2026-06-15 22:50:50 +08:00
Zeng Chuang
ca75623ff3
[BugFix] Fix HunyuanImage3 CoT truncation when stop token stripped by detokenizer ( #4260 )
...
Signed-off-by: zengchuang <zengchuang3@huawei.com >
2026-06-09 15:30:25 +00:00
SYLAR
29b18ea298
[Quant] ModelOpt FP8 for Wan2.2 & HunyuanVideo-1.5 video-gen ( #3305 )
...
Signed-off-by: WeiQing Chen <david6666666@users.noreply.github.com >
2026-06-08 02:53:06 +08:00
Zeyu Huang | 黃澤宇 and Gao Han
2414b6f94d
[CI][bugfix]: Improve Qwen Image accuracy test with diffusers' RMSNorm ( #4143 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
2026-06-05 07:07:26 -07:00
amy-why-3459
1e43656ab1
[Bugfix] Update the value of --max-seed-tts-mean-wer in the accuracy test. ( #4160 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-06-05 11:39:07 +08:00
amy-why-3459
519cf3ecf1
[Refactor] [Qwen3-Omni]Modify the thinker's sampling parameters to align with transformers. ( #4137 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-06-04 22:49:04 +08:00
dengyunyang
a57b8f858b
[HunyuanImage3][CI] fix ci ( #4134 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-06-04 16:15:49 +08:00
d2e65a92f1
[CI][Accuracy] Add HunyuanImage3 pixel accuracy test and nightly CI ( #3790 )
...
Signed-off-by: zzh <943967662@qq.com >
Co-authored-by: Alicia <115451386+congw729@users.noreply.github.com >
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-06-03 16:59:21 +08:00
bc794e625f
Add Cosmos3 model support ( #3454 )
...
Signed-off-by: Maciej Bala <mbala@nvidia.com >
Signed-off-by: MaciejBalaNV <mbala@nvidia.com >
Signed-off-by: lishunyang12 <lishunyang12@163.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
Co-authored-by: lishunyang12 <lishunyang12@163.com >
2026-06-02 04:04:31 +08:00
Zeyu Huang | 黃澤宇
74258b18b7
[CI] Rectify L2~L4 Qwen Image Edit series tests ( #3901 )
2026-05-28 18:33:31 +08:00
WeiQing Chen
6031c7d393
[CI] Add HunyuanVideo 1.5 X2V accuracy tests ( #3852 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-05-28 11:09:45 +08:00
bjf-frz and Hongsheng Liu
c33ef34654
[Bugfix]Fix Hunyuan Image3 denoise flow alignment ( #3857 )
...
Signed-off-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-27 19:18:01 +08:00
Jason and Zeyu Huang | 黃澤宇
753508fe02
[Bugfix] Fix Qwen-Image-Edit-2511 TeaCache zero_cond_t handling ( #3219 )
...
Signed-off-by: JasonJ2021 <jasonj@zju.edu.cn >
Signed-off-by: Jason <72191212+JasonJ2021@users.noreply.github.com >
Co-authored-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
2026-05-27 11:06:18 +08:00
bjf-frz
ec94e83a25
[CI][Bugfix]Fix Wan2.2 I2V reference image upload ( #3869 )
...
Signed-off-by: bjf-frz <frz123db@gmail.com >
2026-05-26 16:23:28 +08:00
zzh
9a37ca83d4
Add hunyuan online accuracy test ( #3795 )
...
Signed-off-by: zzh <943967662@qq.com >
2026-05-25 11:03:39 +08:00
Zeng Chuang and Claude Opus 4.7
f0af3ab200
[BugFix] Fix prefer_model_sampler token history in async scheduling ( #3681 )
...
Signed-off-by: zengchuang <zengchuang3@huawei.com >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
2026-05-22 14:29:46 +08:00
baonudesifeizhai
076c34abfb
(Phase 2)Add ModelOpt mixed FP8/NVFP4 support for image generation ( #3570 )
...
Signed-off-by: roG0d <baonudesifeizhai@gmail.com >
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com >
2026-05-22 10:39:10 +08:00
wangyu
e1c6bc7597
[Test] add run_nightly_jobs.sh for local nightly pytest parity ( #3670 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-05-20 15:26:59 +08:00
WeiQing Chen
b5e163cfca
[CI][Accuracy] Add Qwen-Image-2512 Qwen-Image-Edit-2511 pixel accuracy tests ( #3502 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-05-16 20:08:51 +08:00
dengyunyang and Hongsheng Liu
d647e7e4cf
[Hunyuanimage 3.0] hunyuan accuracy test ( #3655 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-16 23:35:05 +12:00
Zeyu Huang | 黃澤宇 and Copilot Autofix powered by AI
d18168ccbb
[bugfix] Fix diffusers backend input bug after #2913 ( #3644 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-05-15 09:55:09 +00:00
3f63aaf982
[Feature] HunyuanImage-3.0 IT2I: multi-image input + prompt API cleanup ( #3444 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Signed-off-by: TaffyOfficial <wu15922848573@outlook.com >
Signed-off-by: skf1999 <13234016272@163.com >
Signed-off-by: zuiho <2324465096@qq.com >
Signed-off-by: Claude Code <noreply@anthropic.com >
Signed-off-by: zuiho <wu15922848573@outlook.com >
Signed-off-by: TaffyOfficial <2587297563@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <wu15922848573@outlook.com >
Co-authored-by: skf1999 <13234016272@163.com >
2026-05-14 16:58:40 +08:00
rein yang
f4b28f2398
[CI] update daily omni min accuracy ( #3536 )
...
Signed-off-by: rein yang <ruiruyang2@gmail.com >
2026-05-12 22:10:10 +08:00
dengyunyang and Hongsheng Liu
0d91fbbbb7
[Bugfix] Align the AR and DiT prompt formatting across both online and offline modes. ( #3516 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-12 12:13:30 +08:00
wangyu
2cdffcea6b
[CI] skip failing diffusion and accuracy cases ( #3432 , #3256 , #3257 , #3488 ) ( #3507 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-05-11 21:56:08 +08:00
wangyu and Hongsheng Liu
26d481fc84
[CI] Remove VLLM_TEST_CLEAN_GPU_MEMORY to avoid environment variable pollution that causes unnecessary GPU detection, thereby slowing down test case execution. ( #3446 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: [Your Name] <your.email@example.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-10 07:00:29 +08:00
dengyunyang
5b61e7f1f1
[Feature][Hunyuan image 3.0] AR + DIT with kv reuse. ( #3346 )
...
Signed-off-by: dengyunyang <584797741@qq.com >
2026-05-08 20:51:46 +08:00
wangyu and Huang, Zeyu
6f2ad7b403
[Test] Unify L2/L3 test layout, Buildkite steps, and test helpers ( #2556 )
...
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
2026-05-08 14:12:23 +08:00
Nick Cao
e6466cf0e6
[Refactor] Replace and ban a few torch.cuda functions in favor of torch.accelerator replacements. ( #3365 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
2026-05-07 23:23:59 +08:00
Gao Han
54277a8dd0
[chore] Update command to download dataset from huggingface-cli to hf ( #3403 )
...
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk >
2026-05-07 16:16:36 +08:00
Zeyu Huang | 黃澤宇 and Copilot Autofix powered by AI
f19891e4f1
[bugfix][CI] Diffusers backend update ( #3096 )
...
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-05-05 20:54:39 +08:00
amy-why-3459
e375b12680
[Refactor] Remove the default value "mp" from distributed_executor_backend. ( #3007 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-04-25 11:48:03 +08:00
Ricardo Noriega
05c6c9a0b6
feat: add LTX-2.3 video generation model support ( #2893 )
...
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com >
2026-04-23 16:51:51 +08:00
amy-why-3459
3aa84c4742
[Tests]Add accuracy benchmark L4 test cases ( #2843 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-04-23 09:40:43 +08:00
wangyu
e18cb89d5a
[CI] Update test markers and configurations to use 'full_model' for L4 nightly tests ( #2641 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-22 15:14:20 +08:00
WeiQing Chen
c2859e9cd7
[Revert] drop Wan2.2 prompt-length enforcement from #2847 ( #2877 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-04-20 19:19:38 +08:00
wangyu
8a9add1c81
[CI] Restructure vLLM-Omni Test Layout, Fixture Scope, and Support Modules ( #2620 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-20 14:23:42 +08:00
wangyu
b4add5bd87
[CI] Skip test_bagel[parallel_tp_2] and test_wan22_i2v_online_serving_generates_video[wan22_i2v_usp2_hsdp2] ( #2883 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-17 23:10:51 +08:00
WeiQing Chen
24e61f4d7b
[CI] add qwen image and layered accuracy test ( #2772 )
...
Signed-off-by: david6666666 <530634352@qq.com >
2026-04-16 14:52:53 +08:00
Zeyu Huang | 黃澤宇
0d020739a7
[CI] qwen image edit L4 accuracy test ( #2761 )
2026-04-15 11:13:11 +08:00
wangyu
5ce0a43492
[CI][Bugfix] Update thresholds for accuracy tests ( #2725 )
...
Signed-off-by: wangyu <410167048@qq.com >
2026-04-14 20:48:04 +08:00
c20cac86ce
[Bugfix] Restore user config/runtime stage init timeout ( #2519 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-04-12 00:48:47 +08:00
WeiQing Chen
e68ca4aa5c
[CI]test: add wan22 i2v video similarity e2e ( #2262 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-03-31 16:15:47 +08:00
WeiQing Chen
3a5483d339
[CI] fix Wan22 timeout and i2i accuracy threshold ( #2235 )
...
Signed-off-by: David Chen <530634352@qq.com >
2026-03-26 22:03:03 +08:00
WeiQing Chen
c392ce21e9
[Accuracy Benchmark] feat: add accuracy benchmark integrations for t2i and i2i ( #1917 )
...
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
2026-03-26 17:27:29 +08:00