Commit Graph
3166 Commits
Author SHA1 Message Date
102ba716bf [Feat] Add native Mooncake KV transfer from AR to DiT (#7166)
Signed-off-by: asukaqaq-s <1311722138@qq.com>
Signed-off-by: Acerak01-fy <wfy2003324@163.com>
Co-authored-by: Acerak01-fy <wfy2003324@163.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
2026-09-20 14:44:55 +00:00
psv666 2d0b03f717 [Bugfix] Fix Qwen3-Omni realtime playback interruption and conversation history (#7791)
Signed-off-by: psv666 <2693925048@qq.com>
2026-09-20 14:42:17 +00:00
RyanYun09 d3396fc5fb # [Bugfix] Replace ffmpeg subprocess with PyAV to avoid HEVC decoder hang (#7364) (#7504)
Signed-off-by: RyanYun09 <318555231+RyanYun09@users.noreply.github.com>
2026-09-20 14:37:09 +00:00
Canlin Guo 4d877780d3 [Bugfix] Avoid waveform-list GC scans and release completed MOSS batches (#7885)
Signed-off-by: Canlin Guo <canlinguosdu@gmail.com>
2026-09-20 05:36:52 -07:00
23f4126445 [Hardware][Ascend] Use incremental KV-cache decode for MOSS-TTS depth transformer (#6967)
Signed-off-by: jingchengtian <tjc1995@126.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
2026-09-20 18:34:25 +08:00
AliciaandHongsheng Liu d02681bf01 [Refactor][Diffusion] Move single-model layers into their model directories (#5908)
Signed-off-by: congw729 <115451386+congw729@users.noreply.github.com>
Signed-off-by: Alicia <115451386+congw729@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-20 18:19:24 +08:00
amy-why-3459 9f5521351e [Benchmark][MiniCPM-o] Port Video-MME dataset support to Omni bench s… (#6987)
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com>
2026-09-20 17:15:53 +08:00
tlysanhuo ea62f86718 [Bugfix] Honor request-level seed in VoxCPM2 CFM noise (#7866)
Signed-off-by: tly <2200895168@qq.com>
2026-09-20 16:24:38 +08:00
wangyuandYueqian Lin 6a03e45c34 [Misc] Remove Dynin-Omni and dots.tts support (#7655)
Signed-off-by: wangyu <410167048@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
2026-09-20 00:28:29 -07:00
Zeng Chuang 3f94c417be [Bugfix] Stabilize NIXL ownership test claim queries (#7870)
Signed-off-by: zengchuang-hw <zengchuang1005@gmail.com>
2026-09-20 06:55:47 +00:00
xiaoyu-xyz 5a93ec1b4e [Model][Frontend] MiniMax-H3: Add latent-mask editing (#7465)
Signed-off-by: xiaoyu <1259084489@qq.com>
2026-09-20 03:54:44 +00:00
汪志鹏 8e10c3ee07 [Bugfix] Avoid multimodal cache collisions in multistage image editing (#7817)
Signed-off-by: princepride <wangzhipeng628@gmail.com>
2026-09-20 11:27:06 +08:00
yulun b6b868f3de [Hardware][Ascend] Enable VoxCPM2 eager optimizations (#7207)
Signed-off-by: Big2Wheel <1404207590@qq.com>
2026-09-20 11:18:12 +08:00
ooooooyeandWeiQing Chen b2b6c6c7a9 [Perf][MiniMax-H3] Cut video VAE encode/decode memory peaks for low-memory serving (#7241)
Signed-off-by: brandneway <gyuan4892@gmail.com>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
2026-09-20 10:56:54 +08:00
ooooooye a9abd563f9 [Bugfix][RAINFUSION_ATTN] Fix padding-mask rejection on packed [real, pad] layouts and reuse query tail as output padding (#7235)
Signed-off-by: brandneway <gyuan4892@gmail.com>
2026-09-20 10:56:51 +08:00
andyluo7 fa422a3f44 [CI/Build][ROCm] Cache AMD test images in registry (#7712)
Signed-off-by: andyluo7 <andy.luo@amd.com>
2026-09-20 09:51:14 +08:00
chethanukandGao Han 573ec4cdac fix(e2e): re-point HunyuanImage3 offline test to text_to_image.py (#7525)
Signed-off-by: ChethanUK <chethanuk@outlook.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
2026-09-19 11:16:13 -07:00
leegangtoe fa506e0fe8 [Bugfix] Register statistics for dynamically added replicas (#7298)
Signed-off-by: leegangtoe <leegangtoe@gmail.com>
2026-09-19 17:07:14 +00:00
Inesh Reddy Chappidi 51c715c7ef [Bugfix][Test] Assert stable-audio CPU offload savings on max_memory_allocated (#6826)
Signed-off-by: Inesh Reddy <ineshreddy249@gmail.com>
Signed-off-by: Inesh Reddy Chappidi <ineshreddy249@gmail.com>
2026-09-19 10:04:58 -07:00
NumberWan 23d8c83dab [Bugfix][Qwen-Image] Keep AutoRound W4A16 on CPU when offloading; Fixes #7555 (#7579)
Signed-off-by: NumberWan <wantszkin2003@gmail.com>
2026-09-19 16:34:11 +00:00
boatman f9f53f2bd8 [Bugfix]Include Reference Audio Cache Salt for HiggsAudio v2 (#7826)
Signed-off-by: boatman <109857087+sphinxkkkbc@users.noreply.github.com>
2026-09-20 00:19:14 +08:00
akshatvishu 415005be22 [Model] Add circlestone-labs/Anima (#4083)
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
2026-09-19 16:16:38 +00:00
698f716012 [Refactor] Reject unknown diffusion config fields (#5172)
Signed-off-by: TaffyOfficial <2324465096@qq.com>
Signed-off-by: zuiho <2324465096@qq.com>
Signed-off-by: Gao Han <hgaoaf@connect.ust.hk>
Co-authored-by: TaffyOfficial <2324465096@qq.com>
Co-authored-by: Gao Han <hgaoaf@connect.ust.hk>
2026-09-19 15:37:34 +00:00
psv666andamy-why-3459 f90c267ffb [Bugfix] Use monotonic clocks for test server startup timeouts (#7628)
Signed-off-by: psv666 <2693925048@qq.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
2026-09-19 21:25:14 +08:00
470ec60848 [Core] Refactor omni prefix cache into Manager/Controller (#6654)
Signed-off-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-19 21:23:59 +08:00
ea84055507 [Refactor][Diffusion] Resolve distributed layerwise topology in the plan (#7326)
Signed-off-by: specture724 <specture724@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
2026-09-19 19:05:18 +08:00
andyluo7 232dbc82f8 [CI/Build] Restrict ERNIE fused RoPE tests to NVIDIA CUDA (#7771)
Signed-off-by: andyluo7 <andy.luo@amd.com>
2026-09-19 13:23:50 +08:00
Joshna-Medisetty 4c7a98c26f [XPU][CI] Drop the USTC PyPI mirror from the XPU image build (#7808)
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
2026-09-18 17:32:33 -05:00
7b4fc7ce2e [Model] Migrate MammothModa2 DiT to the shared diffusion runtime (#7134)
Signed-off-by: levius <2114377220@qq.com>
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
Co-authored-by: Yueqian Lin <linyueqian@outlook.com>
2026-09-18 13:29:18 -07:00
Joshna-MedisettyandCursor ca3ccfc9a3 [XPU][Bugfix] Make AR-Diffusion KV preallocation device-agnostic (#7777)
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-18 14:41:41 -05:00
bcsdhjew fbb4e63f0a [Bugfix][Core] Apply Realtime item truncation once per command (#7800)
Signed-off-by: Nolen Liang <nliang@nvidia.com>
2026-09-18 18:59:09 +00:00
Yueqian Lin 0570f7a06e [CI][Qwen3-Omni] Keep the deploy-YAML literal in the structured-config sampling check (#7803)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
2026-09-18 18:25:01 +00:00
Yueqian Lin d4ffde1a6e [CI][Qwen3-Omni] Compare structured-config sampling defaults against vLLM normalization (#7742)
Signed-off-by: Yueqian Lin <linyueqian@outlook.com>
2026-09-18 14:55:58 +00:00
wangyuandCursor 0a5ece4ae5 [CI/Build] Retarget skipped HiDream and MammothModa2 E2E tests to current issues (#7755)
Signed-off-by: wangyu <410167048@qq.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-18 13:24:00 +00:00
Yukim1 4b0c187a1e [Bugfix][Core] Fix CLI parallel flags losing to nested deploy parallel_config (#7786)
Signed-off-by: zwhzzz0821 <2831474076@qq.com>
2026-09-18 13:09:18 +00:00
akshatvishu 3084b5d107 [BugFix][TTS] Restore MOSS v1 codec streaming (#6420)
Signed-off-by: akshatvishu <akshatnayak197@gmail.com>
2026-09-18 20:06:57 +08:00
chickeytonandClaude Fable 5.1 6df62d5157 [CI/Build][MiniCPM-o] Fix the Nightly tests (#7758)
Signed-off-by: chickeyton <ngton2014@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-18 08:58:33 +00:00
holykie aa2fadac42 [Perf][Diffusion] Activate NPU/GPU matmul for LoRA delta computation when weights are on CPU (#7590)
Signed-off-by: holykie <116775684+holykie@users.noreply.github.com>
2026-09-18 16:51:23 +08:00
Zeng Chuang eb2075981d [Test][Ascend] Share HunyuanVideo-1.5 E2E across GPU and NPU (#7547)
Signed-off-by: zengchuang <zengchuang3@huawei.com>
2026-09-18 08:49:08 +00:00
ooooooye 823af92347 [Bugfix][Ascend NPU][Diffusion] Load over-wide unquantized fallback weights straight into host memory under DLOFix/mxfp online offload after quant (#7009)
Signed-off-by: brandneway <gyuan4892@gmail.com>
2026-09-18 07:36:48 +00:00
WeiQing Chen 5d3e6dc1b4 [Bugfix][MiniMax-H3] Use Hopper-safe modulation precision (#7693)
Signed-off-by: david6666666 <530634352@qq.com>
2026-09-18 15:16:45 +08:00
wtz2333 9fbc36ab2d [AR-Diffusion] Bound KV metadata for long rollouts (#7498)
Signed-off-by: wtz2333 <2955110911@qq.com>
2026-09-18 12:06:02 +08:00
1c7476ec19 [CI/Build][ROCm] Stabilize shared AMD test lanes (#7706)
Signed-off-by: andyluo7 <andy.luo@amd.com>
Signed-off-by: haic0 <haic0@users.noreply.github.com>
Co-authored-by: haic0 <haic0@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-18 11:13:07 +08:00
Zhenqiang Xuandzqxu 242c3cddeb [Hardware][Ascend] Integrate MindIE dense and sparse quantized attention for Wan2.2 T2V (#7561)
Signed-off-by: zqxu <xuzhenqiang3@huawei.com>
Co-authored-by: zqxu <xuzhenqiang3@huawei.com>
2026-09-18 01:28:27 +00:00
Anjie Hou f8197e120f [5/N] Schedule chunk transfers as their own stage (#7406)
Signed-off-by: specture724 <specture724@gmail.com>
2026-09-18 09:27:56 +08:00
Alex Brooks 6bda549ac2 [Bugfix] Fix Parallel State Initialization For MoE + Diffusion (#7676)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
2026-09-17 17:15:37 -06:00
Joshna-Medisetty 77d8de70da [XPU][HunyuanImage3] Fix HunyuanImage-3.0 text-to-image on XPU (#7674)
Signed-off-by: Joshna Medisetty <joshna.medisetty@intel.com>
2026-09-17 19:23:27 +00:00
Nick CaoandCodex b81f2c5d4b [Misc] treewide: remove shm_threshold_bytes from deploy config (#7522)
Signed-off-by: Nick Cao <ncao@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
2026-09-17 19:22:14 +00:00
dongbo910220 a6570b6814 [Diffusion] Fuse ERNIE-Image Q/K RoPE for eager execution (#7502)
Signed-off-by: dongbo910220 <1275604947@qq.com>
2026-09-17 19:06:45 +00:00
BeatSeat 9cdc57d2e7 [Bugfix][MAGI-2] Fix layerwise offload OOM by pointing offload block attrs to 'block' (#7523) (#7540)
Signed-off-by: BeatSeat <wendavid552@gmail.com>
2026-09-17 19:02:08 +00:00