lishunyang12
c15f51a2f6
Merge branch 'main' into lance-model-support; drop lance.yaml
...
Resolves conflicts in:
- vllm_omni/diffusion/registry.py: keep both LancePipeline (HEAD)
and MingImagePipeline (main) entries.
- vllm_omni/diffusion/models/bagel/bagel_transformer.py: take main's
simpler cfg_batched payload; HEAD referenced undefined locals.
Also strips vllm_omni/deploy/lance.yaml -- Lance is single-stage
diffusion, so its engine knobs (pipeline=lance, enforce_eager,
trust_remote_code, max_num_seqs=1, ...) flow directly to Omni(...)
/ vllm-omni serve instead of through a deploy YAML.
create_default_diffusion builds the stage config from those kwargs.
Touched: examples/offline_inference/lance/{end2end,gradio_demo}.py,
tests/e2e/online_serving/test_lance.py, tests/helpers/stage_config.py.
Signed-off-by: lishunyang12 <lishunyang12@163.com >
2026-05-31 11:50:21 +00:00
lishunyang12
7c934b6188
[Lance] Add Gradio demo and align inference with upstream
...
- Add ``examples/offline_inference/lance/gradio_demo.py`` — a unified 7-task UI
(t2i / t2v / i2v / image_edit / video_edit / x2t_image / x2t_video) that
loads ``Lance_3B`` and ``Lance_3B_Video`` on two GPUs so image and video
tasks run concurrently. Surfaces official Lance examples per task; aspect
ratio is auto-snapped to one of upstream's 6 buckets from the input
image/video.
- Fix x2t_image / x2t_video output format: route x2t_image through a new
``_forward_x2t_image`` handler (was falling through to the img2img path
and emitting garbage), build the chat prefill in three segments
(prefix → ViT → suffix) so the ``<|im_end|>`` markers line up with
upstream's template, and start generation from a newline token instead of
``<|im_start|>`` so the assistant turn doesn't close itself with an
immediate EOS. Add a ``system_prompt`` override to ``render_lance_prompt``
so per-example QA instructions surface ("Look at the image carefully and
answer the question.") instead of the caption-style default.
- ``_forward_image_edit``: also stash the PIL image into ``custom_output``
so callers reading ``outputs[0].output`` *or* ``custom_output["image"]``
both work — the orchestrator IPC strips the bare ``output`` field across
process boundaries.
- ``pipeline_registry.py``, ``model_executor/models/lance/*``, registry
cleanup: remove the dead Lance-specific autoregressive shim
(``lance.py``) and its stage-input processor; the diffusion pipeline owns
the full flow now.
- Aspect-ratio buckets aligned with upstream's ``BucketResize`` (6 ratios:
21:9 / 16:9 / 4:3 / 1:1 / 3:4 / 9:16, sized for ``resolution_vae`` ∈
{480, 640, 768}). 3:2 / 2:3 dropped — upstream snaps those to 4:3 / 3:4.
- Gradio defaults match upstream's official scripts (cfg_text_scale=4.0,
validation_num_timesteps=30, validation_timestep_shift=3.5, seed=42); only
the demo *duration* is intentionally shorter than upstream's 121-frame
default to keep the UI snappy (user can extend to 10s via slider for
byte-identical reproduction).
Signed-off-by: lishunyang12 <lishunyang12@163.com >
Signed-off-by: WeiQing Chen <david6666666@users.noreply.github.com >
2026-05-31 11:40:40 +00:00
ChenWenjing
5dfdf584dd
[Feat]audio streaming input for async chunk ( #3614 )
...
Signed-off-by: CHEN <116010019@link.cuhk.edu.cn >
2026-05-31 17:39:25 +08:00
Yuanheng Zhao and Zheng Wengang
ea6d811b58
[Config Refactor] Migrate Ming-flash-omni-2.0 Image-Gen deploy configs ( #3975 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Co-authored-by: Zheng Wengang <zwg0606@gmail.com >
2026-05-30 08:13:21 +00:00
Viacheslav Klimkov and Yueqian Lin
914e92cf80
[Refactor][Qwen3-TTS] Extract reusable prompt-embeds builder and make tts_pad_embed a persistent buffer ( #3992 )
...
Signed-off-by: Viacheslav Klimkov <vklimkov@nvidia.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-30 16:11:00 +08:00
nperraud
9fdb3bcb89
[Bugfix][Model] Qwen3-TTS: don't collapse 2D ref_code list when estimating prompt length ( #3940 )
...
Signed-off-by: nperraud <nathanael.perraudin@gmail.com >
2026-05-29 09:18:25 -06:00
amy-why-3459 and Hongsheng Liu
2696751003
[Perf] Qwen3-Omni performance optimization ( #3878 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-29 22:15:23 +08:00
boatman and sphinxkkkbc
4d9262a6eb
[Feat]Support voice clone for omnivoice in online serving & add seed parameter for reproducible ( #3668 )
...
Signed-off-by: sphinxkkkbc <binchengkang8@gmail.com >
Co-authored-by: sphinxkkkbc <binchengkang8@gmail.com >
2026-05-29 07:42:08 +00:00
amy-why-3459
5dd1d0a772
[BugFix] Fix prefix-caching issue ( #3726 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-05-29 01:51:54 +00:00
Dakai An
bb9f21d0db
Fix Qwen3-omni accuracy degradation from deepstack inputs under torch.compile ( #3885 )
...
Signed-off-by: Dakai An <dakaian108@gmail.com >
2026-05-28 23:57:56 +08:00
Nick Cao and Claude
c20afebce4
[Refactor][Qwen3-TTS] Construct speech tokenizer encoder natively ( #3360 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-05-28 16:20:49 +08:00
NATURE
3a347b10b0
[3/5][core]refactor communication layer: PR 3 of 5, all other models in non async mode ( #3719 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
2026-05-28 14:06:41 +08:00
0f3264a9c0
[Perf][Bugfix] cache hot buffers in qwen3_tts talker; fall back on evicted state ( #3688 )
...
Signed-off-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: JuanPZuluaga <juanz9312@gmal.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-28 05:45:54 +00:00
BeatSeat
dab596e468
[Refactor] Unify Snake/SnakeBeta and alias-free activation into common modules ( #3886 )
...
Signed-off-by: BeatSeat <wendavid552@gmail.com >
2026-05-27 23:41:35 -05:00
Sy03 and Yueqian Lin
d37912b071
[TTS][Perf] Optimize Fish Speech S2 Pro high-concurrency serving ( #3773 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-27 13:25:49 -05:00
a698269e47
[Model] Add Ming-flash-omni-2.0 Image Generation (Diffusion) Stage ( #2875 )
...
Signed-off-by: ZhengWG <zwg0606@gmail.com >
Signed-off-by: Zheng Wengang <zwg0606@gmail.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com >
2026-05-27 23:21:20 +08:00
Dan
1f1c82ecdd
[BugFix] Fix Qwen3-TTS Code2Wav compatibility with transformers >= 5.9.0 ( #3880 )
...
Signed-off-by: Dan250124 <416947747@qq.com >
2026-05-26 16:24:43 +00:00
8f45e68bcd
[Higgs-Audio] bosonai/higgs-audio-v2-generation-3B-base TTS model support ( #3762 )
...
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com >
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-25 23:16:07 +08:00
Yueqian Lin and Rein Yang
e996723bc9
[Bugfix] Fix Qwen3-TTS Stage 0 prefix-caching correctness ( #3665 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: Rein Yang <ruiruyang2@gmail.com >
Co-authored-by: Rein Yang <ruiruyang2@gmail.com >
the ci failure case is irrelavent to this PR and occurs rarely
2026-05-25 23:09:38 +08:00
BeatSeat and Yueqian Lin
28ce618f0e
[Model] Add GLM-TTS text-to-speech model support ( #3141 )
...
Signed-off-by: BeatSeat <wendavid552@gmail.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-24 05:42:26 +08:00
amy-why-3459 and Hongsheng Liu
748470c1fb
[BugFix] code2wav supports disabling CUDA graph. ( #3732 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-24 00:05:55 +08:00
e7644daa7f
[Perf] [OmniVoice] Triton kernel fusion + CUDA Graph acceleration ( #3336 )
...
Signed-off-by: univa-HARRY <harry@univa.co.kr >
Signed-off-by: Harry <harry@univa.co.kr >
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-22 13:12:47 +00:00
Jialong Liu and Hongsheng Liu
5799d85a51
[Bugfix] Revert MiMo-Audio local_sampler to greedy to fix text truncation under concurrent batching (followup to #3686 ) ( #3817 )
...
Signed-off-by: Jialong Liu <88185941+Galleons2029@users.noreply.github.com >
Signed-off-by: Galleons2029 <Galleons777@gmail.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-22 19:25:37 +08:00
baonudesifeizhai
076c34abfb
（Phase 2）Add ModelOpt mixed FP8/NVFP4 support for image generation ( #3570 )
...
Signed-off-by: roG0d <baonudesifeizhai@gmail.com >
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com >
2026-05-22 10:39:10 +08:00
SYLAR
f0cec3ecd4
Merge branch 'main' into lance-model-support
2026-05-22 04:13:58 +08:00
Jialong Liu and Yueqian Lin
e949ccf087
[Bugfix] Fix MiMo-Audio voice instability: stochastic local_sampler + codec streaming context ( #3686 )
...
Signed-off-by: Galleons2029 <Galleons777@gmail.com >
Signed-off-by: Jialong Liu <88185941+Galleons2029@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
2026-05-21 10:18:00 -04:00
Siyuan Kong
7d9d8aee79
[Bugfix] Fix qwen2_5_omni weight loading ( #3598 )
...
Signed-off-by: ksiyuan <ksiyuan@umich.edu >
2026-05-21 16:43:33 +08:00
Canlin Guo
2aafe0bf94
[Perf] Optimize sampler D2H sync for HY-Image ( #3617 )
...
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
2026-05-20 15:40:34 +08:00
Yueqian Lin
fc8486cf20
[Doc][TTS] CosyVoice3 online docs + residual TTS yaml cleanup + remove VoxCPM v1 ( #3748 )
...
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
2026-05-20 15:24:06 +08:00
Nick Cao
06ab723afc
[Perf][VoxCPM2][Ming-Flash-Omni] Use global CUDA graph pool ( #3361 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
2026-05-20 05:01:42 +00:00
lishunyang
69bcc6416d
[New Model] Lance (ByteDance) — unified AR+diffusion multimodal ( #3697 )
...
Adds Lance (bytedance-research/Lance), a 3B unified AR+diffusion
multimodal model on a Qwen2.5-VL backbone. Lance is BAGEL-lineage:
it reuses vLLM-Omni's BAGEL Mixture-of-Transformers core verbatim and
specializes only the ViT (Qwen2.5-VL vision), the VAE (Wan2.2) and the
checkpoint layout.
All six single-stage Lance modalities verified end-to-end on 1x B300:
t2i, t2v, image_edit, video_edit, x2t_image (image understanding) and
x2t_video (video understanding). 3-D mRoPE is wired through
BagelRotaryEmbedding for the x2t / video / edit paths. Includes the
upstream gap-analysis quality fixes (task-specific system prompts, full
Qwen chat template, upstream inference defaults and aspect-ratio
buckets).
Ships an offline example (examples/offline_inference/lance/), an
OpenAI-compatible online-serving example
(examples/online_serving/lance/) and an e2e test
(tests/e2e/online_serving/test_lance.py).
See LANCE_PR.md for the architecture rationale, per-modality status and
the two remaining follow-ups (two-stage AR+DiT, video_edit polish).
Closes #3697 .
Signed-off-by: lishunyang <lishunyang03@gmail.com >
2026-05-18 22:09:14 +00:00
Sy03 and amy-why-3459
ab59673f21
[Bugfix][Qwen3-Omni] Handle short Code2Wav chunk outputs ( #3687 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-05-18 18:59:23 +00:00
c99df1ebd9
[TTS][Perf] Optimize Qwen3-TTS high-concurrency serving ( #3662 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: SYLAR <125541396+lishunyang12@users.noreply.github.com >
2026-05-17 16:58:59 -04:00
4e88053750
[BugFix][HunyuanImage3] Set MRoPE dynamic_arg_dims so graph mode can compile ( #3630 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: Codex <codex@openai.com >
2026-05-17 22:42:59 +08:00
Yuanheng Zhao
a64ebf103b
[Refactor] Migrate and clean up TTS configs: CosyVoice3, OmniVoice, VoxCPM ( #3338 )
...
Signed-off-by: yuanheng <jonathan.zhaoyh@gmail.com >
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com >
2026-05-17 07:32:34 +08:00
+20
eb4e60ee64
[Rebase] Rebase to vllm v0.21.0 ( #3530 )
...
Signed-off-by: tzhouam <tzhouam@connect.ust.hk >
Signed-off-by: Zhou Taichang <tzhouam@connect.ust.hk >
Signed-off-by: NumberWan <wantszkin2003@gmail.com >
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
Signed-off-by: Dnoob <dxpouo@gmail.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Signed-off-by: rein yang <ruiruyang2@gmail.com >
Signed-off-by: Nick Cao <ncao@redhat.com >
Signed-off-by: zhumingjue <zhumingjue@huawei.com >
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com >
Signed-off-by: lyj-jjj <liuyingjun5@huawei.com >
Signed-off-by: gcanlin <canlinguosdu@gmail.com >
Signed-off-by: wangyu <410167048@qq.com >
Signed-off-by: weizhoublue <weizhoublue@github.com >
Signed-off-by: weizhou.lan@daocloud.io <weizhou.lan@daocloud.io >
Signed-off-by: dengyunyang <584797741@qq.com >
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com >
Signed-off-by: David Chen <530634352@qq.com >
Signed-off-by: Jie Liu <33612777+keeper-jie@users.noreply.github.com >
Signed-off-by: Yueqian Lin <linyueqian@outlook.com >
Signed-off-by: princepride <wangzhipeng628@gmail.com >
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Signed-off-by: bjf-frz <frz123db@gmail.com >
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
Signed-off-by: KexiongYu <yukexiong1@huawei.com >
Signed-off-by: Huang, Zeyu <11222265+fhfuih@users.noreply.github.com >
Signed-off-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com >
Co-authored-by: NumberWan <wantszkin2003@gmail.com >
Co-authored-by: dsinghvi <divyanshsinghvi@gmail.com >
Co-authored-by: Dnoob <dxpouo@gmail.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com >
Co-authored-by: Samit <285365963@qq.com >
Co-authored-by: rein yang <73573651+R2-Y@users.noreply.github.com >
Co-authored-by: Nick Cao <ncao@redhat.com >
Co-authored-by: zhumingjue138 <zhumingjue@huawei.com >
Co-authored-by: Ricardo Noriega <rnoriega@redhat.com >
Co-authored-by: lyj-jjj <liuyingjun5@huawei.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: gcanlin <canlinguosdu@gmail.com >
Co-authored-by: wangyu <53896905+yenuo26@users.noreply.github.com >
Co-authored-by: weizhoublue <45163302+weizhoublue@users.noreply.github.com >
Co-authored-by: weizhoublue <weizhoublue@github.com >
Co-authored-by: dengyunyang <584797741@qq.com >
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com >
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com >
Co-authored-by: Jie Liu <33612777+keeper-jie@users.noreply.github.com >
Co-authored-by: Yueqian Lin <linyueqian@outlook.com >
Co-authored-by: NATURE <wzliu@connect.hku.hk >
Co-authored-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com >
Co-authored-by: Y. Fisher <yukexiong1@huawei.com >
Co-authored-by: Zeyu Huang | 黃澤宇 <11222265+fhfuih@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-05-16 18:18:43 +08:00
Y. Fisher
779bf3118b
[Bugfix] fix compatibility of _hunyuan_image3_unpack_packed_topk between vllm / vllm ascend ( #3640 )
...
Signed-off-by: KexiongYu <yukexiong1@huawei.com >
2026-05-15 17:35:22 +08:00
amy-why-3459
e7ee5de09f
[BugFix] Fix the issue of thinker requests being preempted, causing shape mismatch. ( #3147 )
...
Signed-off-by: amy-why-3459 <wuhaiyan17@huawei.com >
2026-05-15 17:07:42 +08:00
NATURE and Hongsheng Liu
82a0b3a467
[2/5] [core]refactor communication layer: PR 2 of 5 Qwen3 Omni non async ( #2677 )
...
Signed-off-by: natureofnature <wzliu@connect.hku.hk >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-15 14:14:08 +08:00
bjf-frz and Canlin Guo
f7161b07d0
[Bugfix]Allow HunyuanImage3 AR sampler batching ( #3590 )
...
Signed-off-by: bjf-frz <frz123db@gmail.com >
Co-authored-by: Canlin Guo <canlinguosdu@gmail.com >
2026-05-14 09:27:59 +00:00
3f63aaf982
[Feature] HunyuanImage-3.0 IT2I: multi-image input + prompt API cleanup ( #3444 )
...
Signed-off-by: TaffyOfficial <2324465096@qq.com >
Signed-off-by: TaffyOfficial <wu15922848573@outlook.com >
Signed-off-by: skf1999 <13234016272@163.com >
Signed-off-by: zuiho <2324465096@qq.com >
Signed-off-by: Claude Code <noreply@anthropic.com >
Signed-off-by: zuiho <wu15922848573@outlook.com >
Signed-off-by: TaffyOfficial <2587297563@qq.com >
Co-authored-by: TaffyOfficial <2324465096@qq.com >
Co-authored-by: TaffyOfficial <wu15922848573@outlook.com >
Co-authored-by: skf1999 <13234016272@163.com >
2026-05-14 16:58:40 +08:00
Y. Fisher
51b4b1131e
[Bugfix]: Fix online serving failure when using deploy config ( #3537 )
...
Signed-off-by: KexiongYu <yukexiong1@huawei.com >
Signed-off-by: Y. Fisher <yukexiong1@huawei.com >
2026-05-14 11:17:15 +08:00
Nick Cao and Claude
dca369d448
[Perf] Remove dead audio_tower and visual from Qwen2.5-Omni talker stage ( #3425 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-05-12 23:24:13 +08:00
d7ea5d5979
[New Model] Add support for tencent/Covo-Audio-Chat ( #2293 )
...
Signed-off-by: Dnoob <dxpouo@gmail.com >
Signed-off-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Yueqian Lin <70319226+linyueqian@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-12 14:39:58 +08:00
dsinghvi
e40076e872
[Refactor] msgspec standardisation for data entry key names and improved type checks ( #3149 )
...
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com >
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com >
2026-05-12 14:30:13 +08:00
Nick Cao and Claude
bd4ede391b
[Perf] Remove dead audio_tower and visual from Qwen3-Omni talker stage ( #3296 )
...
Signed-off-by: Nick Cao <ncao@redhat.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-05-11 16:04:56 +00:00
Y. Fisher
a33e2eb588
[Config] Add HunyuanImage3 deploy configs ( #3172 )
...
Signed-off-by: KexiongYu <yukexiong1@huawei.com >
Signed-off-by: Y. Fisher <yukexiong1@huawei.com >
2026-05-11 22:49:19 +08:00
e1088026fa
[Performance] Improve MiMo-Audio tokenizer decoding performance ( #2183 )
...
Signed-off-by: 齐保元 <qibaoyuan@xiaomi.com >
Co-authored-by: Jialong Liu <88185941+Galleons2029@users.noreply.github.com >
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com >
2026-05-11 10:05:46 +08:00
Sy03
2c73cf3522
[Perf] Fix Qwen3-TTS latency regression ( #3485 )
...
Signed-off-by: Sy03 <1370724210@qq.com >
2026-05-10 23:07:38 +00:00
baonudesifeizhai and roG0d
c4a0990044
（Phase 1）Add ModelOpt FP8 auto-detect support for diffusion checkpoints #2709 ( #2913 )
...
Signed-off-by: roG0d <rodgarcas98@gmail.com >
Signed-off-by: roG0d <baonudesifeizhai@gmail.com >
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com >
Co-authored-by: roG0d <rodgarcas98@gmail.com >
2026-05-09 16:55:05 +08:00
lishunyang12