[Model] Add Ming-omni-tts MoE 16.8B-A3B + CFM CUDAGraph (#4341)

Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
Co-authored-by: Yuanheng Zhao <54058983+yuanheng-zhao@users.noreply.github.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
This commit is contained in:
authored and GitHub committed 2026-06-25 22:11:35 +08:00
1 parent 5db89b41c4
commit 0b04f2a0d6
17 files changed
+637 -57

No files matched your search

@@ -137,8 +137,12 @@ def test_ming_compute_logits_falls_back_to_dummy_token_id():
def test_ming_forward_non_decode_return_clears_cached_forced_next_token_ids():
class FakeBackbone:
def __call__(self, **kwargs):
return kwargs["inputs_embeds"]
# MingLLMModel.forward calls the backbone positionally
# (input_ids, positions, intermediate_tensors, inputs_embeds) so the
# same signature works for both Qwen2Model (``positions``) and
# BailingMoeModel (``position_ids``).
def __call__(self, input_ids, positions, intermediate_tensors, inputs_embeds, **kwargs):
return inputs_embeds
model = _make_ming_logits_model()
model.model = FakeBackbone()