[Bugfix] fix compatibility of _hunyuan_image3_unpack_packed_topk between vllm / vllm ascend (#3640)
Signed-off-by: KexiongYu <yukexiong1@huawei.com>
This commit is contained in:
1 parent
e7ee5de09f
commit
779bf3118b
1 file changed
+1
-1
@@ -1167,7 +1167,7 @@ def _hunyuan_image3_unpack_packed_topk(
|
||||
gating_output: torch.Tensor,
|
||||
topk: int,
|
||||
renormalize: bool,
|
||||
num_experts: int,
|
||||
num_experts: int | None = None,
|
||||
) -> tuple[torch.Tensor, torch.Tensor]:
|
||||
"""Unpack pre-computed ``(topk_weights, topk_indices)`` packed by
|
||||
:class:`HunyuanImage3SparseMoeBlock` into ``gating_output``.
|
||||
|
||||
Reference in new issue
Block a user