Zhengyuan SuandClaude Opus 4.6 e1834ab19b [Enhancement] Fix SP path for MoT fused kernels, address review feedback ...

Rebase MoT fused kernels (PR #1328) onto current main and fix issues:

- Rewrite _forward_sp_gen() to use MoT unified API instead of deleted
  *_moe_gen layers (qkv_proj_moe_gen, o_proj_moe_gen, q_norm_moe_gen,
  k_norm_moe_gen), which caused AttributeError when SP was active
- Parameterize bias in MoT kernel tests (ZJY0516 review feedback)
- Add configs/ directory with README documenting the 3-tier config
  loading mechanism (ZJY0516 review feedback)

Signed-off-by: Zhengyuan Su <su.zhengyuan@u.nus.edu>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Signed-off-by: princepride <wangzhipeng628@gmail.com>

2026-05-29 02:34:52 +00:00

..

mot

[Enhancement] Fix SP path for MoT fused kernels, address review feedback

2026-05-29 02:34:52 +00:00

__init__.py

enhancement: add mot fused kernels and benchmarks 01

2026-05-29 02:34:51 +00:00