[Perf][MiniCPM-o] Code2Wav resident Euler slot pool, fused DiT body, and exact HiFT graphs (#8443)
Signed-off-by: BeatSeat <wendavid552@gmail.com> Co-authored-by: amy-why-3459 <wuhaiyan17@huawei.com>
This commit is contained in:
1 parent
3aab12851f
commit
79562e97ad
20 files changed
+2954
-246
No files matched your search
@@ -12,8 +12,11 @@ require new end-to-end performance measurements after the mainline integration.
|
||||
Previously reported numbers do not describe this revised codec backend.
|
||||
|
||||
The generic MRv2 profile and the opt-in native V1 duplex H200 profile enable
|
||||
TF32 matmuls within Code2Wav forward/capture only; the previous process policy
|
||||
is restored afterwards. cuDNN's TF32 policy is independent. TF32 changes rounding.
|
||||
ordinary TF32 for CFM DiT GEMMs within Code2Wav forward/capture only
|
||||
(`torch.backends.cuda.matmul.allow_tf32` on dense QKV/MLP, Triton
|
||||
`input_precision="tf32"` on tiled attention). This is not compensated TF32x3.
|
||||
The previous process matmul policy is restored afterwards. cuDNN's TF32 policy
|
||||
is independent. HiFT stays IEEE FP32. TF32 changes rounding.
|
||||
Duplex keeps the mainline V1 session path. Turn results do not establish duplex
|
||||
performance or interruption correctness.
|
||||
|
||||
|
||||
Reference in new issue
Block a user