23 lines
1.3 KiB
Markdown
23 lines
1.3 KiB
Markdown
# MiniCPM-o 4.5 MRv2 profiles
|
|
|
|
Turn mode uses the stage-level MRv2 contracts from #8184. Thinker emits live
|
|
latent metadata outside graph replay; Talker keeps codec history and EOS
|
|
control on device. Code2Wav reuses mainline Whole-Euler Flow graphs and shared
|
|
prompt state. The previous experimental block compilation, tiled attention,
|
|
channels-last and merged-CFM implementations are removed.
|
|
|
|
`minicpmo_4_5_turn_mrv2_h200.yaml` selects Talker capacity 16 and 4 GiB KV;
|
|
the generic MRv2 profile selects capacity 8 and 2 GiB KV. These configurations
|
|
require new end-to-end performance measurements after the mainline integration.
|
|
Previously reported numbers do not describe this revised codec backend.
|
|
|
|
The generic MRv2 profile and the opt-in native V1 duplex H200 profile enable
|
|
TF32 matmuls within Code2Wav forward/capture only; the previous process policy
|
|
is restored afterwards. cuDNN's TF32 policy is independent. TF32 changes rounding.
|
|
Duplex keeps the mainline V1 session path. Turn results do not establish duplex
|
|
performance or interruption correctness.
|
|
|
|
The shared asynchronous output snapshot and batched Talker preprocessing also
|
|
apply to V1 when async chunking/scheduling is enabled. Default V1 behavior must
|
|
therefore be included in end-to-end regression validation.
|