TaffyOfficialandTaffyOfficial ee33601571 [Perf] Deduplicate AR prefix cache hidden-state CPU staging (#3734) ...

Signed-off-by: TaffyOfficial <2324465096@qq.com>
Co-authored-by: TaffyOfficial <2324465096@qq.com>

2026-06-01 09:35:07 +00:00

..

test_gpu_ar_model_runner.py

[Perf] Deduplicate AR prefix cache hidden-state CPU staging (#3734)

2026-06-01 09:35:07 +00:00

test_gpu_generation_model_runner.py

[Perf] Deduplicate AR prefix cache hidden-state CPU staging (#3734)

2026-06-01 09:35:07 +00:00

test_omni_connector_mixin.py

[Refactor] msgspec standardisation for data entry key names and improved type checks (#3149)

2026-05-12 14:30:13 +08:00

test_omni_gpu_model_runner.py

[Refactor] Unify _talker_mtp_forward across GPU and NPU model runners (#3476)

2026-05-31 07:58:00 +08:00

test_process_gpu_memory.py

[Refactor] Replace and ban a few torch.cuda functions in favor of torch.accelerator replacements. (#3365)

2026-05-07 23:23:59 +08:00