Evidence-only change: probe kit (serve wrapper, API client, PSNR
comparator, offline fp8_v driver), per-host run summaries, and the
findings report. No code changes to the stack.
Verdicts: not-built on both cards. On the 3090 the served reference
ceiling is two condition images with the conditioning cache on
(2.2x the Diffusers nocache baseline, pair PSNR mean 27.57 dB);
four references OOM on the resident BF16 working set, not the KV
(~0.3 GiB/reference, per-request). On the 5080 the server cannot
initialize under any flag: init_parameters materializes the
unquantized skeleton on-device before quantization/offload engage.
Also documents that the recipe's deploy-YAML extras route for
prefix_kv_cache_dtype does not reach the served transformer on
8484d85d (offline Omni engine kwarg does).
31 lines
418 B
JSON
31 lines
418 B
JSON
{
|
|
"cpuoff-expandable": {
|
|
"rows": [
|
|
{
|
|
"seed": 2301,
|
|
"psnr_db": 26.09,
|
|
"modes": "RGBA/RGBA"
|
|
},
|
|
{
|
|
"seed": 2302,
|
|
"psnr_db": 28.75,
|
|
"modes": "RGBA/RGBA"
|
|
},
|
|
{
|
|
"seed": 2303,
|
|
"psnr_db": 26.51,
|
|
"modes": "RGBA/RGBA"
|
|
},
|
|
{
|
|
"seed": 2304,
|
|
"psnr_db": 28.92,
|
|
"modes": "RGBA/RGBA"
|
|
}
|
|
],
|
|
"mean_db": 27.57,
|
|
"min_db": 26.09,
|
|
"max_db": 28.92,
|
|
"n": 4
|
|
}
|
|
}
|