admin
67eb7fdb48
Evidence-only change: probe kit (serve wrapper, API client, PSNR
comparator, offline fp8_v driver), per-host run summaries, and the
findings report. No code changes to the stack.
Verdicts: not-built on both cards. On the 3090 the served reference
ceiling is two condition images with the conditioning cache on
(2.2x the Diffusers nocache baseline, pair PSNR mean 27.57 dB);
four references OOM on the resident BF16 working set, not the KV
(~0.3 GiB/reference, per-request). On the 5080 the server cannot
initialize under any flag: init_parameters materializes the
unquantized skeleton on-device before quantization/offload engage.
Also documents that the recipe's deploy-YAML extras route for
prefix_kv_cache_dtype does not reach the served transformer on
8484d85d (offline Omni engine kwarg does).
8 lines
270 B
YAML
8 lines
270 B
YAML
# Issue 2 probe: Qwen-Image-2.1 with FP8 V-only prefix-KV storage.
|
|
# Merged over the pipeline's declared single-stage topology; every other
|
|
# field falls back to StageDeployConfig defaults.
|
|
stages:
|
|
- stage_id: 0
|
|
engine_extras:
|
|
prefix_kv_cache_dtype: "fp8_v"
|