[Benchmark] Add MammothModa2 startup/loading breakdown (#7312)

Signed-off-by: redearly123 <65453204+redearly123@users.noreply.github.com>
Co-authored-by: redearly123 <65453204+redearly123@users.noreply.github.com>
This commit is contained in:
Hongchen Liandredearly123 authored and GitHub committed 2026-09-30 11:38:07 +08:00
1 parent 3a82c85880
commit 989161c49d
11 files changed
+1065

No files matched your search

+9
View File
@@ -289,6 +289,15 @@ The first request took 85.224 seconds. The AR stage generated 4,161 visual token
The output was a valid 1024 by 1024 RGB PNG.
### Startup benchmark
The [startup benchmark](../../benchmarks/mammoth_moda2/README.md) provides
commands, measurement boundaries and a single-A800 eager baseline. On that
16-CPU-quota machine, parallel stage initialization and 16 CPU threads reduced
`Omni()` initialization from about 60 s to 37 s. See the benchmark for the
configuration and limitations; CUDA-graph mode needs separate memory and
quality validation.
## MammothModa2-Dev unified inference
MammothModa2-Dev uses a Qwen3-VL AR backbone, while MammothModa2-Preview uses