Record mixed AMD NPU vocoder waveform failure
This commit is contained in:
1 parent
a1866083a0
commit
d174d2f47b
11 files changed
+328
-12
No files matched your search
@@ -117,7 +117,7 @@ attributed all 728 rows to NPU, but p50/p95 was **3.662/3.676 s** for
|
||||
0.16 s audio (median component RTF **22.89**). These are component-only
|
||||
results and the short NPU vocoder is too slow for playable streaming.
|
||||
|
||||
A separate [HX370 AMD NPU Code2Wav study](evidence/qwen_tts_amd_npu_vocoder/README.md) tested the real-weight 25-frame and pinned two-frame FP32 ONNX exports on native Windows. Both matched retained ORT CPU waveforms within 1.05e-6 relative L2, but AMD VitisAI EP 1.8.63.0 aborted during full-graph compilation. Isolating the first decoder ConvTranspose1d reproduced the native assertion; equivalent size-one-height ConvTranspose2d compiled and executed on the NPU. Four real-weight prefixes through source node 200 also ran on NPU with 0.391-1.083% one-fixture intermediate differences versus CPU. Rewriting all six upsampling convolutions kept the complete two-frame CPU waveform bitwise identical; no full NPU waveform or TTS stream is yet qualified. The cell remains NOT E2E.
|
||||
A separate [HX370 AMD NPU Code2Wav study](evidence/qwen_tts_amd_npu_vocoder/README.md) tested the real-weight 25-frame and pinned two-frame FP32 ONNX exports on native Windows. Both matched retained ORT CPU waveforms within 1.05e-6 relative L2, but AMD VitisAI EP 1.8.63.0 aborted during full-graph compilation. Isolating the first decoder ConvTranspose1d reproduced the native assertion; equivalent size-one-height ConvTranspose2d compiled and executed on the NPU. Four real-weight prefixes through source node 200 also ran on NPU with 0.391-1.083% one-fixture intermediate differences versus CPU. Rewriting all six upsampling convolutions kept the complete two-frame CPU waveform bitwise identical. The rewritten short graph completed with two VitisAI and 139 CPU node events, but its one-fixture waveform differed 15.696% relative L2 / 16.08 dB SNR from CPU after a 2515 s session build; its single cold inference took 2.205 s for 0.16 s audio. It failed the numerical gate and does not qualify a complete TTS stream. The cell remains NOT E2E.
|
||||
|
||||
The [Qwen3-TTS vocoder study](evidence/qwen_tts_vocoder_qualcomm/README.md) reuses a retained fixed-shape Code2Wav export and historical Workbench input to test numerical behavior on SA8775P and other Qualcomm settings. The fresh SA8775P GPU-requested inference produces a saturated waveform, while the same binary's CPU-requested output on the exact SA device matches ONNX CPU within 4.13e-6 relative L2. Its 100-sample CPU-requested component profile had p50/p95 5.384/5.534 s with all 738 execution-detail rows on CPU. A FP32-preserving GPU-option control still saturated 84.89% of samples, so that option did not repair the tested path. RB3 GPU-requested execution produces an unsaturated but 15.73%-divergent waveform; its fresh 100-sample mixed CPU/GPU component p50/p95 was 3.099/3.133 s, not a usable TTS timing claim. On the exact RB3 device, the same binary requested on CPU matched original ONNX CPU within 4.13e-6 relative L2 on the retained fixture; its 47-sample component profile measured p50/p95 12.727/13.424 s with all 738 execution-detail rows on CPU. This is a major streaming-latency blocker. A single-fixture-calibrated RB3 INT8 QNN vocoder returned a finite but 66.93%-relative-L2 divergent waveform (3.49 dB SNR) versus ONNX CPU; its 100-sample component profile was p50/p95 1.971/1.992 s with all 728 execution-detail rows on NPU; these timings describe numerically unqualified audio. X Elite ONNX CPU output matches the local ONNX Runtime reference on the retained fixture; its 94-sample component p50/p95 was 6.384/6.644 s with all execution-detail rows on CPU. Corrected X Elite DirectML inference and profile both failed during provider initialization; separate FP16 QNN DLC inference returned an unsaturated waveform at 1.138% relative L2 / 38.88 dB SNR against original ONNX CPU; its placement profile timed out during QNN graph preparation without samples. A separate SA8775P FP16 QNN vocoder compile passed, but same-fixture NPU-requested inference failed after compilation without a waveform or placement samples. Fresh S24 and S25 CPU-requested TFLite vocoder inferences matched ONNX CPU within 4.04e-6 relative L2 on the retained fixture. S25 measured 100 component samples at p50/p95 4.418/4.641 s with all 738 execution-detail rows on CPU; S24 measured 100 at 4.826/4.958 s with all 738 rows on CPU. Separate explicit INT8 and W8A16 QDQ ONNX exports checked on local ORT CPU failed the same-fixture numerical gate at 246.97% and 331.83% waveform relative L2, respectively. S25 CPU talker inference preserved token 80 and its 100-sample component profile measured p50/p95 30.161/31.301 ms with all 1,800 rows on CPU. No complete on-device TTS stream or model-quality qualification is claimed.
|
||||
|
||||
|
||||
+27
-8
@@ -46,12 +46,9 @@ ExecutionProvider. `--cpu-only` reproduces the parity gate without
|
||||
starting the NPU compiler. Run the NPU case in a separate process because
|
||||
the native assertion cannot be caught by Python.
|
||||
|
||||
Next: bisect the specific ONNX operator/subgraph that trips this VitisAI
|
||||
compiler, export a version it accepts without losing same-checkpoint
|
||||
waveform quality, verify nonzero NPU node placement and measured coarse
|
||||
stage benefit, then connect talker, codec, state, admission, cancellation,
|
||||
and complete-stream quality gates through Omni. This compiler failure
|
||||
constrains these graphs and EP version only.
|
||||
The initial compiler failure constrains these graphs and EP version only.
|
||||
The follow-up below isolates one trigger and tests a numerically equivalent
|
||||
ONNX rewrite.
|
||||
|
||||
## Compiler bisection and equivalent decoder rewrite
|
||||
|
||||
@@ -88,8 +85,30 @@ Applying the same transformation to all six upsampling convolutions
|
||||
produced a [full two-frame graph](full_short_2d_rewrite.json) whose
|
||||
`[1,3840]` CPU waveform was bitwise identical to the original graph on
|
||||
the pinned fixture. The ~424 MB rewritten artifact remains outside Git;
|
||||
its SHA-256 is pinned in the report. A full-graph NPU waveform, placement
|
||||
profile and complete TTS stream are still unqualified in this evidence.
|
||||
its SHA-256 is pinned in the report. A [full rewritten graph NPU attempt](full_short_2d_npu_probe.json)
|
||||
then completed with **two VitisAI NPU node events and 139 CPU node events**,
|
||||
so this was mixed execution, not an all-NPU vocoder. Its finite,
|
||||
unsaturated waveform differed from the same-graph CPU result by **15.696%
|
||||
relative L2 / 16.08 dB SNR** on the fixed fixture, failing the probe's
|
||||
1% waveform gate. Session creation took **2515.0 s**. One cold inference
|
||||
took **2.205 s** for nominal 0.16 s audio (single-sample component RTF
|
||||
**13.78**); there was no warmup or repeated latency profile. The
|
||||
[raw profile](full_short_2d_profile_2026-09-24_19-07-20_388.json)
|
||||
and [native log](full_short_2d_npu_probe.log) are retained.
|
||||
An [isolated original `Sin` node](local_sin0_probe.json) on a labeled
|
||||
synthetic activation executed entirely on ORT CPU (one CPU event, zero
|
||||
VitisAI events) with exact CPU parity; the full graph likewise lists
|
||||
CPU sine nodes. That control identifies a real fallback boundary but
|
||||
does not by itself explain the 15.696% waveform difference.
|
||||
|
||||
The rewrite therefore fixes the isolated compiler crash and keeps CPU
|
||||
waveform behavior exact, but this mixed AMD NPU path fails numerical
|
||||
quality and is not a supported TTS stream. Next, identify which NPU
|
||||
partition or handoff causes the waveform difference, improve same-graph
|
||||
numerics without silent precision or model changes, and measure a
|
||||
useful coarse stage against CPU after warmup. Only then connect talker,
|
||||
codec, state, admission, cancellation and complete-stream quality
|
||||
through Omni.
|
||||
The [extraction/probe tool](../../../../experiments/bisect_qwen_tts_vitisai_graph.py)
|
||||
records cut hashes, CPU execution, actual provider events and intermediate
|
||||
numerics. No precision, weights or checkpoint revision changed in the
|
||||
|
||||
+29
-1
@@ -72,10 +72,38 @@
|
||||
"profile": "local_convtranspose0_2d_profile_2026-09-24_19-02-21_591.json"
|
||||
},
|
||||
"full_short_2d_rewrite": {
|
||||
"status": "cpu_parity_pass_full_npu_unqualified",
|
||||
"status": "cpu_parity_pass; mixed_npu_cpu_waveform_numeric_failed; not_e2e",
|
||||
"model_sha256": "3f041942800dc22b4e0ee88cebb606d8117ff9d77f1d35e216fe185d4ad0cb90",
|
||||
"rewritten_nodes": 6,
|
||||
"cpu_vs_original_waveform_l2": 0,
|
||||
"report": "full_short_2d_rewrite.json"
|
||||
},
|
||||
"full_short_2d_npu_run": {
|
||||
"scope": "one cold two-frame component call, 0.16 s nominal audio; no warmup or repeated timing",
|
||||
"report": "full_short_2d_npu_probe.json",
|
||||
"raw_log": "full_short_2d_npu_probe.log",
|
||||
"raw_log_sha256": "2bcc782112152ebf42053bccd21d8d49d729f36fb91b6b1e09e6d75fe6eba3b7",
|
||||
"profile": "full_short_2d_profile_2026-09-24_19-07-20_388.json",
|
||||
"profile_sha256": "4322b210f2e3e9c524e735d837cf77621e24248af782065dcdcb26d1a357f522",
|
||||
"session_create_s": 2515.029476099997,
|
||||
"single_cold_inference_s": 2.204674599925056,
|
||||
"single_cold_component_rtf": 13.7792162495316,
|
||||
"vitisai_node_events": 2,
|
||||
"cpu_node_events": 139,
|
||||
"waveform_relative_l2_vs_cpu": 0.15696028170607357,
|
||||
"waveform_snr_db_vs_cpu": 16.084204610179135,
|
||||
"waveform_saturation_fraction": 0.0,
|
||||
"numeric_disposition": "failed probe 1% waveform relative-L2 gate; no listening-quality pass"
|
||||
},
|
||||
"isolated_sin_control": {
|
||||
"scope": "one original Sin operator, fixed-seed synthetic tensor, not a waveform",
|
||||
"source_sha256": "da6bfdbefab41639c15506156b56f6a68f77487f960228cdf256b39615fc2702",
|
||||
"provider_events": {
|
||||
"CPUExecutionProvider": 1
|
||||
},
|
||||
"relative_l2_vs_cpu": 0.0,
|
||||
"report": "local_sin0_probe.json",
|
||||
"profile": "local_sin0_profile_2026-09-24_19-51-29_472.json",
|
||||
"profile_sha256": "c3fa9cdeafc3b4e035cccd39b999cd63784cfe5644f5a2d311aab79041147cea"
|
||||
}
|
||||
}
|
||||
+54
@@ -0,0 +1,54 @@
|
||||
{
|
||||
"scope": "one real-weight Qwen3-TTS Code2Wav component window; not a complete TTS stream",
|
||||
"os": "Windows-11-10.0.26200-SP0",
|
||||
"onnxruntime_version": "1.30.0",
|
||||
"input_shape": [
|
||||
1,
|
||||
512,
|
||||
74
|
||||
],
|
||||
"output_shape": [
|
||||
1,
|
||||
3840
|
||||
],
|
||||
"model_file": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\qwen3tts_code2wav_c2_ctx72_convtranspose2d_20260924.onnx",
|
||||
"fixture_file": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\results\\e2e_expansion_20260924\\evidence\\qwen_tts_vocoder_qualcomm\\s25\\qnn_short_chunk\\fixture.npz",
|
||||
"reference_file": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\results\\e2e_expansion_20260924\\evidence\\qwen_tts_vocoder_qualcomm\\s25\\qnn_short_chunk\\ort_output.npz",
|
||||
"artifact_sha256": {
|
||||
"model": "3f041942800dc22b4e0ee88cebb606d8117ff9d77f1d35e216fe185d4ad0cb90",
|
||||
"fixture": "77aea3554c51b9daf808748257ebfc5e0496172c4d34c8267288be984d8a0f55",
|
||||
"reference": "989307db317d77be054f684211ae0c6a2fd24d93bcd74307c597fed430ba2a37"
|
||||
},
|
||||
"cpu_load_s": 2.416820300044492,
|
||||
"cpu_inference_s": 1.0615151999518275,
|
||||
"cpu_vs_retained_reference": {
|
||||
"finite": true,
|
||||
"relative_l2": 1.0450898781329582e-06,
|
||||
"snr_db": 119.61692716907409,
|
||||
"maximum_absolute_error": 3.948807716369629e-07,
|
||||
"saturation_fraction": 0.0
|
||||
},
|
||||
"vitisai_npu_device_count": 1,
|
||||
"npu_load_s": 2515.029476099997,
|
||||
"npu_inference_s": 2.204674599925056,
|
||||
"npu_vs_cpu": {
|
||||
"finite": true,
|
||||
"relative_l2": 0.15696028170607357,
|
||||
"snr_db": 16.084204610179135,
|
||||
"maximum_absolute_error": 0.06048398092389107,
|
||||
"saturation_fraction": 0.0
|
||||
},
|
||||
"npu_vs_retained_reference": {
|
||||
"finite": true,
|
||||
"relative_l2": 0.1569608750593908,
|
||||
"snr_db": 16.084171775173793,
|
||||
"maximum_absolute_error": 0.06048431992530823,
|
||||
"saturation_fraction": 0.0
|
||||
},
|
||||
"profile_file": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\results\\e2e_expansion_20260924\\evidence\\qwen_tts_amd_npu_vocoder\\full_short_2d_profile_2026-09-24_19-07-20_388.json",
|
||||
"placement_events": {
|
||||
"vitisai": 2,
|
||||
"cpu": 139
|
||||
},
|
||||
"status": "component_not_qualified"
|
||||
}
|
||||
BIN
Binary file not shown.
+147
@@ -0,0 +1,147 @@
|
||||
[
|
||||
{"cat" : "Session","pid" :38024,"tid" :24636,"dur" :2127634,"ts" :11,"ph" : "X","name" :"model_loading_uri","args" : {}},
|
||||
{"cat" : "Session","pid" :38024,"tid" :24636,"dur" :2512896098,"ts" :2128716,"ph" : "X","name" :"session_initialization","args" : {}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :738862,"ts" :2515025234,"ph" : "X","name" :"vitisai_vitisai_17107263543137520299_0_0_kernel_time","args" : {"input_type_shape" : [{"float":[1,512,74]}],"op_name" : "vitisai_17107263543137520299_0","node_index" : "758","mem_arena_held" : "33554512","mem_requested_in_use_delta" : "14548992","output_type_shape" : [{"float":[1,768,2368]},{"float":[1,768,2368]}],"mem_bytes_requested_in_use" : "17350736","mem_in_use_peak" : "20299856","parameter_size" : "0","provider" : "vitisai","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": -1, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 0, "core": -1},"50944": {"num_run": 0, "core": -1},"26660": {"num_run": 0, "core": -1},"4492": {"num_run": 0, "core": -1},"58992": {"num_run": 0, "core": -1},"6948": {"num_run": 0, "core": -1},"23204": {"num_run": 0, "core": -1},"38556": {"num_run": 0, "core": -1},"60516": {"num_run": 0, "core": -1},"17584": {"num_run": 0, "core": -1},"59336": {"num_run": 0, "core": -1}}},"mem_bytes_in_use" : "20299856","mem_arena_held_delta" : "25165824","output_size" : "14548992","mem_in_use_delta" : "15663104","activation_size" : "151552"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :32991,"ts" :2515764118,"ph" : "X","name" :"node_conv1d_6_kernel_time","args" : {"mem_in_use_delta" : "9502720","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 5, "Distribution": 21, "DistributionEnqueue": 19, "Run": 30837, "Wait": 1978, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 1, "core": 13},"50944": {"num_run": 1, "core": 17},"26660": {"num_run": 1, "core": 23},"4492": {"num_run": 1, "core": 15},"58992": {"num_run": 1, "core": 5},"6948": {"num_run": 1, "core": 3},"23204": {"num_run": 1, "core": 4},"38556": {"num_run": 1, "core": 4},"60516": {"num_run": 1, "core": 22},"17584": {"num_run": 1, "core": 0},"59336": {"num_run": 1, "core": 1}}},"activation_size" : "7274496","mem_requested_in_use_delta" : "7274496","input_type_shape" : [{"float":[1,768,2368]},{"float":[768,768,7]},{"float":[768]}],"op_name" : "Conv","output_size" : "7274496","node_index" : "550","output_type_shape" : [{"float":[1,768,2368]}],"mem_bytes_requested_in_use" : "24625232","provider" : "CPUExecutionProvider","mem_arena_held" : "33554512","mem_in_use_peak" : "30589008","parameter_size" : "16518144","mem_arena_held_delta" : "0","mem_bytes_in_use" : "29802576"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :325,"ts" :2515797130,"ph" : "X","name" :"node_mul_102_kernel_time","args" : {"output_size" : "7274496","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [16], "core": 0, "Distribution": 2, "DistributionEnqueue": 0, "Run": 269, "Wait": 4, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 2, "core": 13},"50944": {"num_run": 2, "core": 17},"26660": {"num_run": 2, "core": 23},"4492": {"num_run": 2, "core": 15},"58992": {"num_run": 2, "core": 5},"6948": {"num_run": 2, "core": 3},"23204": {"num_run": 2, "core": 5},"38556": {"num_run": 2, "core": 4},"60516": {"num_run": 2, "core": 22},"17584": {"num_run": 2, "core": 10},"59336": {"num_run": 2, "core": 8}}},"node_index" : "551","mem_bytes_in_use" : "29802576","mem_bytes_requested_in_use" : "24625232","mem_arena_held" : "33554512","op_name" : "Mul","mem_in_use_peak" : "30589008","provider" : "CPUExecutionProvider","input_type_shape" : [{"float":[1,768,2368]},{"float":[1,768,1]}],"activation_size" : "7274496","mem_arena_held_delta" : "0","parameter_size" : "3072","mem_requested_in_use_delta" : "0","mem_in_use_delta" : "0","output_type_shape" : [{"float":[1,768,2368]}]}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3611,"ts" :2515797462,"ph" : "X","name" :"node_sin_5_kernel_time","args" : {"mem_in_use_peak" : "37077072","activation_size" : "7274496","mem_arena_held" : "67108944","output_type_shape" : [{"float":[1,768,2368]}],"input_type_shape" : [{"float":[1,768,2368]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 0, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 2, "core": 13},"50944": {"num_run": 2, "core": 17},"26660": {"num_run": 2, "core": 23},"4492": {"num_run": 2, "core": 15},"58992": {"num_run": 2, "core": 5},"6948": {"num_run": 2, "core": 3},"23204": {"num_run": 2, "core": 5},"38556": {"num_run": 2, "core": 4},"60516": {"num_run": 2, "core": 22},"17584": {"num_run": 2, "core": 10},"59336": {"num_run": 2, "core": 8}}},"node_index" : "552","mem_in_use_delta" : "7274496","output_size" : "7274496","mem_bytes_requested_in_use" : "31899728","provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "7274496","mem_bytes_in_use" : "37077072","parameter_size" : "0","mem_arena_held_delta" : "33554432","op_name" : "Sin"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :332,"ts" :2515801087,"ph" : "X","name" :"node_pow_22_kernel_time","args" : {"node_index" : "553","parameter_size" : "4","mem_arena_held_delta" : "0","output_type_shape" : [{"float":[1,768,2368]}],"mem_bytes_in_use" : "37077072","mem_requested_in_use_delta" : "0","mem_bytes_requested_in_use" : "31899728","mem_in_use_peak" : "37077072","input_type_shape" : [{"float":[1,768,2368]},{"float":[]}],"mem_in_use_delta" : "0","output_size" : "7274496","op_name" : "Pow","provider" : "CPUExecutionProvider","mem_arena_held" : "67108944","activation_size" : "7274496","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [37888], "core": 0, "Distribution": 2, "DistributionEnqueue": 1, "Run": 241, "Wait": 44, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 3, "core": 14},"50944": {"num_run": 3, "core": 17},"26660": {"num_run": 3, "core": 23},"4492": {"num_run": 3, "core": 15},"58992": {"num_run": 3, "core": 21},"6948": {"num_run": 3, "core": 3},"23204": {"num_run": 3, "core": 5},"38556": {"num_run": 3, "core": 4},"60516": {"num_run": 3, "core": 22},"17584": {"num_run": 3, "core": 10},"59336": {"num_run": 3, "core": 8}}}}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :227,"ts" :2515801431,"ph" : "X","name" :"node_mul_103_kernel_time","args" : {"input_type_shape" : [{"float":[1,768,1]},{"float":[1,768,2368]}],"provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "0","mem_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [16], "core": 0, "Distribution": 1, "DistributionEnqueue": 0, "Run": 156, "Wait": 42, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 4, "core": 14},"50944": {"num_run": 4, "core": 17},"26660": {"num_run": 4, "core": 23},"4492": {"num_run": 4, "core": 15},"58992": {"num_run": 4, "core": 21},"6948": {"num_run": 4, "core": 3},"23204": {"num_run": 4, "core": 5},"38556": {"num_run": 4, "core": 4},"60516": {"num_run": 4, "core": 22},"17584": {"num_run": 4, "core": 10},"59336": {"num_run": 4, "core": 8}}},"mem_bytes_in_use" : "37077072","mem_arena_held" : "67108944","node_index" : "554","mem_arena_held_delta" : "0","mem_in_use_peak" : "37077072","output_type_shape" : [{"float":[1,768,2368]}],"op_name" : "Mul","activation_size" : "7274496","output_size" : "7274496","parameter_size" : "3072","mem_bytes_requested_in_use" : "31899728"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :359,"ts" :2515801663,"ph" : "X","name" :"node_add_60_kernel_time","args" : {"input_type_shape" : [{"float":[1,768,2368]},{"float":[1,768,2368]}],"parameter_size" : "0","mem_requested_in_use_delta" : "0","mem_arena_held" : "67108944","mem_in_use_delta" : "0","output_size" : "7274496","output_type_shape" : [{"float":[1,768,2368]}],"activation_size" : "14548992","provider" : "CPUExecutionProvider","node_index" : "555","mem_in_use_peak" : "37077072","op_name" : "Add","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "31899728","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [37888], "core": 0, "Distribution": 0, "DistributionEnqueue": 0, "Run": 287, "Wait": 38, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 5, "core": 14},"50944": {"num_run": 5, "core": 19},"26660": {"num_run": 5, "core": 9},"4492": {"num_run": 5, "core": 15},"58992": {"num_run": 5, "core": 21},"6948": {"num_run": 5, "core": 3},"23204": {"num_run": 5, "core": 5},"38556": {"num_run": 5, "core": 4},"60516": {"num_run": 5, "core": 22},"17584": {"num_run": 5, "core": 10},"59336": {"num_run": 5, "core": 8}}},"mem_bytes_in_use" : "37077072"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :6162,"ts" :2515802034,"ph" : "X","name" :"node_conv1d_7_kernel_time","args" : {"mem_in_use_peak" : "37077072","provider" : "CPUExecutionProvider","mem_arena_held" : "67108944","mem_in_use_delta" : "0","input_type_shape" : [{"float":[1,768,2368]},{"float":[768,768,1]},{"float":[768]}],"mem_requested_in_use_delta" : "0","mem_bytes_requested_in_use" : "24625232","node_index" : "556","parameter_size" : "2362368","output_size" : "7274496","output_type_shape" : [{"float":[1,768,2368]}],"activation_size" : "7274496","op_name" : "Conv","mem_arena_held_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 2, "Distribution": 2, "DistributionEnqueue": 1, "Run": 4274, "Wait": 1481, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 6, "core": 14},"50944": {"num_run": 6, "core": 19},"26660": {"num_run": 6, "core": 9},"4492": {"num_run": 6, "core": 16},"58992": {"num_run": 6, "core": 21},"6948": {"num_run": 6, "core": 18},"23204": {"num_run": 6, "core": 5},"38556": {"num_run": 6, "core": 14},"60516": {"num_run": 6, "core": 9},"17584": {"num_run": 6, "core": 10},"59336": {"num_run": 6, "core": 8}}},"mem_bytes_in_use" : "27574352"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :423,"ts" :2515808214,"ph" : "X","name" :"node_add_61_kernel_time","args" : {"input_type_shape" : [{"float":[1,768,2368]},{"float":[1,768,2368]}],"output_type_shape" : [{"float":[1,768,2368]}],"output_size" : "7274496","mem_in_use_peak" : "37077072","mem_in_use_delta" : "0","provider" : "CPUExecutionProvider","node_index" : "557","mem_bytes_requested_in_use" : "24625232","mem_requested_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [37888], "core": 7, "Distribution": 1, "DistributionEnqueue": 0, "Run": 325, "Wait": 39, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 7, "core": 14},"50944": {"num_run": 7, "core": 19},"26660": {"num_run": 7, "core": 9},"4492": {"num_run": 7, "core": 16},"58992": {"num_run": 7, "core": 21},"6948": {"num_run": 7, "core": 18},"23204": {"num_run": 7, "core": 4},"38556": {"num_run": 7, "core": 14},"60516": {"num_run": 7, "core": 9},"17584": {"num_run": 7, "core": 8},"59336": {"num_run": 7, "core": 16}}},"mem_bytes_in_use" : "27574352","parameter_size" : "0","mem_arena_held" : "67108944","activation_size" : "14548992","mem_arena_held_delta" : "0","op_name" : "Add"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :178,"ts" :2515808646,"ph" : "X","name" :"node_mul_104_kernel_time","args" : {"mem_arena_held_delta" : "0","activation_size" : "7274496","mem_in_use_delta" : "0","parameter_size" : "3072","mem_in_use_peak" : "37077072","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [16], "core": 7, "Distribution": 0, "DistributionEnqueue": 0, "Run": 95, "Wait": 41, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 8, "core": 14},"50944": {"num_run": 8, "core": 19},"26660": {"num_run": 8, "core": 9},"4492": {"num_run": 8, "core": 16},"58992": {"num_run": 8, "core": 21},"6948": {"num_run": 8, "core": 18},"23204": {"num_run": 8, "core": 4},"38556": {"num_run": 8, "core": 14},"60516": {"num_run": 8, "core": 9},"17584": {"num_run": 8, "core": 8},"59336": {"num_run": 8, "core": 16}}},"provider" : "CPUExecutionProvider","mem_arena_held" : "67108944","op_name" : "Mul","mem_requested_in_use_delta" : "0","node_index" : "558","output_type_shape" : [{"float":[1,768,2368]}],"mem_bytes_requested_in_use" : "24625232","mem_bytes_in_use" : "27574352","input_type_shape" : [{"float":[1,768,2368]},{"float":[1,768,1]}],"output_size" : "7274496"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3658,"ts" :2515808831,"ph" : "X","name" :"node_sin_6_kernel_time","args" : {"input_type_shape" : [{"float":[1,768,2368]}],"mem_arena_held" : "67108944","mem_arena_held_delta" : "0","mem_in_use_delta" : "0","parameter_size" : "0","provider" : "CPUExecutionProvider","output_size" : "7274496","mem_requested_in_use_delta" : "0","mem_bytes_in_use" : "27574352","activation_size" : "7274496","output_type_shape" : [{"float":[1,768,2368]}],"mem_in_use_peak" : "37077072","node_index" : "559","op_name" : "Sin","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 7, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 8, "core": 14},"50944": {"num_run": 8, "core": 19},"26660": {"num_run": 8, "core": 9},"4492": {"num_run": 8, "core": 16},"58992": {"num_run": 8, "core": 21},"6948": {"num_run": 8, "core": 18},"23204": {"num_run": 8, "core": 4},"38556": {"num_run": 8, "core": 14},"60516": {"num_run": 8, "core": 9},"17584": {"num_run": 8, "core": 8},"59336": {"num_run": 8, "core": 16}}},"mem_bytes_requested_in_use" : "24625232"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :417,"ts" :2515812511,"ph" : "X","name" :"node_pow_23_kernel_time","args" : {"input_type_shape" : [{"float":[1,768,2368]},{"float":[]}],"output_type_shape" : [{"float":[1,768,2368]}],"node_index" : "560","parameter_size" : "4","output_size" : "7274496","mem_arena_held" : "67108944","op_name" : "Pow","mem_bytes_in_use" : "27574352","mem_bytes_requested_in_use" : "24625232","mem_requested_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [37888], "core": 12, "Distribution": 2, "DistributionEnqueue": 0, "Run": 302, "Wait": 7, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 9, "core": 21},"50944": {"num_run": 9, "core": 11},"26660": {"num_run": 9, "core": 10},"4492": {"num_run": 9, "core": 16},"58992": {"num_run": 9, "core": 15},"6948": {"num_run": 9, "core": 18},"23204": {"num_run": 9, "core": 4},"38556": {"num_run": 9, "core": 14},"60516": {"num_run": 9, "core": 9},"17584": {"num_run": 9, "core": 8},"59336": {"num_run": 9, "core": 16}}},"provider" : "CPUExecutionProvider","mem_arena_held_delta" : "0","mem_in_use_delta" : "0","activation_size" : "7274496","mem_in_use_peak" : "37077072"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :225,"ts" :2515812948,"ph" : "X","name" :"node_mul_105_kernel_time","args" : {"mem_requested_in_use_delta" : "0","mem_arena_held_delta" : "0","output_type_shape" : [{"float":[1,768,2368]}],"mem_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [16], "core": 4, "Distribution": 1, "DistributionEnqueue": 0, "Run": 160, "Wait": 22, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 10, "core": 21},"50944": {"num_run": 10, "core": 11},"26660": {"num_run": 10, "core": 10},"4492": {"num_run": 10, "core": 16},"58992": {"num_run": 10, "core": 15},"6948": {"num_run": 10, "core": 18},"23204": {"num_run": 10, "core": 4},"38556": {"num_run": 10, "core": 14},"60516": {"num_run": 10, "core": 9},"17584": {"num_run": 10, "core": 8},"59336": {"num_run": 10, "core": 16}}},"mem_bytes_requested_in_use" : "24625232","mem_in_use_peak" : "37077072","activation_size" : "7274496","output_size" : "7274496","parameter_size" : "3072","mem_arena_held" : "67108944","op_name" : "Mul","input_type_shape" : [{"float":[1,768,1]},{"float":[1,768,2368]}],"mem_bytes_in_use" : "27574352","provider" : "CPUExecutionProvider","node_index" : "561"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :299,"ts" :2515813178,"ph" : "X","name" :"node_add_62_kernel_time","args" : {"mem_in_use_delta" : "0","op_name" : "Add","provider" : "CPUExecutionProvider","mem_arena_held_delta" : "0","mem_in_use_peak" : "37077072","output_size" : "7274496","mem_arena_held" : "67108944","parameter_size" : "0","node_index" : "562","activation_size" : "14548992","mem_bytes_in_use" : "27574352","mem_bytes_requested_in_use" : "24625232","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [37888], "core": 4, "Distribution": 0, "DistributionEnqueue": 0, "Run": 250, "Wait": 20, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 11, "core": 21},"50944": {"num_run": 11, "core": 11},"26660": {"num_run": 11, "core": 10},"4492": {"num_run": 11, "core": 16},"58992": {"num_run": 11, "core": 15},"6948": {"num_run": 11, "core": 18},"23204": {"num_run": 11, "core": 4},"38556": {"num_run": 11, "core": 14},"60516": {"num_run": 11, "core": 9},"17584": {"num_run": 11, "core": 8},"59336": {"num_run": 11, "core": 16}}},"output_type_shape" : [{"float":[1,768,2368]}],"input_type_shape" : [{"float":[1,768,2368]},{"float":[1,768,2368]}],"mem_requested_in_use_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :34111,"ts" :2515813482,"ph" : "X","name" :"node_conv1d_8_kernel_time","args" : {"provider" : "CPUExecutionProvider","parameter_size" : "16518144","mem_bytes_in_use" : "27574352","mem_arena_held" : "67108944","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "24625232","node_index" : "563","output_type_shape" : [{"float":[1,768,2368]}],"mem_in_use_delta" : "0","input_type_shape" : [{"float":[1,768,2368]},{"float":[768,768,7]},{"float":[768]}],"mem_requested_in_use_delta" : "0","op_name" : "Conv","output_size" : "7274496","mem_in_use_peak" : "37077072","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 4, "Distribution": 0, "DistributionEnqueue": 0, "Run": 26722, "Wait": 7279, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 12, "core": 19},"50944": {"num_run": 12, "core": 18},"26660": {"num_run": 12, "core": 2},"4492": {"num_run": 12, "core": 18},"58992": {"num_run": 12, "core": 1},"6948": {"num_run": 12, "core": 15},"23204": {"num_run": 12, "core": 5},"38556": {"num_run": 12, "core": 5},"60516": {"num_run": 12, "core": 5},"17584": {"num_run": 12, "core": 9},"59336": {"num_run": 12, "core": 16}}},"activation_size" : "7274496"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :354633,"ts" :2515847622,"ph" : "X","name" :"vitisai_vitisai_17107263543137520299_1_1_kernel_time","args" : {"output_type_shape" : [{"float":[1,384,11840]},{"float":[1,384,11840]}],"mem_in_use_peak" : "64766032","parameter_size" : "0","mem_bytes_in_use" : "64766032","provider" : "vitisai","node_index" : "759","activation_size" : "14548992","mem_arena_held_delta" : "67108864","mem_requested_in_use_delta" : "36372480","mem_arena_held" : "134217808","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 4, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 12, "core": 19},"50944": {"num_run": 12, "core": 18},"26660": {"num_run": 12, "core": 2},"4492": {"num_run": 12, "core": 18},"58992": {"num_run": 12, "core": 1},"6948": {"num_run": 12, "core": 15},"23204": {"num_run": 12, "core": 5},"38556": {"num_run": 12, "core": 5},"60516": {"num_run": 12, "core": 5},"17584": {"num_run": 12, "core": 9},"59336": {"num_run": 12, "core": 16}}},"mem_bytes_requested_in_use" : "53723216","mem_in_use_delta" : "44466176","op_name" : "vitisai_17107263543137520299_1","input_type_shape" : [{"float":[1,768,2368]},{"float":[1,768,2368]}],"output_size" : "36372480"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :40969,"ts" :2516202288,"ph" : "X","name" :"node_conv1d_12_kernel_time","args" : {"mem_bytes_requested_in_use" : "57360464","parameter_size" : "4130304","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 14, "Distribution": 15, "DistributionEnqueue": 12, "Run": 39280, "Wait": 1528, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 13, "core": 4},"50944": {"num_run": 13, "core": 7},"26660": {"num_run": 13, "core": 15},"4492": {"num_run": 13, "core": 5},"58992": {"num_run": 13, "core": 16},"6948": {"num_run": 13, "core": 15},"23204": {"num_run": 13, "core": 6},"38556": {"num_run": 13, "core": 4},"60516": {"num_run": 13, "core": 2},"17584": {"num_run": 13, "core": 8},"59336": {"num_run": 13, "core": 13}}},"input_type_shape" : [{"float":[1,384,11840]},{"float":[384,384,7]},{"float":[384]}],"mem_bytes_in_use" : "67289168","op_name" : "Conv","mem_requested_in_use_delta" : "18186240","activation_size" : "18186240","node_index" : "598","mem_in_use_delta" : "18186240","mem_arena_held" : "134217808","output_size" : "18186240","output_type_shape" : [{"float":[1,384,11840]}],"mem_in_use_peak" : "68075600","mem_arena_held_delta" : "0","provider" : "CPUExecutionProvider"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1350,"ts" :2516243278,"ph" : "X","name" :"node_mul_116_kernel_time","args" : {"mem_arena_held_delta" : "0","output_type_shape" : [{"float":[1,384,11840]}],"mem_in_use_peak" : "68075600","provider" : "CPUExecutionProvider","mem_in_use_delta" : "0","mem_arena_held" : "134217808","input_type_shape" : [{"float":[1,384,11840]},{"float":[1,384,1]}],"mem_bytes_in_use" : "67289168","node_index" : "599","activation_size" : "18186240","output_size" : "18186240","op_name" : "Mul","parameter_size" : "1536","mem_requested_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [8], "core": 10, "Distribution": 2, "DistributionEnqueue": 0, "Run": 781, "Wait": 467, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 14, "core": 1},"50944": {"num_run": 14, "core": 7},"26660": {"num_run": 14, "core": 15},"4492": {"num_run": 14, "core": 4},"58992": {"num_run": 14, "core": 16},"6948": {"num_run": 14, "core": 15},"23204": {"num_run": 14, "core": 18},"38556": {"num_run": 14, "core": 4},"60516": {"num_run": 14, "core": 2},"17584": {"num_run": 14, "core": 8},"59336": {"num_run": 14, "core": 13}}},"mem_bytes_requested_in_use" : "57360464"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :10022,"ts" :2516244648,"ph" : "X","name" :"node_sin_12_kernel_time","args" : {"provider" : "CPUExecutionProvider","node_index" : "600","output_type_shape" : [{"float":[1,384,11840]}],"op_name" : "Sin","activation_size" : "18186240","mem_arena_held_delta" : "0","input_type_shape" : [{"float":[1,384,11840]}],"output_size" : "18186240","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 10, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 14, "core": 1},"50944": {"num_run": 14, "core": 7},"26660": {"num_run": 14, "core": 15},"4492": {"num_run": 14, "core": 4},"58992": {"num_run": 14, "core": 16},"6948": {"num_run": 14, "core": 15},"23204": {"num_run": 14, "core": 18},"38556": {"num_run": 14, "core": 4},"60516": {"num_run": 14, "core": 2},"17584": {"num_run": 14, "core": 8},"59336": {"num_run": 14, "core": 13}}},"mem_bytes_requested_in_use" : "75546704","parameter_size" : "0","mem_in_use_delta" : "30736384","mem_in_use_peak" : "98025552","mem_bytes_in_use" : "98025552","mem_requested_in_use_delta" : "18186240","mem_arena_held" : "134217808"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :789,"ts" :2516254690,"ph" : "X","name" :"node_pow_29_kernel_time","args" : {"mem_bytes_requested_in_use" : "75546704","mem_bytes_in_use" : "98025552","mem_requested_in_use_delta" : "0","output_type_shape" : [{"float":[1,384,11840]}],"provider" : "CPUExecutionProvider","activation_size" : "18186240","op_name" : "Pow","parameter_size" : "4","mem_in_use_peak" : "98025552","input_type_shape" : [{"float":[1,384,11840]},{"float":[]}],"node_index" : "601","mem_arena_held" : "134217808","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [94720], "core": 4, "Distribution": 2, "DistributionEnqueue": 1, "Run": 674, "Wait": 51, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 15, "core": 14},"50944": {"num_run": 15, "core": 15},"26660": {"num_run": 15, "core": 5},"4492": {"num_run": 15, "core": 18},"58992": {"num_run": 15, "core": 11},"6948": {"num_run": 15, "core": 7},"23204": {"num_run": 15, "core": 2},"38556": {"num_run": 15, "core": 9},"60516": {"num_run": 15, "core": 19},"17584": {"num_run": 15, "core": 10},"59336": {"num_run": 15, "core": 6}}},"output_size" : "18186240","mem_arena_held_delta" : "0","mem_in_use_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :600,"ts" :2516255485,"ph" : "X","name" :"node_mul_117_kernel_time","args" : {"provider" : "CPUExecutionProvider","mem_bytes_requested_in_use" : "75546704","op_name" : "Mul","mem_arena_held_delta" : "0","mem_in_use_delta" : "0","activation_size" : "18186240","output_type_shape" : [{"float":[1,384,11840]}],"mem_arena_held" : "134217808","parameter_size" : "1536","mem_bytes_in_use" : "98025552","mem_requested_in_use_delta" : "0","mem_in_use_peak" : "98025552","output_size" : "18186240","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [8], "core": 4, "Distribution": 1, "DistributionEnqueue": 0, "Run": 508, "Wait": 48, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 16, "core": 14},"50944": {"num_run": 16, "core": 15},"26660": {"num_run": 16, "core": 5},"4492": {"num_run": 16, "core": 18},"58992": {"num_run": 16, "core": 11},"6948": {"num_run": 16, "core": 7},"23204": {"num_run": 16, "core": 2},"38556": {"num_run": 16, "core": 9},"60516": {"num_run": 16, "core": 19},"17584": {"num_run": 16, "core": 10},"59336": {"num_run": 16, "core": 6}}},"node_index" : "602","input_type_shape" : [{"float":[1,384,1]},{"float":[1,384,11840]}]}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1217,"ts" :2516256093,"ph" : "X","name" :"node_add_70_kernel_time","args" : {"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [94720], "core": 4, "Distribution": 0, "DistributionEnqueue": 0, "Run": 1033, "Wait": 143, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 17, "core": 14},"50944": {"num_run": 17, "core": 15},"26660": {"num_run": 17, "core": 5},"4492": {"num_run": 17, "core": 18},"58992": {"num_run": 17, "core": 11},"6948": {"num_run": 17, "core": 7},"23204": {"num_run": 17, "core": 2},"38556": {"num_run": 17, "core": 9},"60516": {"num_run": 17, "core": 19},"17584": {"num_run": 17, "core": 10},"59336": {"num_run": 17, "core": 6}}},"mem_bytes_requested_in_use" : "75546704","op_name" : "Add","node_index" : "603","output_type_shape" : [{"float":[1,384,11840]}],"output_size" : "18186240","parameter_size" : "0","activation_size" : "36372480","mem_in_use_peak" : "98025552","input_type_shape" : [{"float":[1,384,11840]},{"float":[1,384,11840]}],"mem_bytes_in_use" : "98025552","mem_in_use_delta" : "0","mem_arena_held_delta" : "0","mem_requested_in_use_delta" : "0","provider" : "CPUExecutionProvider","mem_arena_held" : "134217808"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :7538,"ts" :2516257321,"ph" : "X","name" :"node_conv1d_13_kernel_time","args" : {"output_size" : "18186240","mem_bytes_in_use" : "98025552","mem_in_use_delta" : "0","mem_bytes_requested_in_use" : "75546704","op_name" : "Conv","provider" : "CPUExecutionProvider","node_index" : "604","activation_size" : "18186240","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 4, "Distribution": 1, "DistributionEnqueue": 0, "Run": 3967, "Wait": 2560, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 18, "core": 14},"50944": {"num_run": 18, "core": 15},"26660": {"num_run": 18, "core": 5},"4492": {"num_run": 18, "core": 18},"58992": {"num_run": 18, "core": 11},"6948": {"num_run": 18, "core": 7},"23204": {"num_run": 18, "core": 2},"38556": {"num_run": 18, "core": 9},"60516": {"num_run": 18, "core": 19},"17584": {"num_run": 18, "core": 10},"59336": {"num_run": 18, "core": 6}}},"output_type_shape" : [{"float":[1,384,11840]}],"mem_requested_in_use_delta" : "0","mem_in_use_peak" : "98025552","parameter_size" : "591360","input_type_shape" : [{"float":[1,384,11840]},{"float":[384,384,1]},{"float":[384]}],"mem_arena_held" : "134217808","mem_arena_held_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2237,"ts" :2516264879,"ph" : "X","name" :"node_add_71_kernel_time","args" : {"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [94720], "core": 4, "Distribution": 2, "DistributionEnqueue": 1, "Run": 1848, "Wait": 332, "WaitRevoke": 4}, "sub_threads": {"20368": {"num_run": 19, "core": 11},"50944": {"num_run": 19, "core": 2},"26660": {"num_run": 19, "core": 10},"4492": {"num_run": 19, "core": 20},"58992": {"num_run": 19, "core": 5},"6948": {"num_run": 19, "core": 15},"23204": {"num_run": 19, "core": 19},"38556": {"num_run": 19, "core": 9},"60516": {"num_run": 19, "core": 3},"17584": {"num_run": 19, "core": 14},"59336": {"num_run": 19, "core": 18}}},"mem_requested_in_use_delta" : "0","parameter_size" : "0","node_index" : "605","mem_arena_held_delta" : "0","activation_size" : "36372480","provider" : "CPUExecutionProvider","output_type_shape" : [{"float":[1,384,11840]}],"mem_bytes_in_use" : "98025552","op_name" : "Add","output_size" : "18186240","mem_in_use_peak" : "98025552","mem_arena_held" : "134217808","input_type_shape" : [{"float":[1,384,11840]},{"float":[1,384,11840]}],"mem_in_use_delta" : "0","mem_bytes_requested_in_use" : "75546704"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :776,"ts" :2516267123,"ph" : "X","name" :"node_mul_118_kernel_time","args" : {"mem_requested_in_use_delta" : "0","mem_in_use_peak" : "98025552","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [8], "core": 4, "Distribution": 0, "DistributionEnqueue": 0, "Run": 724, "Wait": 12, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 20, "core": 11},"50944": {"num_run": 20, "core": 2},"26660": {"num_run": 20, "core": 10},"4492": {"num_run": 20, "core": 20},"58992": {"num_run": 20, "core": 5},"6948": {"num_run": 20, "core": 15},"23204": {"num_run": 20, "core": 19},"38556": {"num_run": 19, "core": 9},"60516": {"num_run": 20, "core": 3},"17584": {"num_run": 20, "core": 14},"59336": {"num_run": 20, "core": 18}}},"mem_arena_held" : "134217808","mem_arena_held_delta" : "0","activation_size" : "18186240","parameter_size" : "1536","mem_in_use_delta" : "0","provider" : "CPUExecutionProvider","node_index" : "606","output_type_shape" : [{"float":[1,384,11840]}],"mem_bytes_requested_in_use" : "75546704","output_size" : "18186240","mem_bytes_in_use" : "98025552","op_name" : "Mul","input_type_shape" : [{"float":[1,384,11840]},{"float":[1,384,1]}]}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :8579,"ts" :2516267905,"ph" : "X","name" :"node_sin_13_kernel_time","args" : {"mem_arena_held_delta" : "0","input_type_shape" : [{"float":[1,384,11840]}],"mem_arena_held" : "134217808","mem_in_use_delta" : "0","mem_requested_in_use_delta" : "0","mem_bytes_in_use" : "98025552","output_size" : "18186240","mem_in_use_peak" : "98025552","activation_size" : "18186240","op_name" : "Sin","node_index" : "607","provider" : "CPUExecutionProvider","mem_bytes_requested_in_use" : "75546704","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 4, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 20, "core": 11},"50944": {"num_run": 20, "core": 2},"26660": {"num_run": 20, "core": 10},"4492": {"num_run": 20, "core": 20},"58992": {"num_run": 20, "core": 5},"6948": {"num_run": 20, "core": 15},"23204": {"num_run": 20, "core": 19},"38556": {"num_run": 19, "core": 9},"60516": {"num_run": 20, "core": 3},"17584": {"num_run": 20, "core": 14},"59336": {"num_run": 20, "core": 18}}},"output_type_shape" : [{"float":[1,384,11840]}],"parameter_size" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :812,"ts" :2516276505,"ph" : "X","name" :"node_pow_30_kernel_time","args" : {"provider" : "CPUExecutionProvider","node_index" : "608","mem_in_use_peak" : "98025552","mem_bytes_in_use" : "98025552","op_name" : "Pow","activation_size" : "18186240","mem_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [94720], "core": 23, "Distribution": 2, "DistributionEnqueue": 0, "Run": 681, "Wait": 46, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 21, "core": 4},"50944": {"num_run": 21, "core": 5},"26660": {"num_run": 21, "core": 19},"4492": {"num_run": 21, "core": 3},"58992": {"num_run": 21, "core": 18},"6948": {"num_run": 21, "core": 15},"23204": {"num_run": 21, "core": 14},"38556": {"num_run": 20, "core": 10},"60516": {"num_run": 21, "core": 9},"17584": {"num_run": 21, "core": 11},"59336": {"num_run": 21, "core": 2}}},"mem_requested_in_use_delta" : "0","output_type_shape" : [{"float":[1,384,11840]}],"mem_arena_held_delta" : "0","input_type_shape" : [{"float":[1,384,11840]},{"float":[]}],"mem_bytes_requested_in_use" : "75546704","output_size" : "18186240","mem_arena_held" : "134217808","parameter_size" : "4"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :676,"ts" :2516277334,"ph" : "X","name" :"node_mul_119_kernel_time","args" : {"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [8], "core": 6, "Distribution": 0, "DistributionEnqueue": 0, "Run": 571, "Wait": 59, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 22, "core": 4},"50944": {"num_run": 22, "core": 5},"26660": {"num_run": 22, "core": 19},"4492": {"num_run": 22, "core": 3},"58992": {"num_run": 22, "core": 18},"6948": {"num_run": 22, "core": 15},"23204": {"num_run": 22, "core": 14},"38556": {"num_run": 21, "core": 10},"60516": {"num_run": 22, "core": 9},"17584": {"num_run": 22, "core": 11},"59336": {"num_run": 22, "core": 2}}},"input_type_shape" : [{"float":[1,384,1]},{"float":[1,384,11840]}],"provider" : "CPUExecutionProvider","mem_bytes_requested_in_use" : "75546704","mem_bytes_in_use" : "98025552","output_type_shape" : [{"float":[1,384,11840]}],"mem_arena_held" : "134217808","parameter_size" : "1536","op_name" : "Mul","mem_in_use_peak" : "98025552","node_index" : "609","mem_arena_held_delta" : "0","output_size" : "18186240","mem_requested_in_use_delta" : "0","mem_in_use_delta" : "0","activation_size" : "18186240"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1420,"ts" :2516278018,"ph" : "X","name" :"node_add_72_kernel_time","args" : {"mem_in_use_peak" : "98025552","parameter_size" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [94720], "core": 6, "Distribution": 0, "DistributionEnqueue": 0, "Run": 1189, "Wait": 87, "WaitRevoke": 5}, "sub_threads": {"20368": {"num_run": 23, "core": 4},"50944": {"num_run": 23, "core": 5},"26660": {"num_run": 23, "core": 19},"4492": {"num_run": 23, "core": 3},"58992": {"num_run": 23, "core": 18},"6948": {"num_run": 23, "core": 15},"23204": {"num_run": 23, "core": 14},"38556": {"num_run": 22, "core": 10},"60516": {"num_run": 23, "core": 9},"17584": {"num_run": 23, "core": 11},"59336": {"num_run": 23, "core": 2}}},"mem_bytes_requested_in_use" : "75546704","input_type_shape" : [{"float":[1,384,11840]},{"float":[1,384,11840]}],"mem_arena_held" : "134217808","output_type_shape" : [{"float":[1,384,11840]}],"activation_size" : "36372480","output_size" : "18186240","node_index" : "610","mem_in_use_delta" : "0","mem_bytes_in_use" : "98025552","mem_requested_in_use_delta" : "0","op_name" : "Add","mem_arena_held_delta" : "0","provider" : "CPUExecutionProvider"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :40735,"ts" :2516279470,"ph" : "X","name" :"node_conv1d_14_kernel_time","args" : {"node_index" : "611","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 13, "Distribution": 3, "DistributionEnqueue": 0, "Run": 36382, "Wait": 4115, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 24, "core": 1},"50944": {"num_run": 24, "core": 18},"26660": {"num_run": 24, "core": 5},"4492": {"num_run": 24, "core": 10},"58992": {"num_run": 24, "core": 21},"6948": {"num_run": 24, "core": 3},"23204": {"num_run": 24, "core": 11},"38556": {"num_run": 23, "core": 15},"60516": {"num_run": 24, "core": 18},"17584": {"num_run": 24, "core": 14},"59336": {"num_run": 24, "core": 20}}},"mem_bytes_requested_in_use" : "75546704","output_size" : "18186240","mem_in_use_delta" : "0","provider" : "CPUExecutionProvider","mem_bytes_in_use" : "98025552","mem_requested_in_use_delta" : "0","input_type_shape" : [{"float":[1,384,11840]},{"float":[384,384,7]},{"float":[384]}],"op_name" : "Conv","mem_arena_held_delta" : "0","activation_size" : "18186240","mem_in_use_peak" : "98811984","output_type_shape" : [{"float":[1,384,11840]}],"parameter_size" : "4130304","mem_arena_held" : "134217808"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :964,"ts" :2516320232,"ph" : "X","name" :"node_mul_120_kernel_time","args" : {"op_name" : "Mul","mem_requested_in_use_delta" : "0","input_type_shape" : [{"float":[1,384,11840]},{"float":[1,384,1]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [8], "core": 23, "Distribution": 2, "DistributionEnqueue": 0, "Run": 758, "Wait": 101, "WaitRevoke": 9}, "sub_threads": {"20368": {"num_run": 25, "core": 1},"50944": {"num_run": 25, "core": 18},"26660": {"num_run": 25, "core": 18},"4492": {"num_run": 25, "core": 10},"58992": {"num_run": 25, "core": 21},"6948": {"num_run": 25, "core": 3},"23204": {"num_run": 25, "core": 11},"38556": {"num_run": 24, "core": 15},"60516": {"num_run": 25, "core": 18},"17584": {"num_run": 25, "core": 14},"59336": {"num_run": 25, "core": 20}}},"provider" : "CPUExecutionProvider","node_index" : "612","mem_bytes_requested_in_use" : "75546704","mem_in_use_peak" : "98811984","output_type_shape" : [{"float":[1,384,11840]}],"mem_arena_held" : "134217808","mem_in_use_delta" : "0","mem_arena_held_delta" : "0","parameter_size" : "1536","mem_bytes_in_use" : "98025552","output_size" : "18186240","activation_size" : "18186240"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :7449,"ts" :2516321205,"ph" : "X","name" :"node_sin_14_kernel_time","args" : {"node_index" : "613","mem_arena_held_delta" : "0","activation_size" : "18186240","input_type_shape" : [{"float":[1,384,11840]}],"mem_arena_held" : "134217808","output_size" : "18186240","output_type_shape" : [{"float":[1,384,11840]}],"op_name" : "Sin","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 23, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 25, "core": 1},"50944": {"num_run": 25, "core": 18},"26660": {"num_run": 25, "core": 18},"4492": {"num_run": 25, "core": 10},"58992": {"num_run": 25, "core": 21},"6948": {"num_run": 25, "core": 3},"23204": {"num_run": 25, "core": 11},"38556": {"num_run": 24, "core": 15},"60516": {"num_run": 25, "core": 18},"17584": {"num_run": 25, "core": 14},"59336": {"num_run": 25, "core": 20}}},"parameter_size" : "0","mem_requested_in_use_delta" : "0","mem_bytes_in_use" : "98025552","mem_in_use_delta" : "0","mem_in_use_peak" : "98811984","provider" : "CPUExecutionProvider","mem_bytes_requested_in_use" : "75546704"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :795,"ts" :2516328675,"ph" : "X","name" :"node_pow_31_kernel_time","args" : {"provider" : "CPUExecutionProvider","output_size" : "18186240","mem_in_use_delta" : "0","mem_in_use_peak" : "98811984","activation_size" : "18186240","mem_arena_held" : "134217808","mem_requested_in_use_delta" : "0","mem_bytes_in_use" : "98025552","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [94720], "core": 7, "Distribution": 2, "DistributionEnqueue": 0, "Run": 720, "Wait": 21, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 26, "core": 6},"50944": {"num_run": 26, "core": 15},"26660": {"num_run": 26, "core": 18},"4492": {"num_run": 26, "core": 1},"58992": {"num_run": 26, "core": 19},"6948": {"num_run": 26, "core": 5},"23204": {"num_run": 26, "core": 11},"38556": {"num_run": 25, "core": 8},"60516": {"num_run": 26, "core": 14},"17584": {"num_run": 26, "core": 11},"59336": {"num_run": 26, "core": 10}}},"input_type_shape" : [{"float":[1,384,11840]},{"float":[]}],"parameter_size" : "4","op_name" : "Pow","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "75546704","node_index" : "614","output_type_shape" : [{"float":[1,384,11840]}]}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :692,"ts" :2516329477,"ph" : "X","name" :"node_mul_121_kernel_time","args" : {"mem_in_use_delta" : "0","mem_arena_held_delta" : "0","node_index" : "615","input_type_shape" : [{"float":[1,384,1]},{"float":[1,384,11840]}],"provider" : "CPUExecutionProvider","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [8], "core": 7, "Distribution": 0, "DistributionEnqueue": 0, "Run": 564, "Wait": 90, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 27, "core": 6},"50944": {"num_run": 27, "core": 15},"26660": {"num_run": 27, "core": 18},"4492": {"num_run": 27, "core": 1},"58992": {"num_run": 27, "core": 19},"6948": {"num_run": 27, "core": 5},"23204": {"num_run": 27, "core": 9},"38556": {"num_run": 26, "core": 8},"60516": {"num_run": 27, "core": 14},"17584": {"num_run": 27, "core": 11},"59336": {"num_run": 27, "core": 10}}},"op_name" : "Mul","mem_requested_in_use_delta" : "0","mem_bytes_in_use" : "98025552","mem_arena_held" : "134217808","output_type_shape" : [{"float":[1,384,11840]}],"mem_bytes_requested_in_use" : "75546704","output_size" : "18186240","activation_size" : "18186240","parameter_size" : "1536","mem_in_use_peak" : "98811984"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1425,"ts" :2516330175,"ph" : "X","name" :"node_add_73_kernel_time","args" : {"node_index" : "616","mem_bytes_requested_in_use" : "75546704","mem_in_use_peak" : "98811984","output_type_shape" : [{"float":[1,384,11840]}],"mem_requested_in_use_delta" : "0","output_size" : "18186240","mem_arena_held_delta" : "0","provider" : "CPUExecutionProvider","mem_bytes_in_use" : "98025552","mem_in_use_delta" : "0","mem_arena_held" : "134217808","op_name" : "Add","parameter_size" : "0","input_type_shape" : [{"float":[1,384,11840]},{"float":[1,384,11840]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [94720], "core": 7, "Distribution": 0, "DistributionEnqueue": 0, "Run": 1028, "Wait": 336, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 28, "core": 6},"50944": {"num_run": 28, "core": 15},"26660": {"num_run": 28, "core": 18},"4492": {"num_run": 28, "core": 1},"58992": {"num_run": 28, "core": 19},"6948": {"num_run": 28, "core": 5},"23204": {"num_run": 28, "core": 9},"38556": {"num_run": 27, "core": 8},"60516": {"num_run": 28, "core": 14},"17584": {"num_run": 28, "core": 11},"59336": {"num_run": 28, "core": 10}}},"activation_size" : "36372480"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :6898,"ts" :2516331627,"ph" : "X","name" :"node_conv1d_15_kernel_time","args" : {"provider" : "CPUExecutionProvider","output_type_shape" : [{"float":[1,384,11840]}],"mem_bytes_requested_in_use" : "57360464","mem_arena_held" : "134217808","mem_arena_held_delta" : "0","activation_size" : "18186240","input_type_shape" : [{"float":[1,384,11840]},{"float":[384,384,1]},{"float":[384]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 7, "Distribution": 0, "DistributionEnqueue": 0, "Run": 4072, "Wait": 2078, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 29, "core": 6},"50944": {"num_run": 29, "core": 15},"26660": {"num_run": 29, "core": 18},"4492": {"num_run": 29, "core": 1},"58992": {"num_run": 29, "core": 19},"6948": {"num_run": 29, "core": 5},"23204": {"num_run": 29, "core": 9},"38556": {"num_run": 28, "core": 8},"60516": {"num_run": 29, "core": 14},"17584": {"num_run": 29, "core": 11},"59336": {"num_run": 29, "core": 10}}},"node_index" : "617","mem_bytes_in_use" : "67289168","output_size" : "18186240","op_name" : "Conv","mem_in_use_peak" : "98811984","mem_requested_in_use_delta" : "0","mem_in_use_delta" : "0","parameter_size" : "591360"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1389,"ts" :2516338543,"ph" : "X","name" :"node_add_74_kernel_time","args" : {"provider" : "CPUExecutionProvider","mem_arena_held_delta" : "0","mem_in_use_delta" : "0","parameter_size" : "0","input_type_shape" : [{"float":[1,384,11840]},{"float":[1,384,11840]}],"mem_bytes_requested_in_use" : "57360464","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [94720], "core": 7, "Distribution": 2, "DistributionEnqueue": 1, "Run": 1031, "Wait": 307, "WaitRevoke": 4}, "sub_threads": {"20368": {"num_run": 30, "core": 8},"50944": {"num_run": 30, "core": 15},"26660": {"num_run": 30, "core": 18},"4492": {"num_run": 30, "core": 14},"58992": {"num_run": 30, "core": 19},"6948": {"num_run": 30, "core": 18},"23204": {"num_run": 30, "core": 9},"38556": {"num_run": 29, "core": 11},"60516": {"num_run": 30, "core": 9},"17584": {"num_run": 30, "core": 5},"59336": {"num_run": 30, "core": 6}}},"node_index" : "618","op_name" : "Add","mem_in_use_peak" : "98811984","output_size" : "18186240","output_type_shape" : [{"float":[1,384,11840]}],"activation_size" : "36372480","mem_bytes_in_use" : "67289168","mem_requested_in_use_delta" : "0","mem_arena_held" : "134217808"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :873,"ts" :2516339939,"ph" : "X","name" :"node_mul_122_kernel_time","args" : {"mem_in_use_delta" : "0","output_type_shape" : [{"float":[1,384,11840]}],"op_name" : "Mul","parameter_size" : "1536","mem_bytes_in_use" : "67289168","provider" : "CPUExecutionProvider","mem_bytes_requested_in_use" : "57360464","mem_requested_in_use_delta" : "0","mem_arena_held_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [8], "core": 7, "Distribution": 0, "DistributionEnqueue": 0, "Run": 672, "Wait": 168, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 31, "core": 8},"50944": {"num_run": 31, "core": 15},"26660": {"num_run": 31, "core": 18},"4492": {"num_run": 31, "core": 14},"58992": {"num_run": 31, "core": 19},"6948": {"num_run": 31, "core": 18},"23204": {"num_run": 31, "core": 10},"38556": {"num_run": 30, "core": 11},"60516": {"num_run": 31, "core": 9},"17584": {"num_run": 31, "core": 5},"59336": {"num_run": 31, "core": 6}}},"input_type_shape" : [{"float":[1,384,11840]},{"float":[1,384,1]}],"mem_arena_held" : "134217808","output_size" : "18186240","mem_in_use_peak" : "98811984","node_index" : "619","activation_size" : "18186240"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :7096,"ts" :2516340819,"ph" : "X","name" :"node_sin_15_kernel_time","args" : {"op_name" : "Sin","activation_size" : "18186240","mem_bytes_in_use" : "67289168","parameter_size" : "0","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "57360464","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 7, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 31, "core": 8},"50944": {"num_run": 31, "core": 15},"26660": {"num_run": 31, "core": 18},"4492": {"num_run": 31, "core": 14},"58992": {"num_run": 31, "core": 19},"6948": {"num_run": 31, "core": 18},"23204": {"num_run": 31, "core": 10},"38556": {"num_run": 30, "core": 11},"60516": {"num_run": 31, "core": 9},"17584": {"num_run": 31, "core": 5},"59336": {"num_run": 31, "core": 6}}},"output_type_shape" : [{"float":[1,384,11840]}],"mem_in_use_peak" : "98811984","input_type_shape" : [{"float":[1,384,11840]}],"mem_in_use_delta" : "0","mem_arena_held" : "134217808","output_size" : "18186240","provider" : "CPUExecutionProvider","node_index" : "620","mem_requested_in_use_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :931,"ts" :2516347934,"ph" : "X","name" :"node_pow_32_kernel_time","args" : {"provider" : "CPUExecutionProvider","mem_arena_held" : "134217808","mem_in_use_delta" : "0","output_type_shape" : [{"float":[1,384,11840]}],"parameter_size" : "4","activation_size" : "18186240","mem_bytes_in_use" : "67289168","mem_in_use_peak" : "98811984","input_type_shape" : [{"float":[1,384,11840]},{"float":[]}],"op_name" : "Pow","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [94720], "core": 0, "Distribution": 2, "DistributionEnqueue": 0, "Run": 674, "Wait": 205, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 32, "core": 8},"50944": {"num_run": 32, "core": 15},"26660": {"num_run": 32, "core": 13},"4492": {"num_run": 32, "core": 14},"58992": {"num_run": 32, "core": 19},"6948": {"num_run": 32, "core": 18},"23204": {"num_run": 32, "core": 10},"38556": {"num_run": 31, "core": 11},"60516": {"num_run": 32, "core": 9},"17584": {"num_run": 32, "core": 5},"59336": {"num_run": 32, "core": 6}}},"mem_requested_in_use_delta" : "0","mem_bytes_requested_in_use" : "57360464","output_size" : "18186240","node_index" : "621","mem_arena_held_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :716,"ts" :2516348870,"ph" : "X","name" :"node_mul_123_kernel_time","args" : {"mem_arena_held" : "134217808","input_type_shape" : [{"float":[1,384,1]},{"float":[1,384,11840]}],"parameter_size" : "1536","output_type_shape" : [{"float":[1,384,11840]}],"mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "57360464","mem_requested_in_use_delta" : "0","op_name" : "Mul","output_size" : "18186240","mem_in_use_peak" : "98811984","provider" : "CPUExecutionProvider","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [8], "core": 0, "Distribution": 0, "DistributionEnqueue": 0, "Run": 586, "Wait": 27, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 33, "core": 8},"50944": {"num_run": 33, "core": 15},"26660": {"num_run": 33, "core": 13},"4492": {"num_run": 33, "core": 14},"58992": {"num_run": 33, "core": 19},"6948": {"num_run": 33, "core": 18},"23204": {"num_run": 33, "core": 10},"38556": {"num_run": 32, "core": 11},"60516": {"num_run": 33, "core": 9},"17584": {"num_run": 33, "core": 5},"59336": {"num_run": 33, "core": 6}}},"mem_bytes_in_use" : "67289168","mem_in_use_delta" : "0","activation_size" : "18186240","node_index" : "622"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1110,"ts" :2516349613,"ph" : "X","name" :"node_add_75_kernel_time","args" : {"op_name" : "Add","mem_arena_held_delta" : "0","output_size" : "18186240","mem_in_use_peak" : "98811984","output_type_shape" : [{"float":[1,384,11840]}],"input_type_shape" : [{"float":[1,384,11840]},{"float":[1,384,11840]}],"activation_size" : "36372480","mem_bytes_in_use" : "67289168","provider" : "CPUExecutionProvider","parameter_size" : "0","mem_in_use_delta" : "0","mem_requested_in_use_delta" : "0","mem_bytes_requested_in_use" : "57360464","mem_arena_held" : "134217808","node_index" : "623","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [94720], "core": 18, "Distribution": 1, "DistributionEnqueue": 0, "Run": 992, "Wait": 51, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 34, "core": 3},"50944": {"num_run": 34, "core": 15},"26660": {"num_run": 34, "core": 13},"4492": {"num_run": 34, "core": 14},"58992": {"num_run": 34, "core": 19},"6948": {"num_run": 34, "core": 5},"23204": {"num_run": 34, "core": 10},"38556": {"num_run": 33, "core": 8},"60516": {"num_run": 34, "core": 9},"17584": {"num_run": 34, "core": 11},"59336": {"num_run": 34, "core": 0}}}}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :49,"ts" :2516350748,"ph" : "X","name" :"node_convolution_4__edge_unsqueeze_kernel_time","args" : {"mem_bytes_requested_in_use" : "20987984","mem_arena_held_delta" : "0","op_name" : "Unsqueeze","mem_in_use_delta" : "0","provider" : "CPUExecutionProvider","mem_arena_held" : "134217808","output_size" : "18186240","mem_in_use_peak" : "98811984","input_type_shape" : [{"float":[1,384,11840]},{"int64":[1]}],"node_index" : "624","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 18, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 34, "core": 3},"50944": {"num_run": 34, "core": 15},"26660": {"num_run": 34, "core": 13},"4492": {"num_run": 34, "core": 14},"58992": {"num_run": 34, "core": 19},"6948": {"num_run": 34, "core": 5},"23204": {"num_run": 34, "core": 10},"38556": {"num_run": 33, "core": 8},"60516": {"num_run": 34, "core": 9},"17584": {"num_run": 34, "core": 11},"59336": {"num_run": 34, "core": 0}}},"mem_bytes_in_use" : "30916688","mem_requested_in_use_delta" : "0","output_type_shape" : [{"float":[1,384,1,11840]}],"activation_size" : "18186240","parameter_size" : "8"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :49762,"ts" :2516350805,"ph" : "X","name" :"node_convolution_4__edge_2d_kernel_time","args" : {"mem_bytes_requested_in_use" : "57363536","node_index" : "625","mem_in_use_peak" : "232243280","mem_arena_held" : "268435536","mem_arena_held_delta" : "134217728","mem_requested_in_use_delta" : "36375552","mem_in_use_delta" : "67108864","input_type_shape" : [{"float":[1,384,1,11840]},{"float":[192]}],"mem_bytes_in_use" : "98025552","op_name" : "ConvTranspose","output_size" : "36375552","provider" : "CPUExecutionProvider","parameter_size" : "768","activation_size" : "18186240","output_type_shape" : [{"float":[1,192,1,47364]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 18, "Distribution": 2, "DistributionEnqueue": 0, "Run": 22033, "Wait": 10272, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 35, "core": 5},"50944": {"num_run": 35, "core": 9},"26660": {"num_run": 35, "core": 20},"4492": {"num_run": 35, "core": 22},"58992": {"num_run": 35, "core": 16},"6948": {"num_run": 35, "core": 7},"23204": {"num_run": 35, "core": 8},"38556": {"num_run": 34, "core": 15},"60516": {"num_run": 35, "core": 10},"17584": {"num_run": 35, "core": 14},"59336": {"num_run": 35, "core": 6}}}}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :45,"ts" :2516400600,"ph" : "X","name" :"node_convolution_4__edge_squeeze_kernel_time","args" : {"mem_arena_held" : "268435536","parameter_size" : "8","mem_in_use_delta" : "0","mem_requested_in_use_delta" : "0","output_size" : "36375552","node_index" : "626","output_type_shape" : [{"float":[1,192,47364]}],"mem_bytes_in_use" : "71745616","op_name" : "Squeeze","provider" : "CPUExecutionProvider","mem_in_use_peak" : "232243280","input_type_shape" : [{"float":[1,192,1,47364]},{"int64":[1]}],"activation_size" : "36375552","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "39177296","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 18, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 35, "core": 5},"50944": {"num_run": 35, "core": 9},"26660": {"num_run": 35, "core": 20},"4492": {"num_run": 35, "core": 22},"58992": {"num_run": 35, "core": 16},"6948": {"num_run": 35, "core": 7},"23204": {"num_run": 35, "core": 8},"38556": {"num_run": 34, "core": 15},"60516": {"num_run": 35, "core": 10},"17584": {"num_run": 35, "core": 14},"59336": {"num_run": 35, "core": 6}}}}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2514,"ts" :2516400650,"ph" : "X","name" :"node_slice_41_kernel_time","args" : {"provider" : "CPUExecutionProvider","mem_in_use_peak" : "232243280","mem_arena_held_delta" : "0","mem_requested_in_use_delta" : "36372480","input_type_shape" : [{"float":[1,192,47364]},{"int64":[1]},{"int64":[1]},{"int64":[1]},{"int64":[1]}],"parameter_size" : "32","mem_arena_held" : "268435536","mem_in_use_delta" : "36372480","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 18, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 35, "core": 5},"50944": {"num_run": 35, "core": 9},"26660": {"num_run": 35, "core": 20},"4492": {"num_run": 35, "core": 22},"58992": {"num_run": 35, "core": 16},"6948": {"num_run": 35, "core": 7},"23204": {"num_run": 35, "core": 8},"38556": {"num_run": 34, "core": 15},"60516": {"num_run": 35, "core": 10},"17584": {"num_run": 35, "core": 14},"59336": {"num_run": 35, "core": 6}}},"mem_bytes_requested_in_use" : "75549776","output_size" : "36372480","node_index" : "627","activation_size" : "36375552","mem_bytes_in_use" : "108118096","output_type_shape" : [{"float":[1,192,47360]}],"op_name" : "Slice"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1936,"ts" :2516403182,"ph" : "X","name" :"node_mul_124_kernel_time","args" : {"mem_in_use_delta" : "67108864","op_name" : "Mul","provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "36372480","output_size" : "36372480","mem_bytes_in_use" : "108118096","output_type_shape" : [{"float":[1,192,47360]}],"mem_arena_held" : "268435536","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,1]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 8, "Distribution": 2, "DistributionEnqueue": 1, "Run": 1698, "Wait": 115, "WaitRevoke": 7}, "sub_threads": {"20368": {"num_run": 36, "core": 4},"50944": {"num_run": 36, "core": 16},"26660": {"num_run": 36, "core": 23},"4492": {"num_run": 36, "core": 14},"58992": {"num_run": 36, "core": 18},"6948": {"num_run": 36, "core": 5},"23204": {"num_run": 36, "core": 15},"38556": {"num_run": 35, "core": 10},"60516": {"num_run": 36, "core": 19},"17584": {"num_run": 36, "core": 9},"59336": {"num_run": 36, "core": 11}}},"mem_arena_held_delta" : "0","parameter_size" : "768","activation_size" : "36372480","node_index" : "628","mem_in_use_peak" : "232243280","mem_bytes_requested_in_use" : "75546704"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :17154,"ts" :2516405133,"ph" : "X","name" :"node_sin_16_kernel_time","args" : {"mem_requested_in_use_delta" : "36372480","activation_size" : "36372480","output_type_shape" : [{"float":[1,192,47360]}],"parameter_size" : "0","mem_arena_held" : "268435536","mem_in_use_peak" : "232243280","mem_arena_held_delta" : "0","output_size" : "36372480","mem_bytes_in_use" : "144490576","op_name" : "Sin","input_type_shape" : [{"float":[1,192,47360]}],"node_index" : "629","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 8, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 36, "core": 4},"50944": {"num_run": 36, "core": 16},"26660": {"num_run": 36, "core": 23},"4492": {"num_run": 36, "core": 14},"58992": {"num_run": 36, "core": 18},"6948": {"num_run": 36, "core": 5},"23204": {"num_run": 36, "core": 15},"38556": {"num_run": 35, "core": 10},"60516": {"num_run": 36, "core": 19},"17584": {"num_run": 36, "core": 9},"59336": {"num_run": 36, "core": 11}}},"mem_in_use_delta" : "36372480","mem_bytes_requested_in_use" : "111919184","provider" : "CPUExecutionProvider"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2057,"ts" :2516422311,"ph" : "X","name" :"node_pow_33_kernel_time","args" : {"op_name" : "Pow","provider" : "CPUExecutionProvider","node_index" : "630","parameter_size" : "4","output_type_shape" : [{"float":[1,192,47360]}],"mem_bytes_in_use" : "144490576","mem_in_use_delta" : "0","mem_arena_held" : "268435536","mem_requested_in_use_delta" : "0","activation_size" : "36372480","output_size" : "36372480","mem_in_use_peak" : "232243280","input_type_shape" : [{"float":[1,192,47360]},{"float":[]}],"mem_bytes_requested_in_use" : "111919184","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 4, "Distribution": 2, "DistributionEnqueue": 0, "Run": 1730, "Wait": 227, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 37, "core": 20},"50944": {"num_run": 37, "core": 14},"26660": {"num_run": 37, "core": 3},"4492": {"num_run": 37, "core": 18},"58992": {"num_run": 37, "core": 15},"6948": {"num_run": 37, "core": 11},"23204": {"num_run": 37, "core": 4},"38556": {"num_run": 36, "core": 12},"60516": {"num_run": 37, "core": 7},"17584": {"num_run": 37, "core": 13},"59336": {"num_run": 37, "core": 23}}},"mem_arena_held_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2167,"ts" :2516424384,"ph" : "X","name" :"node_mul_125_kernel_time","args" : {"activation_size" : "36372480","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 6, "Distribution": 1, "DistributionEnqueue": 0, "Run": 1999, "Wait": 81, "WaitRevoke": 4}, "sub_threads": {"20368": {"num_run": 38, "core": 20},"50944": {"num_run": 38, "core": 14},"26660": {"num_run": 38, "core": 3},"4492": {"num_run": 38, "core": 18},"58992": {"num_run": 38, "core": 15},"6948": {"num_run": 38, "core": 11},"23204": {"num_run": 38, "core": 4},"38556": {"num_run": 37, "core": 12},"60516": {"num_run": 38, "core": 7},"17584": {"num_run": 38, "core": 13},"59336": {"num_run": 38, "core": 23}}},"mem_in_use_peak" : "232243280","output_size" : "36372480","provider" : "CPUExecutionProvider","parameter_size" : "768","mem_arena_held_delta" : "0","output_type_shape" : [{"float":[1,192,47360]}],"input_type_shape" : [{"float":[1,192,1]},{"float":[1,192,47360]}],"mem_arena_held" : "268435536","node_index" : "631","op_name" : "Mul","mem_bytes_in_use" : "144490576","mem_bytes_requested_in_use" : "111919184","mem_requested_in_use_delta" : "0","mem_in_use_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2992,"ts" :2516426567,"ph" : "X","name" :"node_add_76_kernel_time","args" : {"mem_bytes_requested_in_use" : "111919184","mem_in_use_peak" : "232243280","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 5, "Distribution": 1, "DistributionEnqueue": 0, "Run": 2726, "Wait": 179, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 39, "core": 20},"50944": {"num_run": 39, "core": 14},"26660": {"num_run": 39, "core": 3},"4492": {"num_run": 39, "core": 18},"58992": {"num_run": 39, "core": 15},"6948": {"num_run": 39, "core": 11},"23204": {"num_run": 39, "core": 4},"38556": {"num_run": 38, "core": 12},"60516": {"num_run": 39, "core": 7},"17584": {"num_run": 39, "core": 13},"59336": {"num_run": 39, "core": 23}}},"op_name" : "Add","mem_bytes_in_use" : "144490576","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,47360]}],"mem_arena_held_delta" : "0","mem_arena_held" : "268435536","node_index" : "632","output_type_shape" : [{"float":[1,192,47360]}],"mem_in_use_delta" : "0","activation_size" : "72744960","provider" : "CPUExecutionProvider","output_size" : "36372480","mem_requested_in_use_delta" : "0","parameter_size" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :38470,"ts" :2516429572,"ph" : "X","name" :"node_conv1d_16_kernel_time","args" : {"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 5, "Distribution": 1, "DistributionEnqueue": 0, "Run": 26404, "Wait": 11908, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 40, "core": 11},"50944": {"num_run": 40, "core": 15},"26660": {"num_run": 40, "core": 19},"4492": {"num_run": 40, "core": 4},"58992": {"num_run": 40, "core": 14},"6948": {"num_run": 40, "core": 4},"23204": {"num_run": 40, "core": 13},"38556": {"num_run": 39, "core": 7},"60516": {"num_run": 40, "core": 8},"17584": {"num_run": 40, "core": 5},"59336": {"num_run": 40, "core": 23}}},"mem_in_use_delta" : "0","node_index" : "633","mem_in_use_peak" : "232243280","mem_bytes_in_use" : "144490576","output_size" : "36372480","input_type_shape" : [{"float":[1,192,47360]},{"float":[192,192,7]},{"float":[192]}],"activation_size" : "36372480","provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "0","output_type_shape" : [{"float":[1,192,47360]}],"parameter_size" : "1032960","op_name" : "Conv","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "111919184","mem_arena_held" : "268435536"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2446,"ts" :2516468065,"ph" : "X","name" :"node_mul_126_kernel_time","args" : {"mem_bytes_in_use" : "144490576","mem_in_use_delta" : "0","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,1]}],"provider" : "CPUExecutionProvider","op_name" : "Mul","mem_arena_held_delta" : "0","activation_size" : "36372480","mem_bytes_requested_in_use" : "111919184","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 9, "Distribution": 3, "DistributionEnqueue": 1, "Run": 2332, "Wait": 3, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 41, "core": 11},"50944": {"num_run": 41, "core": 15},"26660": {"num_run": 41, "core": 3},"4492": {"num_run": 41, "core": 4},"58992": {"num_run": 41, "core": 14},"6948": {"num_run": 41, "core": 4},"23204": {"num_run": 41, "core": 13},"38556": {"num_run": 40, "core": 7},"60516": {"num_run": 41, "core": 10},"17584": {"num_run": 41, "core": 5},"59336": {"num_run": 41, "core": 8}}},"node_index" : "634","mem_arena_held" : "268435536","mem_requested_in_use_delta" : "0","parameter_size" : "768","mem_in_use_peak" : "232243280","output_size" : "36372480","output_type_shape" : [{"float":[1,192,47360]}]}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :25965,"ts" :2516470532,"ph" : "X","name" :"node_sin_17_kernel_time","args" : {"activation_size" : "36372480","output_size" : "36372480","mem_in_use_delta" : "61472768","op_name" : "Sin","mem_bytes_in_use" : "205963344","mem_arena_held" : "268435536","input_type_shape" : [{"float":[1,192,47360]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 9, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 41, "core": 11},"50944": {"num_run": 41, "core": 15},"26660": {"num_run": 41, "core": 3},"4492": {"num_run": 41, "core": 4},"58992": {"num_run": 41, "core": 14},"6948": {"num_run": 41, "core": 4},"23204": {"num_run": 41, "core": 13},"38556": {"num_run": 40, "core": 7},"60516": {"num_run": 41, "core": 10},"17584": {"num_run": 41, "core": 5},"59336": {"num_run": 41, "core": 8}}},"output_type_shape" : [{"float":[1,192,47360]}],"mem_bytes_requested_in_use" : "148291664","node_index" : "635","mem_in_use_peak" : "232243280","mem_arena_held_delta" : "0","provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "36372480","parameter_size" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1905,"ts" :2516496518,"ph" : "X","name" :"node_pow_34_kernel_time","args" : {"mem_in_use_delta" : "0","provider" : "CPUExecutionProvider","mem_arena_held" : "268435536","output_type_shape" : [{"float":[1,192,47360]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 14, "Distribution": 2, "DistributionEnqueue": 1, "Run": 1818, "Wait": 5, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 42, "core": 13},"50944": {"num_run": 42, "core": 18},"26660": {"num_run": 42, "core": 10},"4492": {"num_run": 42, "core": 15},"58992": {"num_run": 42, "core": 12},"6948": {"num_run": 42, "core": 11},"23204": {"num_run": 42, "core": 8},"38556": {"num_run": 41, "core": 6},"60516": {"num_run": 42, "core": 5},"17584": {"num_run": 42, "core": 9},"59336": {"num_run": 42, "core": 7}}},"input_type_shape" : [{"float":[1,192,47360]},{"float":[]}],"activation_size" : "36372480","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "148291664","node_index" : "636","output_size" : "36372480","mem_bytes_in_use" : "205963344","op_name" : "Pow","parameter_size" : "4","mem_requested_in_use_delta" : "0","mem_in_use_peak" : "232243280"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1884,"ts" :2516498437,"ph" : "X","name" :"node_mul_127_kernel_time","args" : {"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 14, "Distribution": 1, "DistributionEnqueue": 0, "Run": 1710, "Wait": 119, "WaitRevoke": 4}, "sub_threads": {"20368": {"num_run": 43, "core": 13},"50944": {"num_run": 43, "core": 18},"26660": {"num_run": 43, "core": 10},"4492": {"num_run": 43, "core": 15},"58992": {"num_run": 43, "core": 12},"6948": {"num_run": 43, "core": 11},"23204": {"num_run": 43, "core": 8},"38556": {"num_run": 42, "core": 6},"60516": {"num_run": 43, "core": 5},"17584": {"num_run": 43, "core": 9},"59336": {"num_run": 43, "core": 7}}},"mem_requested_in_use_delta" : "0","mem_in_use_delta" : "0","node_index" : "637","mem_bytes_in_use" : "205963344","op_name" : "Mul","provider" : "CPUExecutionProvider","parameter_size" : "768","activation_size" : "36372480","mem_arena_held_delta" : "0","mem_in_use_peak" : "232243280","output_size" : "36372480","input_type_shape" : [{"float":[1,192,1]},{"float":[1,192,47360]}],"mem_bytes_requested_in_use" : "148291664","mem_arena_held" : "268435536","output_type_shape" : [{"float":[1,192,47360]}]}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2674,"ts" :2516500333,"ph" : "X","name" :"node_add_77_kernel_time","args" : {"mem_bytes_requested_in_use" : "148291664","mem_requested_in_use_delta" : "0","mem_in_use_delta" : "0","mem_bytes_in_use" : "205963344","mem_in_use_peak" : "232243280","node_index" : "638","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 14, "Distribution": 1, "DistributionEnqueue": 0, "Run": 2595, "Wait": 3, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 44, "core": 13},"50944": {"num_run": 44, "core": 18},"26660": {"num_run": 44, "core": 10},"4492": {"num_run": 44, "core": 15},"58992": {"num_run": 44, "core": 12},"6948": {"num_run": 44, "core": 11},"23204": {"num_run": 44, "core": 8},"38556": {"num_run": 43, "core": 6},"60516": {"num_run": 44, "core": 5},"17584": {"num_run": 44, "core": 9},"59336": {"num_run": 44, "core": 7}}},"activation_size" : "72744960","output_type_shape" : [{"float":[1,192,47360]}],"mem_arena_held" : "268435536","provider" : "CPUExecutionProvider","mem_arena_held_delta" : "0","parameter_size" : "0","output_size" : "36372480","op_name" : "Add","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,47360]}]}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :8190,"ts" :2516503021,"ph" : "X","name" :"node_conv1d_17_kernel_time","args" : {"mem_bytes_requested_in_use" : "148291664","input_type_shape" : [{"float":[1,192,47360]},{"float":[192,192,1]},{"float":[192]}],"mem_arena_held_delta" : "0","mem_arena_held" : "268435536","activation_size" : "36372480","output_type_shape" : [{"float":[1,192,47360]}],"mem_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 14, "Distribution": 1, "DistributionEnqueue": 0, "Run": 6457, "Wait": 55, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 45, "core": 13},"50944": {"num_run": 45, "core": 10},"26660": {"num_run": 45, "core": 13},"4492": {"num_run": 45, "core": 15},"58992": {"num_run": 45, "core": 3},"6948": {"num_run": 45, "core": 12},"23204": {"num_run": 45, "core": 23},"38556": {"num_run": 44, "core": 6},"60516": {"num_run": 45, "core": 5},"17584": {"num_run": 45, "core": 4},"59336": {"num_run": 45, "core": 7}}},"node_index" : "639","op_name" : "Conv","mem_in_use_peak" : "232243280","mem_requested_in_use_delta" : "0","output_size" : "36372480","provider" : "CPUExecutionProvider","mem_bytes_in_use" : "205963344","parameter_size" : "148224"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2961,"ts" :2516511235,"ph" : "X","name" :"node_add_78_kernel_time","args" : {"provider" : "CPUExecutionProvider","mem_in_use_peak" : "232243280","activation_size" : "72744960","mem_bytes_in_use" : "205963344","mem_in_use_delta" : "0","parameter_size" : "0","mem_arena_held" : "268435536","node_index" : "640","mem_requested_in_use_delta" : "0","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,47360]}],"output_size" : "36372480","mem_arena_held_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 11, "Distribution": 3, "DistributionEnqueue": 0, "Run": 2765, "Wait": 88, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 46, "core": 6},"50944": {"num_run": 46, "core": 10},"26660": {"num_run": 46, "core": 13},"4492": {"num_run": 46, "core": 15},"58992": {"num_run": 46, "core": 3},"6948": {"num_run": 46, "core": 12},"23204": {"num_run": 46, "core": 23},"38556": {"num_run": 45, "core": 8},"60516": {"num_run": 46, "core": 13},"17584": {"num_run": 46, "core": 4},"59336": {"num_run": 46, "core": 9}}},"output_type_shape" : [{"float":[1,192,47360]}],"op_name" : "Add","mem_bytes_requested_in_use" : "148291664"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2170,"ts" :2516514213,"ph" : "X","name" :"node_mul_128_kernel_time","args" : {"op_name" : "Mul","activation_size" : "36372480","parameter_size" : "768","mem_arena_held_delta" : "0","node_index" : "641","output_type_shape" : [{"float":[1,192,47360]}],"mem_bytes_in_use" : "205963344","mem_in_use_peak" : "232243280","output_size" : "36372480","mem_bytes_requested_in_use" : "148291664","mem_in_use_delta" : "0","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,1]}],"mem_requested_in_use_delta" : "0","provider" : "CPUExecutionProvider","mem_arena_held" : "268435536","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 11, "Distribution": 2, "DistributionEnqueue": 0, "Run": 1832, "Wait": 251, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 47, "core": 6},"50944": {"num_run": 47, "core": 10},"26660": {"num_run": 47, "core": 13},"4492": {"num_run": 47, "core": 15},"58992": {"num_run": 47, "core": 3},"6948": {"num_run": 47, "core": 12},"23204": {"num_run": 47, "core": 23},"38556": {"num_run": 46, "core": 8},"60516": {"num_run": 47, "core": 13},"17584": {"num_run": 47, "core": 4},"59336": {"num_run": 47, "core": 9}}}}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :20578,"ts" :2516516404,"ph" : "X","name" :"node_sin_18_kernel_time","args" : {"parameter_size" : "0","input_type_shape" : [{"float":[1,192,47360]}],"mem_arena_held_delta" : "0","provider" : "CPUExecutionProvider","op_name" : "Sin","mem_bytes_in_use" : "205963344","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 11, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 47, "core": 6},"50944": {"num_run": 47, "core": 10},"26660": {"num_run": 47, "core": 13},"4492": {"num_run": 47, "core": 15},"58992": {"num_run": 47, "core": 3},"6948": {"num_run": 47, "core": 12},"23204": {"num_run": 47, "core": 23},"38556": {"num_run": 46, "core": 8},"60516": {"num_run": 47, "core": 13},"17584": {"num_run": 47, "core": 4},"59336": {"num_run": 47, "core": 9}}},"output_size" : "36372480","activation_size" : "36372480","mem_in_use_peak" : "232243280","output_type_shape" : [{"float":[1,192,47360]}],"mem_arena_held" : "268435536","mem_requested_in_use_delta" : "0","mem_in_use_delta" : "0","mem_bytes_requested_in_use" : "148291664","node_index" : "642"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2083,"ts" :2516537010,"ph" : "X","name" :"node_pow_35_kernel_time","args" : {"parameter_size" : "4","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 14, "Distribution": 3, "DistributionEnqueue": 1, "Run": 1940, "Wait": 47, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 48, "core": 19},"50944": {"num_run": 48, "core": 5},"26660": {"num_run": 48, "core": 18},"4492": {"num_run": 48, "core": 3},"58992": {"num_run": 48, "core": 15},"6948": {"num_run": 48, "core": 9},"23204": {"num_run": 48, "core": 8},"38556": {"num_run": 47, "core": 2},"60516": {"num_run": 48, "core": 4},"17584": {"num_run": 48, "core": 10},"59336": {"num_run": 48, "core": 11}}},"node_index" : "643","mem_in_use_delta" : "0","output_type_shape" : [{"float":[1,192,47360]}],"input_type_shape" : [{"float":[1,192,47360]},{"float":[]}],"output_size" : "36372480","mem_arena_held" : "268435536","activation_size" : "36372480","mem_bytes_requested_in_use" : "148291664","mem_in_use_peak" : "232243280","mem_arena_held_delta" : "0","op_name" : "Pow","mem_requested_in_use_delta" : "0","mem_bytes_in_use" : "205963344","provider" : "CPUExecutionProvider"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2138,"ts" :2516539113,"ph" : "X","name" :"node_mul_129_kernel_time","args" : {"mem_requested_in_use_delta" : "0","mem_arena_held" : "268435536","mem_in_use_peak" : "232243280","parameter_size" : "768","mem_bytes_in_use" : "205963344","node_index" : "644","mem_in_use_delta" : "0","provider" : "CPUExecutionProvider","activation_size" : "36372480","mem_bytes_requested_in_use" : "148291664","input_type_shape" : [{"float":[1,192,1]},{"float":[1,192,47360]}],"output_size" : "36372480","op_name" : "Mul","mem_arena_held_delta" : "0","output_type_shape" : [{"float":[1,192,47360]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 14, "Distribution": 0, "DistributionEnqueue": 0, "Run": 1981, "Wait": 61, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 49, "core": 19},"50944": {"num_run": 49, "core": 5},"26660": {"num_run": 49, "core": 18},"4492": {"num_run": 49, "core": 3},"58992": {"num_run": 49, "core": 15},"6948": {"num_run": 49, "core": 9},"23204": {"num_run": 49, "core": 8},"38556": {"num_run": 48, "core": 2},"60516": {"num_run": 49, "core": 4},"17584": {"num_run": 49, "core": 10},"59336": {"num_run": 49, "core": 11}}}}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3065,"ts" :2516541267,"ph" : "X","name" :"node_add_79_kernel_time","args" : {"mem_requested_in_use_delta" : "0","mem_in_use_peak" : "232243280","output_type_shape" : [{"float":[1,192,47360]}],"mem_bytes_requested_in_use" : "148291664","mem_arena_held_delta" : "0","node_index" : "645","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,47360]}],"mem_arena_held" : "268435536","mem_in_use_delta" : "0","op_name" : "Add","activation_size" : "72744960","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 15, "Distribution": 1, "DistributionEnqueue": 0, "Run": 2612, "Wait": 358, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 50, "core": 19},"50944": {"num_run": 50, "core": 5},"26660": {"num_run": 50, "core": 18},"4492": {"num_run": 50, "core": 3},"58992": {"num_run": 50, "core": 15},"6948": {"num_run": 50, "core": 9},"23204": {"num_run": 50, "core": 8},"38556": {"num_run": 49, "core": 2},"60516": {"num_run": 50, "core": 4},"17584": {"num_run": 50, "core": 10},"59336": {"num_run": 50, "core": 11}}},"output_size" : "36372480","parameter_size" : "0","mem_bytes_in_use" : "205963344","provider" : "CPUExecutionProvider"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :35810,"ts" :2516544349,"ph" : "X","name" :"node_conv1d_18_kernel_time","args" : {"mem_bytes_in_use" : "205963344","provider" : "CPUExecutionProvider","activation_size" : "36372480","output_type_shape" : [{"float":[1,192,47360]}],"mem_requested_in_use_delta" : "0","mem_arena_held_delta" : "0","mem_arena_held" : "268435536","mem_in_use_delta" : "0","input_type_shape" : [{"float":[1,192,47360]},{"float":[192,192,7]},{"float":[192]}],"mem_in_use_peak" : "232243280","mem_bytes_requested_in_use" : "148291664","parameter_size" : "1032960","output_size" : "36372480","op_name" : "Conv","node_index" : "646","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 15, "Distribution": 2, "DistributionEnqueue": 0, "Run": 27892, "Wait": 7760, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 51, "core": 2},"50944": {"num_run": 51, "core": 5},"26660": {"num_run": 51, "core": 15},"4492": {"num_run": 51, "core": 23},"58992": {"num_run": 51, "core": 15},"6948": {"num_run": 51, "core": 17},"23204": {"num_run": 51, "core": 1},"38556": {"num_run": 50, "core": 23},"60516": {"num_run": 51, "core": 7},"17584": {"num_run": 51, "core": 5},"59336": {"num_run": 51, "core": 9}}}}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2349,"ts" :2516580186,"ph" : "X","name" :"node_mul_130_kernel_time","args" : {"input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,1]}],"output_size" : "36372480","op_name" : "Mul","mem_bytes_requested_in_use" : "148291664","mem_arena_held" : "268435536","provider" : "CPUExecutionProvider","output_type_shape" : [{"float":[1,192,47360]}],"node_index" : "647","mem_arena_held_delta" : "0","mem_in_use_peak" : "232243280","mem_in_use_delta" : "0","parameter_size" : "768","activation_size" : "36372480","mem_requested_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 16, "Distribution": 3, "DistributionEnqueue": 1, "Run": 1983, "Wait": 252, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 52, "core": 2},"50944": {"num_run": 52, "core": 5},"26660": {"num_run": 52, "core": 15},"4492": {"num_run": 52, "core": 23},"58992": {"num_run": 52, "core": 15},"6948": {"num_run": 52, "core": 17},"23204": {"num_run": 52, "core": 9},"38556": {"num_run": 51, "core": 23},"60516": {"num_run": 52, "core": 7},"17584": {"num_run": 52, "core": 20},"59336": {"num_run": 52, "core": 22}}},"mem_bytes_in_use" : "205963344"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :16780,"ts" :2516582554,"ph" : "X","name" :"node_sin_19_kernel_time","args" : {"input_type_shape" : [{"float":[1,192,47360]}],"output_size" : "36372480","mem_in_use_delta" : "0","node_index" : "648","mem_bytes_requested_in_use" : "148291664","mem_arena_held_delta" : "0","provider" : "CPUExecutionProvider","activation_size" : "36372480","op_name" : "Sin","mem_requested_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 16, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 52, "core": 2},"50944": {"num_run": 52, "core": 5},"26660": {"num_run": 52, "core": 15},"4492": {"num_run": 52, "core": 23},"58992": {"num_run": 52, "core": 15},"6948": {"num_run": 52, "core": 17},"23204": {"num_run": 52, "core": 9},"38556": {"num_run": 51, "core": 23},"60516": {"num_run": 52, "core": 7},"17584": {"num_run": 52, "core": 20},"59336": {"num_run": 52, "core": 22}}},"mem_arena_held" : "268435536","mem_in_use_peak" : "232243280","mem_bytes_in_use" : "205963344","output_type_shape" : [{"float":[1,192,47360]}],"parameter_size" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2026,"ts" :2516599358,"ph" : "X","name" :"node_pow_36_kernel_time","args" : {"mem_in_use_delta" : "0","op_name" : "Pow","mem_in_use_peak" : "232243280","mem_bytes_requested_in_use" : "148291664","provider" : "CPUExecutionProvider","mem_bytes_in_use" : "205963344","output_type_shape" : [{"float":[1,192,47360]}],"input_type_shape" : [{"float":[1,192,47360]},{"float":[]}],"mem_requested_in_use_delta" : "0","activation_size" : "36372480","mem_arena_held" : "268435536","output_size" : "36372480","mem_arena_held_delta" : "0","node_index" : "649","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 10, "Distribution": 2, "DistributionEnqueue": 0, "Run": 1891, "Wait": 45, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 53, "core": 11},"50944": {"num_run": 53, "core": 19},"26660": {"num_run": 53, "core": 18},"4492": {"num_run": 53, "core": 4},"58992": {"num_run": 53, "core": 6},"6948": {"num_run": 53, "core": 7},"23204": {"num_run": 53, "core": 12},"38556": {"num_run": 52, "core": 5},"60516": {"num_run": 53, "core": 15},"17584": {"num_run": 53, "core": 8},"59336": {"num_run": 53, "core": 14}}},"parameter_size" : "4"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1928,"ts" :2516601395,"ph" : "X","name" :"node_mul_131_kernel_time","args" : {"mem_requested_in_use_delta" : "0","mem_bytes_in_use" : "205963344","input_type_shape" : [{"float":[1,192,1]},{"float":[1,192,47360]}],"output_size" : "36372480","activation_size" : "36372480","mem_arena_held_delta" : "0","op_name" : "Mul","mem_in_use_peak" : "232243280","output_type_shape" : [{"float":[1,192,47360]}],"mem_arena_held" : "268435536","parameter_size" : "768","mem_in_use_delta" : "0","node_index" : "650","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 10, "Distribution": 0, "DistributionEnqueue": 0, "Run": 1781, "Wait": 79, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 54, "core": 11},"50944": {"num_run": 54, "core": 19},"26660": {"num_run": 54, "core": 18},"4492": {"num_run": 54, "core": 4},"58992": {"num_run": 54, "core": 6},"6948": {"num_run": 54, "core": 7},"23204": {"num_run": 54, "core": 12},"38556": {"num_run": 53, "core": 5},"60516": {"num_run": 54, "core": 15},"17584": {"num_run": 54, "core": 8},"59336": {"num_run": 54, "core": 14}}},"provider" : "CPUExecutionProvider","mem_bytes_requested_in_use" : "148291664"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3272,"ts" :2516603335,"ph" : "X","name" :"node_add_80_kernel_time","args" : {"mem_in_use_delta" : "0","mem_arena_held_delta" : "0","node_index" : "651","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,47360]}],"parameter_size" : "0","op_name" : "Add","output_size" : "36372480","activation_size" : "72744960","mem_bytes_in_use" : "205963344","mem_requested_in_use_delta" : "0","output_type_shape" : [{"float":[1,192,47360]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 10, "Distribution": 0, "DistributionEnqueue": 0, "Run": 3114, "Wait": 89, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 55, "core": 11},"50944": {"num_run": 55, "core": 19},"26660": {"num_run": 55, "core": 18},"4492": {"num_run": 55, "core": 4},"58992": {"num_run": 55, "core": 6},"6948": {"num_run": 55, "core": 7},"23204": {"num_run": 55, "core": 12},"38556": {"num_run": 54, "core": 5},"60516": {"num_run": 55, "core": 15},"17584": {"num_run": 55, "core": 8},"59336": {"num_run": 55, "core": 14}}},"provider" : "CPUExecutionProvider","mem_bytes_requested_in_use" : "148291664","mem_arena_held" : "268435536","mem_in_use_peak" : "232243280"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :7213,"ts" :2516606619,"ph" : "X","name" :"node_conv1d_19_kernel_time","args" : {"output_size" : "36372480","parameter_size" : "148224","mem_bytes_requested_in_use" : "148291664","mem_requested_in_use_delta" : "0","output_type_shape" : [{"float":[1,192,47360]}],"provider" : "CPUExecutionProvider","mem_bytes_in_use" : "205963344","mem_arena_held_delta" : "0","node_index" : "652","mem_in_use_delta" : "0","mem_arena_held" : "268435536","mem_in_use_peak" : "232243280","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 10, "Distribution": 1, "DistributionEnqueue": 0, "Run": 5057, "Wait": 535, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 56, "core": 15},"50944": {"num_run": 56, "core": 12},"26660": {"num_run": 56, "core": 19},"4492": {"num_run": 56, "core": 4},"58992": {"num_run": 56, "core": 6},"6948": {"num_run": 56, "core": 7},"23204": {"num_run": 56, "core": 12},"38556": {"num_run": 55, "core": 5},"60516": {"num_run": 56, "core": 9},"17584": {"num_run": 56, "core": 2},"59336": {"num_run": 56, "core": 10}}},"input_type_shape" : [{"float":[1,192,47360]},{"float":[192,192,1]},{"float":[192]}],"op_name" : "Conv","activation_size" : "36372480"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3632,"ts" :2516613855,"ph" : "X","name" :"node_add_81_kernel_time","args" : {"mem_in_use_peak" : "232243280","mem_requested_in_use_delta" : "0","parameter_size" : "0","mem_in_use_delta" : "0","mem_bytes_requested_in_use" : "148291664","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 4, "Distribution": 2, "DistributionEnqueue": 1, "Run": 2134, "Wait": 1423, "WaitRevoke": 4}, "sub_threads": {"20368": {"num_run": 57, "core": 15},"50944": {"num_run": 57, "core": 12},"26660": {"num_run": 57, "core": 19},"4492": {"num_run": 57, "core": 18},"58992": {"num_run": 57, "core": 5},"6948": {"num_run": 57, "core": 12},"23204": {"num_run": 57, "core": 11},"38556": {"num_run": 56, "core": 8},"60516": {"num_run": 57, "core": 9},"17584": {"num_run": 57, "core": 2},"59336": {"num_run": 57, "core": 10}}},"mem_arena_held_delta" : "0","node_index" : "653","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,47360]}],"output_type_shape" : [{"float":[1,192,47360]}],"activation_size" : "72744960","provider" : "CPUExecutionProvider","mem_arena_held" : "268435536","output_size" : "36372480","op_name" : "Add","mem_bytes_in_use" : "205963344"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1879,"ts" :2516617496,"ph" : "X","name" :"node_mul_132_kernel_time","args" : {"activation_size" : "36372480","node_index" : "654","mem_arena_held" : "268435536","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,1]}],"parameter_size" : "768","mem_in_use_delta" : "0","op_name" : "Mul","output_type_shape" : [{"float":[1,192,47360]}],"output_size" : "36372480","provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "0","mem_in_use_peak" : "232243280","mem_bytes_in_use" : "205963344","mem_arena_held_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 4, "Distribution": 1, "DistributionEnqueue": 0, "Run": 1682, "Wait": 132, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 58, "core": 15},"50944": {"num_run": 58, "core": 12},"26660": {"num_run": 58, "core": 19},"4492": {"num_run": 58, "core": 18},"58992": {"num_run": 58, "core": 5},"6948": {"num_run": 58, "core": 12},"23204": {"num_run": 58, "core": 11},"38556": {"num_run": 57, "core": 8},"60516": {"num_run": 58, "core": 9},"17584": {"num_run": 58, "core": 2},"59336": {"num_run": 58, "core": 10}}},"mem_bytes_requested_in_use" : "148291664"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :16760,"ts" :2516619385,"ph" : "X","name" :"node_sin_20_kernel_time","args" : {"output_size" : "36372480","parameter_size" : "0","mem_requested_in_use_delta" : "0","input_type_shape" : [{"float":[1,192,47360]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 4, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 58, "core": 15},"50944": {"num_run": 58, "core": 12},"26660": {"num_run": 58, "core": 19},"4492": {"num_run": 58, "core": 18},"58992": {"num_run": 58, "core": 5},"6948": {"num_run": 58, "core": 12},"23204": {"num_run": 58, "core": 11},"38556": {"num_run": 57, "core": 8},"60516": {"num_run": 58, "core": 9},"17584": {"num_run": 58, "core": 2},"59336": {"num_run": 58, "core": 10}}},"node_index" : "655","mem_in_use_peak" : "232243280","output_type_shape" : [{"float":[1,192,47360]}],"mem_in_use_delta" : "0","mem_arena_held_delta" : "0","mem_bytes_in_use" : "205963344","provider" : "CPUExecutionProvider","mem_arena_held" : "268435536","mem_bytes_requested_in_use" : "148291664","op_name" : "Sin","activation_size" : "36372480"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2029,"ts" :2516636168,"ph" : "X","name" :"node_pow_37_kernel_time","args" : {"parameter_size" : "4","activation_size" : "36372480","op_name" : "Pow","mem_arena_held_delta" : "0","mem_bytes_in_use" : "205963344","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 9, "Distribution": 2, "DistributionEnqueue": 0, "Run": 1626, "Wait": 281, "WaitRevoke": 4}, "sub_threads": {"20368": {"num_run": 59, "core": 15},"50944": {"num_run": 59, "core": 5},"26660": {"num_run": 59, "core": 18},"4492": {"num_run": 59, "core": 7},"58992": {"num_run": 59, "core": 0},"6948": {"num_run": 59, "core": 8},"23204": {"num_run": 59, "core": 19},"38556": {"num_run": 58, "core": 10},"60516": {"num_run": 59, "core": 11},"17584": {"num_run": 59, "core": 1},"59336": {"num_run": 59, "core": 6}}},"input_type_shape" : [{"float":[1,192,47360]},{"float":[]}],"mem_in_use_delta" : "0","output_type_shape" : [{"float":[1,192,47360]}],"output_size" : "36372480","mem_requested_in_use_delta" : "0","provider" : "CPUExecutionProvider","mem_bytes_requested_in_use" : "148291664","mem_in_use_peak" : "232243280","mem_arena_held" : "268435536","node_index" : "656"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2494,"ts" :2516638239,"ph" : "X","name" :"node_mul_133_kernel_time","args" : {"mem_requested_in_use_delta" : "0","mem_in_use_peak" : "232243280","mem_in_use_delta" : "0","activation_size" : "36372480","input_type_shape" : [{"float":[1,192,1]},{"float":[1,192,47360]}],"mem_arena_held" : "268435536","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 12, "Distribution": 2, "DistributionEnqueue": 1, "Run": 1916, "Wait": 417, "WaitRevoke": 5}, "sub_threads": {"20368": {"num_run": 60, "core": 15},"50944": {"num_run": 60, "core": 5},"26660": {"num_run": 60, "core": 18},"4492": {"num_run": 60, "core": 7},"58992": {"num_run": 60, "core": 0},"6948": {"num_run": 60, "core": 8},"23204": {"num_run": 60, "core": 19},"38556": {"num_run": 59, "core": 10},"60516": {"num_run": 60, "core": 11},"17584": {"num_run": 60, "core": 1},"59336": {"num_run": 60, "core": 6}}},"op_name" : "Mul","output_type_shape" : [{"float":[1,192,47360]}],"output_size" : "36372480","node_index" : "657","parameter_size" : "768","mem_bytes_in_use" : "205963344","provider" : "CPUExecutionProvider","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "148291664"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2741,"ts" :2516640757,"ph" : "X","name" :"node_add_82_kernel_time","args" : {"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 0, "Distribution": 1, "DistributionEnqueue": 0, "Run": 2543, "Wait": 133, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 61, "core": 15},"50944": {"num_run": 61, "core": 5},"26660": {"num_run": 61, "core": 18},"4492": {"num_run": 61, "core": 7},"58992": {"num_run": 61, "core": 0},"6948": {"num_run": 61, "core": 8},"23204": {"num_run": 61, "core": 19},"38556": {"num_run": 60, "core": 10},"60516": {"num_run": 61, "core": 11},"17584": {"num_run": 61, "core": 1},"59336": {"num_run": 61, "core": 6}}},"op_name" : "Add","activation_size" : "72744960","mem_arena_held" : "268435536","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,47360]}],"mem_bytes_requested_in_use" : "148291664","output_type_shape" : [{"float":[1,192,47360]}],"mem_requested_in_use_delta" : "0","mem_in_use_peak" : "232243280","mem_in_use_delta" : "0","provider" : "CPUExecutionProvider","mem_bytes_in_use" : "205963344","parameter_size" : "0","output_size" : "36372480","mem_arena_held_delta" : "0","node_index" : "658"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :41398,"ts" :2516643508,"ph" : "X","name" :"node_conv1d_20_kernel_time","args" : {"output_type_shape" : [{"float":[1,192,47360]}],"provider" : "CPUExecutionProvider","mem_in_use_delta" : "0","node_index" : "659","mem_bytes_requested_in_use" : "148291664","mem_requested_in_use_delta" : "0","mem_in_use_peak" : "232243280","input_type_shape" : [{"float":[1,192,47360]},{"float":[192,192,7]},{"float":[192]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 0, "Distribution": 1, "DistributionEnqueue": 0, "Run": 25242, "Wait": 16019, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 62, "core": 22},"50944": {"num_run": 62, "core": 18},"26660": {"num_run": 62, "core": 4},"4492": {"num_run": 62, "core": 19},"58992": {"num_run": 62, "core": 18},"6948": {"num_run": 62, "core": 5},"23204": {"num_run": 62, "core": 8},"38556": {"num_run": 61, "core": 10},"60516": {"num_run": 62, "core": 4},"17584": {"num_run": 62, "core": 3},"59336": {"num_run": 62, "core": 9}}},"mem_bytes_in_use" : "205963344","output_size" : "36372480","activation_size" : "36372480","op_name" : "Conv","mem_arena_held" : "268435536","mem_arena_held_delta" : "0","parameter_size" : "1032960"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1928,"ts" :2516684928,"ph" : "X","name" :"node_mul_134_kernel_time","args" : {"output_size" : "36372480","mem_requested_in_use_delta" : "0","node_index" : "660","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 13, "Distribution": 7, "DistributionEnqueue": 6, "Run": 1720, "Wait": 58, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 63, "core": 22},"50944": {"num_run": 63, "core": 18},"26660": {"num_run": 63, "core": 19},"4492": {"num_run": 63, "core": 14},"58992": {"num_run": 63, "core": 15},"6948": {"num_run": 63, "core": 5},"23204": {"num_run": 63, "core": 8},"38556": {"num_run": 62, "core": 10},"60516": {"num_run": 63, "core": 4},"17584": {"num_run": 63, "core": 2},"59336": {"num_run": 63, "core": 9}}},"output_type_shape" : [{"float":[1,192,47360]}],"provider" : "CPUExecutionProvider","op_name" : "Mul","mem_arena_held" : "268435536","mem_bytes_in_use" : "205963344","activation_size" : "36372480","parameter_size" : "768","mem_in_use_peak" : "232243280","mem_in_use_delta" : "0","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,1]}],"mem_bytes_requested_in_use" : "148291664","mem_arena_held_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :12620,"ts" :2516686882,"ph" : "X","name" :"node_sin_21_kernel_time","args" : {"parameter_size" : "0","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "148291664","mem_in_use_peak" : "232243280","op_name" : "Sin","provider" : "CPUExecutionProvider","output_type_shape" : [{"float":[1,192,47360]}],"mem_arena_held" : "268435536","output_size" : "36372480","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 13, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 63, "core": 22},"50944": {"num_run": 63, "core": 18},"26660": {"num_run": 63, "core": 19},"4492": {"num_run": 63, "core": 14},"58992": {"num_run": 63, "core": 15},"6948": {"num_run": 63, "core": 5},"23204": {"num_run": 63, "core": 8},"38556": {"num_run": 62, "core": 10},"60516": {"num_run": 63, "core": 4},"17584": {"num_run": 63, "core": 2},"59336": {"num_run": 63, "core": 9}}},"mem_requested_in_use_delta" : "0","input_type_shape" : [{"float":[1,192,47360]}],"node_index" : "661","mem_bytes_in_use" : "205963344","mem_in_use_delta" : "0","activation_size" : "36372480"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1762,"ts" :2516699521,"ph" : "X","name" :"node_pow_38_kernel_time","args" : {"mem_arena_held_delta" : "0","activation_size" : "36372480","mem_arena_held" : "268435536","mem_in_use_peak" : "232243280","mem_bytes_requested_in_use" : "148291664","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 4, "Distribution": 2, "DistributionEnqueue": 0, "Run": 1648, "Wait": 38, "WaitRevoke": 4}, "sub_threads": {"20368": {"num_run": 64, "core": 15},"50944": {"num_run": 64, "core": 18},"26660": {"num_run": 63, "core": 19},"4492": {"num_run": 64, "core": 14},"58992": {"num_run": 64, "core": 0},"6948": {"num_run": 64, "core": 1},"23204": {"num_run": 64, "core": 10},"38556": {"num_run": 63, "core": 19},"60516": {"num_run": 64, "core": 5},"17584": {"num_run": 64, "core": 8},"59336": {"num_run": 64, "core": 11}}},"provider" : "CPUExecutionProvider","mem_in_use_delta" : "0","output_type_shape" : [{"float":[1,192,47360]}],"mem_requested_in_use_delta" : "0","parameter_size" : "4","mem_bytes_in_use" : "205963344","input_type_shape" : [{"float":[1,192,47360]},{"float":[]}],"node_index" : "662","output_size" : "36372480","op_name" : "Pow"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1656,"ts" :2516701294,"ph" : "X","name" :"node_mul_135_kernel_time","args" : {"mem_bytes_requested_in_use" : "148291664","op_name" : "Mul","mem_in_use_delta" : "0","activation_size" : "36372480","provider" : "CPUExecutionProvider","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 4, "Distribution": 1, "DistributionEnqueue": 0, "Run": 1427, "Wait": 151, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 65, "core": 15},"50944": {"num_run": 65, "core": 18},"26660": {"num_run": 64, "core": 10},"4492": {"num_run": 65, "core": 14},"58992": {"num_run": 65, "core": 0},"6948": {"num_run": 65, "core": 1},"23204": {"num_run": 65, "core": 10},"38556": {"num_run": 64, "core": 19},"60516": {"num_run": 65, "core": 5},"17584": {"num_run": 65, "core": 8},"59336": {"num_run": 65, "core": 11}}},"output_type_shape" : [{"float":[1,192,47360]}],"input_type_shape" : [{"float":[1,192,1]},{"float":[1,192,47360]}],"mem_arena_held_delta" : "0","mem_in_use_peak" : "232243280","output_size" : "36372480","mem_arena_held" : "268435536","mem_bytes_in_use" : "205963344","mem_requested_in_use_delta" : "0","parameter_size" : "768","node_index" : "663"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2444,"ts" :2516702964,"ph" : "X","name" :"node_add_83_kernel_time","args" : {"mem_requested_in_use_delta" : "0","mem_bytes_in_use" : "205963344","output_type_shape" : [{"float":[1,192,47360]}],"parameter_size" : "0","mem_bytes_requested_in_use" : "148291664","provider" : "CPUExecutionProvider","mem_arena_held" : "268435536","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,47360]}],"output_size" : "36372480","activation_size" : "72744960","mem_in_use_delta" : "0","node_index" : "664","mem_in_use_peak" : "232243280","mem_arena_held_delta" : "0","op_name" : "Add","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 4, "Distribution": 1, "DistributionEnqueue": 0, "Run": 2081, "Wait": 291, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 66, "core": 15},"50944": {"num_run": 66, "core": 18},"26660": {"num_run": 65, "core": 10},"4492": {"num_run": 66, "core": 14},"58992": {"num_run": 66, "core": 0},"6948": {"num_run": 66, "core": 1},"23204": {"num_run": 66, "core": 10},"38556": {"num_run": 65, "core": 19},"60516": {"num_run": 66, "core": 5},"17584": {"num_run": 66, "core": 8},"59336": {"num_run": 66, "core": 11}}}}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :8691,"ts" :2516705429,"ph" : "X","name" :"node_conv1d_21_kernel_time","args" : {"provider" : "CPUExecutionProvider","input_type_shape" : [{"float":[1,192,47360]},{"float":[192,192,1]},{"float":[192]}],"output_type_shape" : [{"float":[1,192,47360]}],"op_name" : "Conv","output_size" : "36372480","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 4, "Distribution": 1, "DistributionEnqueue": 0, "Run": 4942, "Wait": 1252, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 67, "core": 15},"50944": {"num_run": 67, "core": 18},"26660": {"num_run": 66, "core": 10},"4492": {"num_run": 67, "core": 14},"58992": {"num_run": 67, "core": 0},"6948": {"num_run": 67, "core": 1},"23204": {"num_run": 67, "core": 10},"38556": {"num_run": 66, "core": 19},"60516": {"num_run": 67, "core": 5},"17584": {"num_run": 67, "core": 8},"59336": {"num_run": 67, "core": 14}}},"mem_requested_in_use_delta" : "0","mem_bytes_in_use" : "169590864","mem_arena_held" : "268435536","node_index" : "665","mem_in_use_delta" : "0","mem_in_use_peak" : "232243280","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "111919184","parameter_size" : "148224","activation_size" : "36372480"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3177,"ts" :2516714152,"ph" : "X","name" :"node_add_84_kernel_time","args" : {"mem_bytes_requested_in_use" : "111919184","output_size" : "36372480","mem_in_use_peak" : "232243280","parameter_size" : "0","mem_arena_held_delta" : "0","mem_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 8, "Distribution": 2, "DistributionEnqueue": 1, "Run": 3054, "Wait": 3, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 68, "core": 15},"50944": {"num_run": 68, "core": 9},"26660": {"num_run": 67, "core": 11},"4492": {"num_run": 68, "core": 19},"58992": {"num_run": 68, "core": 5},"6948": {"num_run": 68, "core": 18},"23204": {"num_run": 68, "core": 10},"38556": {"num_run": 67, "core": 1},"60516": {"num_run": 68, "core": 0},"17584": {"num_run": 68, "core": 4},"59336": {"num_run": 68, "core": 14}}},"node_index" : "666","output_type_shape" : [{"float":[1,192,47360]}],"activation_size" : "72744960","mem_requested_in_use_delta" : "0","op_name" : "Add","provider" : "CPUExecutionProvider","mem_bytes_in_use" : "169590864","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,47360]}],"mem_arena_held" : "268435536"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1979,"ts" :2516717349,"ph" : "X","name" :"node_mul_136_kernel_time","args" : {"mem_arena_held_delta" : "0","activation_size" : "36372480","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,1]}],"provider" : "CPUExecutionProvider","node_index" : "667","mem_bytes_in_use" : "169590864","mem_in_use_peak" : "232243280","mem_in_use_delta" : "0","mem_bytes_requested_in_use" : "111919184","mem_arena_held" : "268435536","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 8, "Distribution": 1, "DistributionEnqueue": 0, "Run": 1687, "Wait": 203, "WaitRevoke": 4}, "sub_threads": {"20368": {"num_run": 69, "core": 15},"50944": {"num_run": 69, "core": 9},"26660": {"num_run": 68, "core": 11},"4492": {"num_run": 69, "core": 19},"58992": {"num_run": 69, "core": 5},"6948": {"num_run": 69, "core": 18},"23204": {"num_run": 69, "core": 10},"38556": {"num_run": 68, "core": 1},"60516": {"num_run": 69, "core": 0},"17584": {"num_run": 69, "core": 4},"59336": {"num_run": 69, "core": 14}}},"mem_requested_in_use_delta" : "0","output_type_shape" : [{"float":[1,192,47360]}],"output_size" : "36372480","parameter_size" : "768","op_name" : "Mul"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :17471,"ts" :2516719345,"ph" : "X","name" :"node_sin_22_kernel_time","args" : {"mem_arena_held_delta" : "0","op_name" : "Sin","mem_bytes_requested_in_use" : "111919184","mem_requested_in_use_delta" : "0","mem_bytes_in_use" : "169590864","mem_arena_held" : "268435536","output_type_shape" : [{"float":[1,192,47360]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 8, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 69, "core": 15},"50944": {"num_run": 69, "core": 9},"26660": {"num_run": 68, "core": 11},"4492": {"num_run": 69, "core": 19},"58992": {"num_run": 69, "core": 5},"6948": {"num_run": 69, "core": 18},"23204": {"num_run": 69, "core": 10},"38556": {"num_run": 68, "core": 1},"60516": {"num_run": 69, "core": 0},"17584": {"num_run": 69, "core": 4},"59336": {"num_run": 69, "core": 14}}},"mem_in_use_delta" : "0","mem_in_use_peak" : "232243280","input_type_shape" : [{"float":[1,192,47360]}],"activation_size" : "36372480","node_index" : "668","output_size" : "36372480","provider" : "CPUExecutionProvider","parameter_size" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2267,"ts" :2516736848,"ph" : "X","name" :"node_pow_39_kernel_time","args" : {"output_size" : "36372480","mem_bytes_in_use" : "169590864","parameter_size" : "4","output_type_shape" : [{"float":[1,192,47360]}],"mem_bytes_requested_in_use" : "111919184","mem_arena_held_delta" : "0","provider" : "CPUExecutionProvider","activation_size" : "36372480","input_type_shape" : [{"float":[1,192,47360]},{"float":[]}],"mem_requested_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 5, "Distribution": 2, "DistributionEnqueue": 0, "Run": 2069, "Wait": 79, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 70, "core": 10},"50944": {"num_run": 70, "core": 7},"26660": {"num_run": 69, "core": 20},"4492": {"num_run": 70, "core": 23},"58992": {"num_run": 70, "core": 11},"6948": {"num_run": 70, "core": 22},"23204": {"num_run": 70, "core": 13},"38556": {"num_run": 69, "core": 4},"60516": {"num_run": 70, "core": 15},"17584": {"num_run": 70, "core": 0},"59336": {"num_run": 70, "core": 4}}},"mem_in_use_delta" : "0","op_name" : "Pow","mem_in_use_peak" : "232243280","node_index" : "669","mem_arena_held" : "268435536"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :1886,"ts" :2516739133,"ph" : "X","name" :"node_mul_137_kernel_time","args" : {"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [4], "core": 4, "Distribution": 1, "DistributionEnqueue": 0, "Run": 1626, "Wait": 192, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 71, "core": 10},"50944": {"num_run": 71, "core": 7},"26660": {"num_run": 70, "core": 20},"4492": {"num_run": 71, "core": 23},"58992": {"num_run": 71, "core": 11},"6948": {"num_run": 71, "core": 22},"23204": {"num_run": 71, "core": 13},"38556": {"num_run": 70, "core": 4},"60516": {"num_run": 71, "core": 15},"17584": {"num_run": 71, "core": 0},"59336": {"num_run": 71, "core": 4}}},"mem_bytes_in_use" : "169590864","mem_in_use_peak" : "232243280","mem_bytes_requested_in_use" : "111919184","mem_in_use_delta" : "0","provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "0","node_index" : "670","mem_arena_held_delta" : "0","activation_size" : "36372480","output_size" : "36372480","op_name" : "Mul","parameter_size" : "768","output_type_shape" : [{"float":[1,192,47360]}],"mem_arena_held" : "268435536","input_type_shape" : [{"float":[1,192,1]},{"float":[1,192,47360]}]}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2562,"ts" :2516741034,"ph" : "X","name" :"node_add_85_kernel_time","args" : {"mem_requested_in_use_delta" : "0","op_name" : "Add","mem_bytes_requested_in_use" : "111919184","activation_size" : "72744960","mem_in_use_peak" : "232243280","parameter_size" : "0","output_type_shape" : [{"float":[1,192,47360]}],"mem_bytes_in_use" : "169590864","mem_in_use_delta" : "0","mem_arena_held" : "268435536","input_type_shape" : [{"float":[1,192,47360]},{"float":[1,192,47360]}],"mem_arena_held_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [189440], "core": 4, "Distribution": 1, "DistributionEnqueue": 0, "Run": 2209, "Wait": 290, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 72, "core": 10},"50944": {"num_run": 72, "core": 7},"26660": {"num_run": 71, "core": 20},"4492": {"num_run": 72, "core": 23},"58992": {"num_run": 72, "core": 11},"6948": {"num_run": 72, "core": 22},"23204": {"num_run": 72, "core": 13},"38556": {"num_run": 71, "core": 4},"60516": {"num_run": 72, "core": 15},"17584": {"num_run": 72, "core": 0},"59336": {"num_run": 72, "core": 4}}},"output_size" : "36372480","provider" : "CPUExecutionProvider","node_index" : "671"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :30,"ts" :2516743622,"ph" : "X","name" :"node_convolution_5__edge_unsqueeze_kernel_time","args" : {"mem_requested_in_use_delta" : "0","output_size" : "36372480","mem_arena_held" : "268435536","mem_bytes_requested_in_use" : "39174224","mem_in_use_delta" : "0","mem_arena_held_delta" : "0","activation_size" : "36372480","mem_in_use_peak" : "232243280","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 4, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 72, "core": 10},"50944": {"num_run": 72, "core": 7},"26660": {"num_run": 71, "core": 20},"4492": {"num_run": 72, "core": 23},"58992": {"num_run": 72, "core": 11},"6948": {"num_run": 72, "core": 22},"23204": {"num_run": 72, "core": 13},"38556": {"num_run": 71, "core": 4},"60516": {"num_run": 72, "core": 15},"17584": {"num_run": 72, "core": 0},"59336": {"num_run": 72, "core": 4}}},"parameter_size" : "8","input_type_shape" : [{"float":[1,192,47360]},{"int64":[1]}],"node_index" : "672","output_type_shape" : [{"float":[1,192,1,47360]}],"op_name" : "Unsqueeze","mem_bytes_in_use" : "41009232","provider" : "CPUExecutionProvider"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :49427,"ts" :2516743657,"ph" : "X","name" :"node_convolution_5__edge_2d_kernel_time","args" : {"provider" : "CPUExecutionProvider","mem_arena_held" : "536870992","parameter_size" : "384","output_type_shape" : [{"float":[1,96,1,142083]}],"node_index" : "673","input_type_shape" : [{"float":[1,192,1,47360]},{"float":[96]}],"mem_requested_in_use_delta" : "54559872","op_name" : "ConvTranspose","activation_size" : "36372480","mem_arena_held_delta" : "268435456","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 5, "Distribution": 2, "DistributionEnqueue": 0, "Run": 19919, "Wait": 3665, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 73, "core": 3},"50944": {"num_run": 73, "core": 8},"26660": {"num_run": 72, "core": 19},"4492": {"num_run": 73, "core": 14},"58992": {"num_run": 73, "core": 21},"6948": {"num_run": 73, "core": 18},"23204": {"num_run": 73, "core": 10},"38556": {"num_run": 72, "core": 6},"60516": {"num_run": 73, "core": 7},"17584": {"num_run": 73, "core": 11},"59336": {"num_run": 73, "core": 9}}},"mem_in_use_delta" : "67108864","mem_bytes_requested_in_use" : "93734096","mem_in_use_peak" : "232243280","mem_bytes_in_use" : "108118096","output_size" : "54559872"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :46,"ts" :2516793116,"ph" : "X","name" :"node_convolution_5__edge_squeeze_kernel_time","args" : {"mem_arena_held_delta" : "0","node_index" : "674","provider" : "CPUExecutionProvider","parameter_size" : "8","output_size" : "54559872","activation_size" : "54559872","output_type_shape" : [{"float":[1,96,142083]}],"op_name" : "Squeeze","mem_bytes_in_use" : "71745616","mem_arena_held" : "536870992","mem_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 5, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 73, "core": 3},"50944": {"num_run": 73, "core": 8},"26660": {"num_run": 72, "core": 19},"4492": {"num_run": 73, "core": 14},"58992": {"num_run": 73, "core": 21},"6948": {"num_run": 73, "core": 18},"23204": {"num_run": 73, "core": 10},"38556": {"num_run": 72, "core": 6},"60516": {"num_run": 73, "core": 7},"17584": {"num_run": 73, "core": 11},"59336": {"num_run": 73, "core": 9}}},"mem_in_use_peak" : "232243280","mem_requested_in_use_delta" : "0","mem_bytes_requested_in_use" : "57361616","input_type_shape" : [{"float":[1,96,1,142083]},{"int64":[1]}]}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3796,"ts" :2516793176,"ph" : "X","name" :"node_slice_42_kernel_time","args" : {"mem_arena_held_delta" : "0","op_name" : "Slice","mem_in_use_peak" : "232243280","mem_in_use_delta" : "54558720","output_type_shape" : [{"float":[1,96,142080]}],"mem_requested_in_use_delta" : "54558720","mem_arena_held" : "536870992","activation_size" : "54559872","mem_bytes_requested_in_use" : "111920336","parameter_size" : "32","node_index" : "675","mem_bytes_in_use" : "126304336","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 5, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 73, "core": 3},"50944": {"num_run": 73, "core": 8},"26660": {"num_run": 72, "core": 19},"4492": {"num_run": 73, "core": 14},"58992": {"num_run": 73, "core": 21},"6948": {"num_run": 73, "core": 18},"23204": {"num_run": 73, "core": 10},"38556": {"num_run": 72, "core": 6},"60516": {"num_run": 73, "core": 7},"17584": {"num_run": 73, "core": 11},"59336": {"num_run": 73, "core": 9}}},"provider" : "CPUExecutionProvider","output_size" : "54558720","input_type_shape" : [{"float":[1,96,142083]},{"int64":[1]},{"int64":[1]},{"int64":[1]},{"int64":[1]}]}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2909,"ts" :2516797001,"ph" : "X","name" :"node_mul_138_kernel_time","args" : {"node_index" : "676","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 2, "Distribution": 2, "DistributionEnqueue": 1, "Run": 2696, "Wait": 136, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 74, "core": 4},"50944": {"num_run": 74, "core": 9},"26660": {"num_run": 73, "core": 22},"4492": {"num_run": 74, "core": 19},"58992": {"num_run": 74, "core": 3},"6948": {"num_run": 74, "core": 8},"23204": {"num_run": 74, "core": 14},"38556": {"num_run": 73, "core": 18},"60516": {"num_run": 74, "core": 15},"17584": {"num_run": 74, "core": 11},"59336": {"num_run": 74, "core": 10}}},"mem_in_use_delta" : "67108864","mem_arena_held" : "536870992","output_size" : "54558720","mem_bytes_in_use" : "126304336","activation_size" : "54558720","mem_in_use_peak" : "232243280","provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "54558720","input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,1]}],"op_name" : "Mul","output_type_shape" : [{"float":[1,96,142080]}],"mem_arena_held_delta" : "0","parameter_size" : "384","mem_bytes_requested_in_use" : "111919184"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :21209,"ts" :2516799924,"ph" : "X","name" :"node_sin_23_kernel_time","args" : {"provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "54558720","parameter_size" : "0","mem_bytes_in_use" : "205963344","activation_size" : "54558720","mem_in_use_delta" : "79659008","mem_in_use_peak" : "232243280","input_type_shape" : [{"float":[1,96,142080]}],"mem_bytes_requested_in_use" : "166477904","output_size" : "54558720","mem_arena_held_delta" : "0","node_index" : "677","mem_arena_held" : "536870992","output_type_shape" : [{"float":[1,96,142080]}],"op_name" : "Sin","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 2, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 74, "core": 4},"50944": {"num_run": 74, "core": 9},"26660": {"num_run": 73, "core": 22},"4492": {"num_run": 74, "core": 19},"58992": {"num_run": 74, "core": 3},"6948": {"num_run": 74, "core": 8},"23204": {"num_run": 74, "core": 14},"38556": {"num_run": 73, "core": 18},"60516": {"num_run": 74, "core": 15},"17584": {"num_run": 74, "core": 11},"59336": {"num_run": 74, "core": 10}}}}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2822,"ts" :2516821155,"ph" : "X","name" :"node_pow_40_kernel_time","args" : {"output_type_shape" : [{"float":[1,96,142080]}],"mem_bytes_requested_in_use" : "166477904","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 4, "Distribution": 2, "DistributionEnqueue": 0, "Run": 2427, "Wait": 321, "WaitRevoke": 4}, "sub_threads": {"20368": {"num_run": 75, "core": 14},"50944": {"num_run": 75, "core": 23},"26660": {"num_run": 74, "core": 11},"4492": {"num_run": 75, "core": 1},"58992": {"num_run": 75, "core": 19},"6948": {"num_run": 75, "core": 18},"23204": {"num_run": 75, "core": 0},"38556": {"num_run": 74, "core": 10},"60516": {"num_run": 75, "core": 15},"17584": {"num_run": 75, "core": 8},"59336": {"num_run": 75, "core": 9}}},"parameter_size" : "4","mem_bytes_in_use" : "205963344","input_type_shape" : [{"float":[1,96,142080]},{"float":[]}],"mem_in_use_peak" : "232243280","mem_requested_in_use_delta" : "0","node_index" : "678","activation_size" : "54558720","output_size" : "54558720","mem_arena_held_delta" : "0","mem_arena_held" : "536870992","mem_in_use_delta" : "0","provider" : "CPUExecutionProvider","op_name" : "Pow"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3317,"ts" :2516823985,"ph" : "X","name" :"node_mul_139_kernel_time","args" : {"mem_in_use_peak" : "232243280","op_name" : "Mul","output_size" : "54558720","mem_in_use_delta" : "0","mem_bytes_requested_in_use" : "166477904","mem_arena_held" : "536870992","node_index" : "679","parameter_size" : "384","activation_size" : "54558720","mem_requested_in_use_delta" : "0","provider" : "CPUExecutionProvider","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 4, "Distribution": 1, "DistributionEnqueue": 0, "Run": 3109, "Wait": 103, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 76, "core": 14},"50944": {"num_run": 76, "core": 23},"26660": {"num_run": 75, "core": 11},"4492": {"num_run": 76, "core": 1},"58992": {"num_run": 76, "core": 19},"6948": {"num_run": 76, "core": 18},"23204": {"num_run": 76, "core": 0},"38556": {"num_run": 75, "core": 10},"60516": {"num_run": 76, "core": 15},"17584": {"num_run": 76, "core": 8},"59336": {"num_run": 76, "core": 9}}},"mem_bytes_in_use" : "205963344","input_type_shape" : [{"float":[1,96,1]},{"float":[1,96,142080]}],"mem_arena_held_delta" : "0","output_type_shape" : [{"float":[1,96,142080]}]}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :5340,"ts" :2516827325,"ph" : "X","name" :"node_add_86_kernel_time","args" : {"mem_arena_held" : "536870992","mem_in_use_delta" : "0","mem_bytes_in_use" : "205963344","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 13, "Distribution": 2, "DistributionEnqueue": 0, "Run": 4835, "Wait": 378, "WaitRevoke": 5}, "sub_threads": {"20368": {"num_run": 77, "core": 14},"50944": {"num_run": 77, "core": 23},"26660": {"num_run": 76, "core": 11},"4492": {"num_run": 77, "core": 1},"58992": {"num_run": 77, "core": 19},"6948": {"num_run": 77, "core": 18},"23204": {"num_run": 77, "core": 0},"38556": {"num_run": 76, "core": 10},"60516": {"num_run": 77, "core": 15},"17584": {"num_run": 77, "core": 8},"59336": {"num_run": 77, "core": 9}}},"mem_in_use_peak" : "232243280","provider" : "CPUExecutionProvider","parameter_size" : "0","output_type_shape" : [{"float":[1,96,142080]}],"activation_size" : "109117440","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "166477904","node_index" : "680","output_size" : "54558720","mem_requested_in_use_delta" : "0","input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,142080]}],"op_name" : "Add"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :29765,"ts" :2516832688,"ph" : "X","name" :"node_conv1d_22_kernel_time","args" : {"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 13, "Distribution": 1, "DistributionEnqueue": 0, "Run": 19582, "Wait": 10018, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 78, "core": 11},"50944": {"num_run": 78, "core": 16},"26660": {"num_run": 77, "core": 15},"4492": {"num_run": 78, "core": 9},"58992": {"num_run": 78, "core": 12},"6948": {"num_run": 78, "core": 0},"23204": {"num_run": 78, "core": 5},"38556": {"num_run": 77, "core": 4},"60516": {"num_run": 78, "core": 19},"17584": {"num_run": 78, "core": 1},"59336": {"num_run": 78, "core": 4}}},"output_type_shape" : [{"float":[1,96,142080]}],"mem_arena_held_delta" : "0","output_size" : "54558720","mem_requested_in_use_delta" : "0","provider" : "CPUExecutionProvider","op_name" : "Conv","node_index" : "681","parameter_size" : "258432","input_type_shape" : [{"float":[1,96,142080]},{"float":[96,96,7]},{"float":[96]}],"mem_bytes_requested_in_use" : "166477904","mem_bytes_in_use" : "205963344","activation_size" : "54558720","mem_in_use_peak" : "232243280","mem_arena_held" : "536870992","mem_in_use_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3239,"ts" :2516862475,"ph" : "X","name" :"node_mul_140_kernel_time","args" : {"mem_arena_held_delta" : "0","mem_requested_in_use_delta" : "0","parameter_size" : "384","activation_size" : "54558720","output_type_shape" : [{"float":[1,96,142080]}],"mem_bytes_in_use" : "205963344","node_index" : "682","mem_arena_held" : "536870992","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 14, "Distribution": 1, "DistributionEnqueue": 0, "Run": 2862, "Wait": 277, "WaitRevoke": 5}, "sub_threads": {"20368": {"num_run": 79, "core": 11},"50944": {"num_run": 79, "core": 16},"26660": {"num_run": 78, "core": 15},"4492": {"num_run": 79, "core": 9},"58992": {"num_run": 79, "core": 12},"6948": {"num_run": 79, "core": 0},"23204": {"num_run": 79, "core": 5},"38556": {"num_run": 78, "core": 4},"60516": {"num_run": 79, "core": 19},"17584": {"num_run": 79, "core": 8},"59336": {"num_run": 79, "core": 10}}},"input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,1]}],"mem_bytes_requested_in_use" : "166477904","mem_in_use_delta" : "0","provider" : "CPUExecutionProvider","mem_in_use_peak" : "232243280","op_name" : "Mul","output_size" : "54558720"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :33351,"ts" :2516865731,"ph" : "X","name" :"node_sin_24_kernel_time","args" : {"output_type_shape" : [{"float":[1,96,142080]}],"mem_arena_held" : "536870992","mem_arena_held_delta" : "0","op_name" : "Sin","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 14, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 79, "core": 11},"50944": {"num_run": 79, "core": 16},"26660": {"num_run": 78, "core": 15},"4492": {"num_run": 79, "core": 9},"58992": {"num_run": 79, "core": 12},"6948": {"num_run": 79, "core": 0},"23204": {"num_run": 79, "core": 5},"38556": {"num_run": 78, "core": 4},"60516": {"num_run": 79, "core": 19},"17584": {"num_run": 79, "core": 8},"59336": {"num_run": 79, "core": 10}}},"input_type_shape" : [{"float":[1,96,142080]}],"mem_bytes_in_use" : "260522064","activation_size" : "54558720","output_size" : "54558720","parameter_size" : "0","mem_bytes_requested_in_use" : "221036624","provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "54558720","node_index" : "683","mem_in_use_delta" : "54558720","mem_in_use_peak" : "260522064"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3975,"ts" :2516899107,"ph" : "X","name" :"node_pow_41_kernel_time","args" : {"input_type_shape" : [{"float":[1,96,142080]},{"float":[]}],"mem_bytes_in_use" : "260522064","output_type_shape" : [{"float":[1,96,142080]}],"mem_arena_held" : "536870992","mem_arena_held_delta" : "0","activation_size" : "54558720","op_name" : "Pow","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 10, "Distribution": 3, "DistributionEnqueue": 1, "Run": 3407, "Wait": 466, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 80, "core": 15},"50944": {"num_run": 80, "core": 19},"26660": {"num_run": 79, "core": 1},"4492": {"num_run": 80, "core": 14},"58992": {"num_run": 80, "core": 11},"6948": {"num_run": 80, "core": 16},"23204": {"num_run": 80, "core": 4},"38556": {"num_run": 79, "core": 8},"60516": {"num_run": 80, "core": 0},"17584": {"num_run": 80, "core": 17},"59336": {"num_run": 80, "core": 9}}},"mem_requested_in_use_delta" : "0","provider" : "CPUExecutionProvider","mem_bytes_requested_in_use" : "221036624","mem_in_use_peak" : "260522064","mem_in_use_delta" : "0","node_index" : "684","parameter_size" : "4","output_size" : "54558720"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2774,"ts" :2516903100,"ph" : "X","name" :"node_mul_141_kernel_time","args" : {"op_name" : "Mul","output_type_shape" : [{"float":[1,96,142080]}],"input_type_shape" : [{"float":[1,96,1]},{"float":[1,96,142080]}],"node_index" : "685","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "221036624","activation_size" : "54558720","parameter_size" : "384","mem_in_use_peak" : "260522064","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 10, "Distribution": 1, "DistributionEnqueue": 0, "Run": 2626, "Wait": 67, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 81, "core": 15},"50944": {"num_run": 81, "core": 19},"26660": {"num_run": 80, "core": 1},"4492": {"num_run": 81, "core": 14},"58992": {"num_run": 81, "core": 11},"6948": {"num_run": 81, "core": 16},"23204": {"num_run": 81, "core": 4},"38556": {"num_run": 80, "core": 8},"60516": {"num_run": 81, "core": 0},"17584": {"num_run": 81, "core": 17},"59336": {"num_run": 81, "core": 9}}},"mem_requested_in_use_delta" : "0","mem_arena_held" : "536870992","output_size" : "54558720","mem_in_use_delta" : "0","mem_bytes_in_use" : "260522064","provider" : "CPUExecutionProvider"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :4075,"ts" :2516905888,"ph" : "X","name" :"node_add_87_kernel_time","args" : {"output_type_shape" : [{"float":[1,96,142080]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 10, "Distribution": 1, "DistributionEnqueue": 0, "Run": 3714, "Wait": 245, "WaitRevoke": 9}, "sub_threads": {"20368": {"num_run": 82, "core": 15},"50944": {"num_run": 82, "core": 19},"26660": {"num_run": 81, "core": 1},"4492": {"num_run": 82, "core": 14},"58992": {"num_run": 82, "core": 11},"6948": {"num_run": 82, "core": 16},"23204": {"num_run": 82, "core": 4},"38556": {"num_run": 81, "core": 8},"60516": {"num_run": 82, "core": 0},"17584": {"num_run": 82, "core": 17},"59336": {"num_run": 82, "core": 9}}},"input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,142080]}],"parameter_size" : "0","mem_in_use_delta" : "0","activation_size" : "109117440","mem_arena_held" : "536870992","mem_bytes_in_use" : "260522064","node_index" : "686","mem_bytes_requested_in_use" : "221036624","mem_requested_in_use_delta" : "0","mem_in_use_peak" : "260522064","op_name" : "Add","output_size" : "54558720","provider" : "CPUExecutionProvider","mem_arena_held_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :8499,"ts" :2516909984,"ph" : "X","name" :"node_conv1d_23_kernel_time","args" : {"mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "221036624","provider" : "CPUExecutionProvider","op_name" : "Conv","mem_in_use_peak" : "260522064","mem_arena_held" : "536870992","output_type_shape" : [{"float":[1,96,142080]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 10, "Distribution": 1, "DistributionEnqueue": 0, "Run": 3850, "Wait": 2162, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 83, "core": 10},"50944": {"num_run": 83, "core": 14},"26660": {"num_run": 82, "core": 19},"4492": {"num_run": 83, "core": 16},"58992": {"num_run": 83, "core": 18},"6948": {"num_run": 83, "core": 1},"23204": {"num_run": 83, "core": 8},"38556": {"num_run": 82, "core": 15},"60516": {"num_run": 83, "core": 0},"17584": {"num_run": 83, "core": 4},"59336": {"num_run": 83, "core": 2}}},"mem_bytes_in_use" : "260522064","node_index" : "687","output_size" : "54558720","mem_requested_in_use_delta" : "0","activation_size" : "54558720","input_type_shape" : [{"float":[1,96,142080]},{"float":[96,96,1]},{"float":[96]}],"mem_in_use_delta" : "0","parameter_size" : "37248"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :4106,"ts" :2516918504,"ph" : "X","name" :"node_add_88_kernel_time","args" : {"input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,142080]}],"mem_bytes_in_use" : "260522064","parameter_size" : "0","output_type_shape" : [{"float":[1,96,142080]}],"output_size" : "54558720","mem_bytes_requested_in_use" : "221036624","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 9, "Distribution": 2, "DistributionEnqueue": 1, "Run": 3891, "Wait": 98, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 84, "core": 10},"50944": {"num_run": 84, "core": 14},"26660": {"num_run": 83, "core": 19},"4492": {"num_run": 84, "core": 16},"58992": {"num_run": 84, "core": 18},"6948": {"num_run": 84, "core": 1},"23204": {"num_run": 84, "core": 8},"38556": {"num_run": 83, "core": 15},"60516": {"num_run": 84, "core": 0},"17584": {"num_run": 84, "core": 4},"59336": {"num_run": 84, "core": 2}}},"node_index" : "688","mem_requested_in_use_delta" : "0","mem_in_use_peak" : "260522064","op_name" : "Add","mem_in_use_delta" : "0","activation_size" : "109117440","mem_arena_held_delta" : "0","provider" : "CPUExecutionProvider","mem_arena_held" : "536870992"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3323,"ts" :2516922629,"ph" : "X","name" :"node_mul_142_kernel_time","args" : {"output_type_shape" : [{"float":[1,96,142080]}],"mem_in_use_peak" : "260522064","node_index" : "689","mem_requested_in_use_delta" : "0","output_size" : "54558720","mem_arena_held" : "536870992","provider" : "CPUExecutionProvider","mem_arena_held_delta" : "0","parameter_size" : "384","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 9, "Distribution": 1, "DistributionEnqueue": 0, "Run": 3057, "Wait": 127, "WaitRevoke": 5}, "sub_threads": {"20368": {"num_run": 85, "core": 13},"50944": {"num_run": 85, "core": 19},"26660": {"num_run": 84, "core": 8},"4492": {"num_run": 85, "core": 14},"58992": {"num_run": 85, "core": 1},"6948": {"num_run": 85, "core": 11},"23204": {"num_run": 85, "core": 8},"38556": {"num_run": 84, "core": 18},"60516": {"num_run": 85, "core": 12},"17584": {"num_run": 85, "core": 9},"59336": {"num_run": 85, "core": 21}}},"mem_bytes_in_use" : "260522064","activation_size" : "54558720","mem_bytes_requested_in_use" : "221036624","input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,1]}],"mem_in_use_delta" : "0","op_name" : "Mul"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :32265,"ts" :2516925979,"ph" : "X","name" :"node_sin_25_kernel_time","args" : {"parameter_size" : "0","activation_size" : "54558720","mem_requested_in_use_delta" : "0","mem_bytes_in_use" : "260522064","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 9, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 85, "core": 13},"50944": {"num_run": 85, "core": 19},"26660": {"num_run": 84, "core": 8},"4492": {"num_run": 85, "core": 14},"58992": {"num_run": 85, "core": 1},"6948": {"num_run": 85, "core": 11},"23204": {"num_run": 85, "core": 8},"38556": {"num_run": 84, "core": 18},"60516": {"num_run": 85, "core": 12},"17584": {"num_run": 85, "core": 9},"59336": {"num_run": 85, "core": 21}}},"mem_arena_held" : "536870992","mem_bytes_requested_in_use" : "221036624","op_name" : "Sin","mem_arena_held_delta" : "0","output_size" : "54558720","mem_in_use_delta" : "0","mem_in_use_peak" : "260522064","output_type_shape" : [{"float":[1,96,142080]}],"provider" : "CPUExecutionProvider","input_type_shape" : [{"float":[1,96,142080]}],"node_index" : "690"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3180,"ts" :2516958267,"ph" : "X","name" :"node_pow_42_kernel_time","args" : {"op_name" : "Pow","mem_arena_held" : "536870992","mem_arena_held_delta" : "0","mem_in_use_peak" : "260522064","mem_bytes_requested_in_use" : "221036624","mem_in_use_delta" : "0","output_size" : "54558720","provider" : "CPUExecutionProvider","output_type_shape" : [{"float":[1,96,142080]}],"node_index" : "691","mem_bytes_in_use" : "260522064","mem_requested_in_use_delta" : "0","activation_size" : "54558720","input_type_shape" : [{"float":[1,96,142080]},{"float":[]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 18, "Distribution": 2, "DistributionEnqueue": 0, "Run": 2876, "Wait": 185, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 86, "core": 9},"50944": {"num_run": 86, "core": 15},"26660": {"num_run": 85, "core": 11},"4492": {"num_run": 86, "core": 8},"58992": {"num_run": 86, "core": 19},"6948": {"num_run": 86, "core": 1},"23204": {"num_run": 86, "core": 14},"38556": {"num_run": 85, "core": 4},"60516": {"num_run": 86, "core": 5},"17584": {"num_run": 86, "core": 10},"59336": {"num_run": 86, "core": 0}}},"parameter_size" : "4"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3334,"ts" :2516961466,"ph" : "X","name" :"node_mul_143_kernel_time","args" : {"output_type_shape" : [{"float":[1,96,142080]}],"output_size" : "54558720","activation_size" : "54558720","node_index" : "692","input_type_shape" : [{"float":[1,96,1]},{"float":[1,96,142080]}],"mem_bytes_in_use" : "260522064","parameter_size" : "384","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 18, "Distribution": 1, "DistributionEnqueue": 0, "Run": 2970, "Wait": 279, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 87, "core": 9},"50944": {"num_run": 87, "core": 15},"26660": {"num_run": 86, "core": 11},"4492": {"num_run": 87, "core": 8},"58992": {"num_run": 87, "core": 19},"6948": {"num_run": 87, "core": 1},"23204": {"num_run": 87, "core": 14},"38556": {"num_run": 86, "core": 4},"60516": {"num_run": 87, "core": 5},"17584": {"num_run": 87, "core": 10},"59336": {"num_run": 87, "core": 0}}},"mem_in_use_delta" : "0","mem_arena_held" : "536870992","op_name" : "Mul","mem_bytes_requested_in_use" : "221036624","provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "0","mem_arena_held_delta" : "0","mem_in_use_peak" : "260522064"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :4142,"ts" :2516964813,"ph" : "X","name" :"node_add_89_kernel_time","args" : {"activation_size" : "109117440","output_size" : "54558720","provider" : "CPUExecutionProvider","mem_in_use_delta" : "0","mem_arena_held" : "536870992","mem_bytes_requested_in_use" : "221036624","node_index" : "693","mem_in_use_peak" : "260522064","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 18, "Distribution": 1, "DistributionEnqueue": 0, "Run": 3684, "Wait": 357, "WaitRevoke": 9}, "sub_threads": {"20368": {"num_run": 88, "core": 9},"50944": {"num_run": 88, "core": 15},"26660": {"num_run": 87, "core": 11},"4492": {"num_run": 88, "core": 8},"58992": {"num_run": 88, "core": 19},"6948": {"num_run": 88, "core": 1},"23204": {"num_run": 88, "core": 14},"38556": {"num_run": 87, "core": 4},"60516": {"num_run": 88, "core": 5},"17584": {"num_run": 88, "core": 10},"59336": {"num_run": 88, "core": 0}}},"mem_arena_held_delta" : "0","op_name" : "Add","output_type_shape" : [{"float":[1,96,142080]}],"mem_requested_in_use_delta" : "0","input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,142080]}],"parameter_size" : "0","mem_bytes_in_use" : "260522064"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :28790,"ts" :2516968971,"ph" : "X","name" :"node_conv1d_24_kernel_time","args" : {"mem_in_use_peak" : "261308496","input_type_shape" : [{"float":[1,96,142080]},{"float":[96,96,7]},{"float":[96]}],"provider" : "CPUExecutionProvider","op_name" : "Conv","mem_arena_held" : "536870992","mem_arena_held_delta" : "0","output_size" : "54558720","parameter_size" : "258432","mem_bytes_in_use" : "260522064","output_type_shape" : [{"float":[1,96,142080]}],"node_index" : "694","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 18, "Distribution": 2, "DistributionEnqueue": 0, "Run": 19598, "Wait": 9050, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 89, "core": 9},"50944": {"num_run": 89, "core": 23},"26660": {"num_run": 88, "core": 14},"4492": {"num_run": 89, "core": 17},"58992": {"num_run": 89, "core": 7},"6948": {"num_run": 89, "core": 16},"23204": {"num_run": 89, "core": 9},"38556": {"num_run": 88, "core": 4},"60516": {"num_run": 89, "core": 15},"17584": {"num_run": 89, "core": 10},"59336": {"num_run": 89, "core": 2}}},"mem_bytes_requested_in_use" : "221036624","activation_size" : "54558720","mem_in_use_delta" : "0","mem_requested_in_use_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2803,"ts" :2516997782,"ph" : "X","name" :"node_mul_144_kernel_time","args" : {"mem_arena_held" : "536870992","output_size" : "54558720","op_name" : "Mul","parameter_size" : "384","node_index" : "695","input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,1]}],"mem_bytes_requested_in_use" : "221036624","activation_size" : "54558720","mem_in_use_delta" : "0","output_type_shape" : [{"float":[1,96,142080]}],"provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "0","mem_in_use_peak" : "261308496","mem_arena_held_delta" : "0","mem_bytes_in_use" : "260522064","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 14, "Distribution": 2, "DistributionEnqueue": 1, "Run": 2630, "Wait": 82, "WaitRevoke": 4}, "sub_threads": {"20368": {"num_run": 90, "core": 9},"50944": {"num_run": 90, "core": 23},"26660": {"num_run": 89, "core": 14},"4492": {"num_run": 90, "core": 17},"58992": {"num_run": 90, "core": 7},"6948": {"num_run": 90, "core": 16},"23204": {"num_run": 90, "core": 9},"38556": {"num_run": 89, "core": 4},"60516": {"num_run": 90, "core": 15},"17584": {"num_run": 90, "core": 10},"59336": {"num_run": 90, "core": 2}}}}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :24361,"ts" :2517000598,"ph" : "X","name" :"node_sin_26_kernel_time","args" : {"node_index" : "696","op_name" : "Sin","mem_in_use_peak" : "261308496","output_size" : "54558720","output_type_shape" : [{"float":[1,96,142080]}],"mem_in_use_delta" : "0","mem_bytes_requested_in_use" : "221036624","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 14, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 90, "core": 9},"50944": {"num_run": 90, "core": 23},"26660": {"num_run": 89, "core": 14},"4492": {"num_run": 90, "core": 17},"58992": {"num_run": 90, "core": 7},"6948": {"num_run": 90, "core": 16},"23204": {"num_run": 90, "core": 9},"38556": {"num_run": 89, "core": 4},"60516": {"num_run": 90, "core": 15},"17584": {"num_run": 90, "core": 10},"59336": {"num_run": 90, "core": 2}}},"mem_arena_held" : "536870992","mem_arena_held_delta" : "0","input_type_shape" : [{"float":[1,96,142080]}],"mem_requested_in_use_delta" : "0","mem_bytes_in_use" : "260522064","provider" : "CPUExecutionProvider","parameter_size" : "0","activation_size" : "54558720"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2929,"ts" :2517024982,"ph" : "X","name" :"node_pow_43_kernel_time","args" : {"provider" : "CPUExecutionProvider","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 16, "Distribution": 2, "DistributionEnqueue": 1, "Run": 2543, "Wait": 244, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 91, "core": 10},"50944": {"num_run": 91, "core": 7},"26660": {"num_run": 90, "core": 16},"4492": {"num_run": 91, "core": 15},"58992": {"num_run": 91, "core": 11},"6948": {"num_run": 91, "core": 19},"23204": {"num_run": 91, "core": 4},"38556": {"num_run": 90, "core": 2},"60516": {"num_run": 91, "core": 18},"17584": {"num_run": 91, "core": 5},"59336": {"num_run": 91, "core": 14}}},"mem_requested_in_use_delta" : "0","output_type_shape" : [{"float":[1,96,142080]}],"mem_in_use_delta" : "0","mem_arena_held" : "536870992","input_type_shape" : [{"float":[1,96,142080]},{"float":[]}],"mem_in_use_peak" : "261308496","output_size" : "54558720","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "221036624","node_index" : "697","mem_bytes_in_use" : "260522064","activation_size" : "54558720","op_name" : "Pow","parameter_size" : "4"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3218,"ts" :2517027932,"ph" : "X","name" :"node_mul_145_kernel_time","args" : {"activation_size" : "54558720","mem_bytes_in_use" : "260522064","parameter_size" : "384","mem_arena_held" : "536870992","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 6, "Distribution": 2, "DistributionEnqueue": 0, "Run": 2982, "Wait": 104, "WaitRevoke": 8}, "sub_threads": {"20368": {"num_run": 92, "core": 10},"50944": {"num_run": 92, "core": 7},"26660": {"num_run": 91, "core": 16},"4492": {"num_run": 92, "core": 15},"58992": {"num_run": 92, "core": 11},"6948": {"num_run": 92, "core": 19},"23204": {"num_run": 92, "core": 4},"38556": {"num_run": 91, "core": 2},"60516": {"num_run": 92, "core": 18},"17584": {"num_run": 92, "core": 5},"59336": {"num_run": 92, "core": 14}}},"output_size" : "54558720","op_name" : "Mul","mem_in_use_peak" : "261308496","provider" : "CPUExecutionProvider","output_type_shape" : [{"float":[1,96,142080]}],"mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "221036624","node_index" : "698","input_type_shape" : [{"float":[1,96,1]},{"float":[1,96,142080]}],"mem_requested_in_use_delta" : "0","mem_in_use_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :4269,"ts" :2517031177,"ph" : "X","name" :"node_add_90_kernel_time","args" : {"mem_requested_in_use_delta" : "0","node_index" : "699","provider" : "CPUExecutionProvider","output_type_shape" : [{"float":[1,96,142080]}],"parameter_size" : "0","mem_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 20, "Distribution": 2, "DistributionEnqueue": 0, "Run": 3980, "Wait": 175, "WaitRevoke": 6}, "sub_threads": {"20368": {"num_run": 93, "core": 10},"50944": {"num_run": 93, "core": 7},"26660": {"num_run": 92, "core": 16},"4492": {"num_run": 93, "core": 15},"58992": {"num_run": 93, "core": 11},"6948": {"num_run": 93, "core": 19},"23204": {"num_run": 93, "core": 4},"38556": {"num_run": 92, "core": 2},"60516": {"num_run": 93, "core": 18},"17584": {"num_run": 93, "core": 5},"59336": {"num_run": 93, "core": 14}}},"mem_arena_held_delta" : "0","input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,142080]}],"op_name" : "Add","mem_arena_held" : "536870992","mem_bytes_requested_in_use" : "221036624","mem_bytes_in_use" : "260522064","mem_in_use_peak" : "261308496","activation_size" : "109117440","output_size" : "54558720"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :8964,"ts" :2517035467,"ph" : "X","name" :"node_conv1d_25_kernel_time","args" : {"mem_arena_held_delta" : "0","parameter_size" : "37248","op_name" : "Conv","mem_in_use_peak" : "261308496","output_size" : "54558720","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 23, "Distribution": 2, "DistributionEnqueue": 0, "Run": 3363, "Wait": 2607, "WaitRevoke": 5}, "sub_threads": {"20368": {"num_run": 94, "core": 7},"50944": {"num_run": 94, "core": 13},"26660": {"num_run": 93, "core": 19},"4492": {"num_run": 94, "core": 15},"58992": {"num_run": 94, "core": 22},"6948": {"num_run": 94, "core": 11},"23204": {"num_run": 94, "core": 4},"38556": {"num_run": 93, "core": 8},"60516": {"num_run": 94, "core": 18},"17584": {"num_run": 94, "core": 10},"59336": {"num_run": 94, "core": 14}}},"mem_in_use_delta" : "0","mem_bytes_in_use" : "260522064","mem_arena_held" : "536870992","node_index" : "700","output_type_shape" : [{"float":[1,96,142080]}],"input_type_shape" : [{"float":[1,96,142080]},{"float":[96,96,1]},{"float":[96]}],"activation_size" : "54558720","mem_requested_in_use_delta" : "0","mem_bytes_requested_in_use" : "221036624","provider" : "CPUExecutionProvider"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :4658,"ts" :2517044468,"ph" : "X","name" :"node_add_91_kernel_time","args" : {"mem_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 5, "Distribution": 4, "DistributionEnqueue": 2, "Run": 4516, "Wait": 3, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 95, "core": 7},"50944": {"num_run": 95, "core": 13},"26660": {"num_run": 94, "core": 19},"4492": {"num_run": 95, "core": 15},"58992": {"num_run": 95, "core": 22},"6948": {"num_run": 95, "core": 11},"23204": {"num_run": 95, "core": 4},"38556": {"num_run": 94, "core": 8},"60516": {"num_run": 95, "core": 18},"17584": {"num_run": 95, "core": 10},"59336": {"num_run": 95, "core": 14}}},"mem_in_use_peak" : "261308496","mem_arena_held" : "536870992","node_index" : "701","mem_bytes_requested_in_use" : "221036624","output_type_shape" : [{"float":[1,96,142080]}],"mem_requested_in_use_delta" : "0","input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,142080]}],"parameter_size" : "0","op_name" : "Add","output_size" : "54558720","activation_size" : "109117440","mem_arena_held_delta" : "0","provider" : "CPUExecutionProvider","mem_bytes_in_use" : "260522064"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2900,"ts" :2517049151,"ph" : "X","name" :"node_mul_146_kernel_time","args" : {"op_name" : "Mul","mem_arena_held" : "536870992","mem_requested_in_use_delta" : "0","mem_bytes_in_use" : "260522064","parameter_size" : "384","output_size" : "54558720","provider" : "CPUExecutionProvider","output_type_shape" : [{"float":[1,96,142080]}],"mem_in_use_peak" : "261308496","input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,1]}],"mem_arena_held_delta" : "0","mem_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 9, "Distribution": 1, "DistributionEnqueue": 0, "Run": 2788, "Wait": 34, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 96, "core": 20},"50944": {"num_run": 96, "core": 23},"26660": {"num_run": 95, "core": 19},"4492": {"num_run": 96, "core": 15},"58992": {"num_run": 96, "core": 10},"6948": {"num_run": 96, "core": 11},"23204": {"num_run": 96, "core": 4},"38556": {"num_run": 95, "core": 12},"60516": {"num_run": 96, "core": 14},"17584": {"num_run": 96, "core": 5},"59336": {"num_run": 96, "core": 8}}},"mem_bytes_requested_in_use" : "221036624","activation_size" : "54558720","node_index" : "702"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :30304,"ts" :2517052062,"ph" : "X","name" :"node_sin_27_kernel_time","args" : {"parameter_size" : "0","mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "221036624","provider" : "CPUExecutionProvider","mem_in_use_peak" : "261308496","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 9, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 96, "core": 20},"50944": {"num_run": 96, "core": 23},"26660": {"num_run": 95, "core": 19},"4492": {"num_run": 96, "core": 15},"58992": {"num_run": 96, "core": 10},"6948": {"num_run": 96, "core": 11},"23204": {"num_run": 96, "core": 4},"38556": {"num_run": 95, "core": 12},"60516": {"num_run": 96, "core": 14},"17584": {"num_run": 96, "core": 5},"59336": {"num_run": 96, "core": 8}}},"activation_size" : "54558720","input_type_shape" : [{"float":[1,96,142080]}],"mem_requested_in_use_delta" : "0","op_name" : "Sin","mem_bytes_in_use" : "260522064","output_size" : "54558720","mem_arena_held" : "536870992","output_type_shape" : [{"float":[1,96,142080]}],"mem_in_use_delta" : "0","node_index" : "703"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2828,"ts" :2517082389,"ph" : "X","name" :"node_pow_44_kernel_time","args" : {"mem_arena_held_delta" : "0","op_name" : "Pow","mem_requested_in_use_delta" : "0","mem_bytes_requested_in_use" : "221036624","output_size" : "54558720","parameter_size" : "4","provider" : "CPUExecutionProvider","mem_arena_held" : "536870992","mem_bytes_in_use" : "260522064","input_type_shape" : [{"float":[1,96,142080]},{"float":[]}],"activation_size" : "54558720","output_type_shape" : [{"float":[1,96,142080]}],"mem_in_use_peak" : "261308496","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 14, "Distribution": 3, "DistributionEnqueue": 1, "Run": 2675, "Wait": 26, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 97, "core": 15},"50944": {"num_run": 97, "core": 11},"26660": {"num_run": 96, "core": 1},"4492": {"num_run": 97, "core": 19},"58992": {"num_run": 97, "core": 10},"6948": {"num_run": 97, "core": 5},"23204": {"num_run": 97, "core": 9},"38556": {"num_run": 96, "core": 14},"60516": {"num_run": 97, "core": 4},"17584": {"num_run": 97, "core": 13},"59336": {"num_run": 97, "core": 18}}},"mem_in_use_delta" : "0","node_index" : "704"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2760,"ts" :2517085239,"ph" : "X","name" :"node_mul_147_kernel_time","args" : {"input_type_shape" : [{"float":[1,96,1]},{"float":[1,96,142080]}],"mem_in_use_delta" : "0","mem_arena_held" : "536870992","node_index" : "705","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 8, "Distribution": 1, "DistributionEnqueue": 0, "Run": 2461, "Wait": 217, "WaitRevoke": 4}, "sub_threads": {"20368": {"num_run": 98, "core": 15},"50944": {"num_run": 98, "core": 11},"26660": {"num_run": 97, "core": 1},"4492": {"num_run": 98, "core": 19},"58992": {"num_run": 98, "core": 10},"6948": {"num_run": 98, "core": 5},"23204": {"num_run": 98, "core": 9},"38556": {"num_run": 97, "core": 14},"60516": {"num_run": 98, "core": 4},"17584": {"num_run": 98, "core": 13},"59336": {"num_run": 98, "core": 18}}},"mem_bytes_requested_in_use" : "221036624","output_type_shape" : [{"float":[1,96,142080]}],"mem_arena_held_delta" : "0","activation_size" : "54558720","mem_bytes_in_use" : "260522064","provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "0","output_size" : "54558720","parameter_size" : "384","op_name" : "Mul","mem_in_use_peak" : "261308496"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :4334,"ts" :2517088013,"ph" : "X","name" :"node_add_92_kernel_time","args" : {"mem_arena_held" : "536870992","mem_bytes_in_use" : "260522064","mem_in_use_delta" : "0","provider" : "CPUExecutionProvider","parameter_size" : "0","output_type_shape" : [{"float":[1,96,142080]}],"input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,142080]}],"op_name" : "Add","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 8, "Distribution": 1, "DistributionEnqueue": 0, "Run": 3795, "Wait": 404, "WaitRevoke": 9}, "sub_threads": {"20368": {"num_run": 99, "core": 15},"50944": {"num_run": 99, "core": 11},"26660": {"num_run": 98, "core": 1},"4492": {"num_run": 99, "core": 19},"58992": {"num_run": 99, "core": 10},"6948": {"num_run": 99, "core": 5},"23204": {"num_run": 99, "core": 9},"38556": {"num_run": 98, "core": 14},"60516": {"num_run": 99, "core": 4},"17584": {"num_run": 99, "core": 13},"59336": {"num_run": 99, "core": 18}}},"mem_in_use_peak" : "261308496","activation_size" : "109117440","mem_requested_in_use_delta" : "0","mem_bytes_requested_in_use" : "221036624","output_size" : "54558720","node_index" : "706","mem_arena_held_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :29995,"ts" :2517092378,"ph" : "X","name" :"node_conv1d_26_kernel_time","args" : {"mem_requested_in_use_delta" : "0","op_name" : "Conv","output_type_shape" : [{"float":[1,96,142080]}],"node_index" : "707","parameter_size" : "258432","mem_in_use_peak" : "261308496","mem_arena_held" : "536870992","mem_in_use_delta" : "0","input_type_shape" : [{"float":[1,96,142080]},{"float":[96,96,7]},{"float":[96]}],"provider" : "CPUExecutionProvider","output_size" : "54558720","mem_arena_held_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 6, "Distribution": 2, "DistributionEnqueue": 0, "Run": 23654, "Wait": 6093, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 100, "core": 0},"50944": {"num_run": 100, "core": 11},"26660": {"num_run": 99, "core": 9},"4492": {"num_run": 100, "core": 19},"58992": {"num_run": 100, "core": 18},"6948": {"num_run": 100, "core": 5},"23204": {"num_run": 100, "core": 19},"38556": {"num_run": 99, "core": 4},"60516": {"num_run": 100, "core": 14},"17584": {"num_run": 100, "core": 4},"59336": {"num_run": 100, "core": 15}}},"mem_bytes_requested_in_use" : "221036624","activation_size" : "54558720","mem_bytes_in_use" : "260522064"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3050,"ts" :2517122400,"ph" : "X","name" :"node_mul_148_kernel_time","args" : {"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 13, "Distribution": 3, "DistributionEnqueue": 1, "Run": 2711, "Wait": 209, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 101, "core": 0},"50944": {"num_run": 101, "core": 11},"26660": {"num_run": 100, "core": 9},"4492": {"num_run": 101, "core": 19},"58992": {"num_run": 101, "core": 18},"6948": {"num_run": 101, "core": 5},"23204": {"num_run": 101, "core": 11},"38556": {"num_run": 100, "core": 4},"60516": {"num_run": 101, "core": 14},"17584": {"num_run": 101, "core": 4},"59336": {"num_run": 101, "core": 15}}},"parameter_size" : "384","input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,1]}],"mem_requested_in_use_delta" : "0","mem_arena_held" : "536870992","mem_bytes_in_use" : "260522064","activation_size" : "54558720","node_index" : "708","output_size" : "54558720","mem_in_use_delta" : "0","mem_in_use_peak" : "261308496","mem_arena_held_delta" : "0","output_type_shape" : [{"float":[1,96,142080]}],"provider" : "CPUExecutionProvider","op_name" : "Mul","mem_bytes_requested_in_use" : "221036624"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :29558,"ts" :2517125474,"ph" : "X","name" :"node_sin_28_kernel_time","args" : {"mem_arena_held_delta" : "0","mem_in_use_delta" : "0","activation_size" : "54558720","mem_arena_held" : "536870992","output_type_shape" : [{"float":[1,96,142080]}],"mem_bytes_in_use" : "260522064","input_type_shape" : [{"float":[1,96,142080]}],"op_name" : "Sin","mem_in_use_peak" : "261308496","parameter_size" : "0","mem_bytes_requested_in_use" : "221036624","mem_requested_in_use_delta" : "0","provider" : "CPUExecutionProvider","node_index" : "709","output_size" : "54558720","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 13, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 101, "core": 0},"50944": {"num_run": 101, "core": 11},"26660": {"num_run": 100, "core": 9},"4492": {"num_run": 101, "core": 19},"58992": {"num_run": 101, "core": 18},"6948": {"num_run": 101, "core": 5},"23204": {"num_run": 101, "core": 11},"38556": {"num_run": 100, "core": 4},"60516": {"num_run": 101, "core": 14},"17584": {"num_run": 101, "core": 4},"59336": {"num_run": 101, "core": 15}}}}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3046,"ts" :2517155064,"ph" : "X","name" :"node_pow_45_kernel_time","args" : {"input_type_shape" : [{"float":[1,96,142080]},{"float":[]}],"op_name" : "Pow","parameter_size" : "4","mem_in_use_peak" : "261308496","mem_requested_in_use_delta" : "0","output_type_shape" : [{"float":[1,96,142080]}],"mem_bytes_requested_in_use" : "221036624","provider" : "CPUExecutionProvider","mem_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 8, "Distribution": 2, "DistributionEnqueue": 1, "Run": 2576, "Wait": 363, "WaitRevoke": 7}, "sub_threads": {"20368": {"num_run": 102, "core": 12},"50944": {"num_run": 102, "core": 15},"26660": {"num_run": 101, "core": 4},"4492": {"num_run": 102, "core": 18},"58992": {"num_run": 102, "core": 19},"6948": {"num_run": 102, "core": 11},"23204": {"num_run": 102, "core": 9},"38556": {"num_run": 101, "core": 14},"60516": {"num_run": 102, "core": 13},"17584": {"num_run": 102, "core": 10},"59336": {"num_run": 102, "core": 5}}},"mem_bytes_in_use" : "260522064","mem_arena_held_delta" : "0","activation_size" : "54558720","mem_arena_held" : "536870992","output_size" : "54558720","node_index" : "710"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3585,"ts" :2517158124,"ph" : "X","name" :"node_mul_149_kernel_time","args" : {"mem_bytes_in_use" : "260522064","input_type_shape" : [{"float":[1,96,1]},{"float":[1,96,142080]}],"activation_size" : "54558720","mem_in_use_peak" : "261308496","mem_arena_held_delta" : "0","parameter_size" : "384","mem_arena_held" : "536870992","output_size" : "54558720","node_index" : "711","mem_bytes_requested_in_use" : "221036624","provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "0","output_type_shape" : [{"float":[1,96,142080]}],"op_name" : "Mul","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 8, "Distribution": 0, "DistributionEnqueue": 0, "Run": 3050, "Wait": 366, "WaitRevoke": 5}, "sub_threads": {"20368": {"num_run": 103, "core": 12},"50944": {"num_run": 103, "core": 15},"26660": {"num_run": 102, "core": 4},"4492": {"num_run": 103, "core": 18},"58992": {"num_run": 103, "core": 19},"6948": {"num_run": 103, "core": 11},"23204": {"num_run": 103, "core": 9},"38556": {"num_run": 102, "core": 14},"60516": {"num_run": 103, "core": 13},"17584": {"num_run": 103, "core": 10},"59336": {"num_run": 103, "core": 5}}},"mem_in_use_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :5093,"ts" :2517161740,"ph" : "X","name" :"node_add_93_kernel_time","args" : {"output_type_shape" : [{"float":[1,96,142080]}],"mem_bytes_requested_in_use" : "221036624","parameter_size" : "0","provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "0","activation_size" : "109117440","mem_arena_held" : "536870992","mem_bytes_in_use" : "260522064","mem_arena_held_delta" : "0","input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,142080]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 17, "Distribution": 3, "DistributionEnqueue": 1, "Run": 4917, "Wait": 24, "WaitRevoke": 3}, "sub_threads": {"20368": {"num_run": 104, "core": 12},"50944": {"num_run": 104, "core": 15},"26660": {"num_run": 103, "core": 4},"4492": {"num_run": 104, "core": 18},"58992": {"num_run": 104, "core": 19},"6948": {"num_run": 104, "core": 11},"23204": {"num_run": 104, "core": 9},"38556": {"num_run": 103, "core": 14},"60516": {"num_run": 104, "core": 13},"17584": {"num_run": 104, "core": 10},"59336": {"num_run": 104, "core": 5}}},"mem_in_use_peak" : "261308496","node_index" : "712","output_size" : "54558720","mem_in_use_delta" : "0","op_name" : "Add"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :9654,"ts" :2517166876,"ph" : "X","name" :"node_conv1d_27_kernel_time","args" : {"input_type_shape" : [{"float":[1,96,142080]},{"float":[96,96,1]},{"float":[96]}],"mem_arena_held" : "536870992","output_size" : "54558720","op_name" : "Conv","activation_size" : "54558720","mem_bytes_in_use" : "180863056","mem_requested_in_use_delta" : "0","parameter_size" : "37248","mem_bytes_requested_in_use" : "166477904","mem_in_use_delta" : "0","output_type_shape" : [{"float":[1,96,142080]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 18, "Distribution": 3, "DistributionEnqueue": 0, "Run": 6454, "Wait": 3, "WaitRevoke": 1}, "sub_threads": {"20368": {"num_run": 105, "core": 4},"50944": {"num_run": 105, "core": 19},"26660": {"num_run": 104, "core": 5},"4492": {"num_run": 105, "core": 18},"58992": {"num_run": 105, "core": 11},"6948": {"num_run": 105, "core": 14},"23204": {"num_run": 105, "core": 23},"38556": {"num_run": 104, "core": 7},"60516": {"num_run": 105, "core": 16},"17584": {"num_run": 105, "core": 8},"59336": {"num_run": 105, "core": 6}}},"node_index" : "713","mem_arena_held_delta" : "0","mem_in_use_peak" : "261308496","provider" : "CPUExecutionProvider"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :4448,"ts" :2517176553,"ph" : "X","name" :"node_add_94_kernel_time","args" : {"op_name" : "Add","output_size" : "54558720","mem_in_use_delta" : "0","mem_in_use_peak" : "261308496","mem_arena_held_delta" : "0","activation_size" : "109117440","parameter_size" : "0","output_type_shape" : [{"float":[1,96,142080]}],"mem_bytes_in_use" : "180863056","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 14, "Distribution": 2, "DistributionEnqueue": 0, "Run": 3773, "Wait": 543, "WaitRevoke": 7}, "sub_threads": {"20368": {"num_run": 106, "core": 4},"50944": {"num_run": 106, "core": 19},"26660": {"num_run": 105, "core": 5},"4492": {"num_run": 106, "core": 18},"58992": {"num_run": 106, "core": 11},"6948": {"num_run": 106, "core": 14},"23204": {"num_run": 106, "core": 23},"38556": {"num_run": 105, "core": 7},"60516": {"num_run": 106, "core": 16},"17584": {"num_run": 106, "core": 8},"59336": {"num_run": 106, "core": 6}}},"input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,142080]}],"provider" : "CPUExecutionProvider","mem_arena_held" : "536870992","mem_bytes_requested_in_use" : "166477904","node_index" : "714","mem_requested_in_use_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :2944,"ts" :2517181025,"ph" : "X","name" :"node_mul_150_kernel_time","args" : {"output_type_shape" : [{"float":[1,96,142080]}],"output_size" : "54558720","mem_requested_in_use_delta" : "0","mem_bytes_requested_in_use" : "166477904","op_name" : "Mul","mem_arena_held_delta" : "0","activation_size" : "54558720","mem_bytes_in_use" : "180863056","node_index" : "715","mem_arena_held" : "536870992","mem_in_use_delta" : "0","provider" : "CPUExecutionProvider","input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,1]}],"thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 17, "Distribution": 1, "DistributionEnqueue": 0, "Run": 2797, "Wait": 11, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 107, "core": 20},"50944": {"num_run": 107, "core": 18},"26660": {"num_run": 106, "core": 17},"4492": {"num_run": 107, "core": 4},"58992": {"num_run": 107, "core": 21},"6948": {"num_run": 107, "core": 19},"23204": {"num_run": 107, "core": 5},"38556": {"num_run": 106, "core": 11},"60516": {"num_run": 107, "core": 22},"17584": {"num_run": 107, "core": 16},"59336": {"num_run": 107, "core": 14}}},"parameter_size" : "384","mem_in_use_peak" : "261308496"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :31140,"ts" :2517184001,"ph" : "X","name" :"node_sin_29_kernel_time","args" : {"output_size" : "54558720","mem_bytes_in_use" : "180863056","mem_arena_held" : "536870992","provider" : "CPUExecutionProvider","mem_bytes_requested_in_use" : "166477904","input_type_shape" : [{"float":[1,96,142080]}],"mem_in_use_delta" : "0","mem_requested_in_use_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 17, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 107, "core": 20},"50944": {"num_run": 107, "core": 18},"26660": {"num_run": 106, "core": 17},"4492": {"num_run": 107, "core": 4},"58992": {"num_run": 107, "core": 21},"6948": {"num_run": 107, "core": 19},"23204": {"num_run": 107, "core": 5},"38556": {"num_run": 106, "core": 11},"60516": {"num_run": 107, "core": 22},"17584": {"num_run": 107, "core": 16},"59336": {"num_run": 107, "core": 14}}},"mem_in_use_peak" : "261308496","op_name" : "Sin","output_type_shape" : [{"float":[1,96,142080]}],"mem_arena_held_delta" : "0","activation_size" : "54558720","node_index" : "716","parameter_size" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3029,"ts" :2517215162,"ph" : "X","name" :"node_pow_46_kernel_time","args" : {"mem_in_use_delta" : "0","output_type_shape" : [{"float":[1,96,142080]}],"mem_bytes_requested_in_use" : "166477904","input_type_shape" : [{"float":[1,96,142080]},{"float":[]}],"op_name" : "Pow","mem_arena_held_delta" : "0","node_index" : "717","output_size" : "54558720","mem_bytes_in_use" : "180863056","activation_size" : "54558720","mem_arena_held" : "536870992","parameter_size" : "4","mem_in_use_peak" : "261308496","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 10, "Distribution": 3, "DistributionEnqueue": 1, "Run": 2673, "Wait": 237, "WaitRevoke": 6}, "sub_threads": {"20368": {"num_run": 108, "core": 12},"50944": {"num_run": 108, "core": 2},"26660": {"num_run": 107, "core": 5},"4492": {"num_run": 108, "core": 11},"58992": {"num_run": 108, "core": 14},"6948": {"num_run": 108, "core": 18},"23204": {"num_run": 108, "core": 8},"38556": {"num_run": 107, "core": 9},"60516": {"num_run": 108, "core": 3},"17584": {"num_run": 108, "core": 15},"59336": {"num_run": 108, "core": 19}}},"provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3131,"ts" :2517218210,"ph" : "X","name" :"node_mul_151_kernel_time","args" : {"mem_bytes_in_use" : "180863056","input_type_shape" : [{"float":[1,96,1]},{"float":[1,96,142080]}],"mem_in_use_delta" : "0","mem_arena_held_delta" : "0","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [2], "core": 10, "Distribution": 1, "DistributionEnqueue": 0, "Run": 2801, "Wait": 242, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 109, "core": 12},"50944": {"num_run": 109, "core": 2},"26660": {"num_run": 108, "core": 5},"4492": {"num_run": 109, "core": 11},"58992": {"num_run": 109, "core": 14},"6948": {"num_run": 109, "core": 18},"23204": {"num_run": 109, "core": 8},"38556": {"num_run": 108, "core": 9},"60516": {"num_run": 109, "core": 3},"17584": {"num_run": 109, "core": 15},"59336": {"num_run": 109, "core": 19}}},"activation_size" : "54558720","node_index" : "718","output_size" : "54558720","mem_bytes_requested_in_use" : "166477904","provider" : "CPUExecutionProvider","output_type_shape" : [{"float":[1,96,142080]}],"op_name" : "Mul","mem_in_use_peak" : "261308496","parameter_size" : "384","mem_arena_held" : "536870992","mem_requested_in_use_delta" : "0"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :4206,"ts" :2517221362,"ph" : "X","name" :"node_add_95_kernel_time","args" : {"mem_bytes_in_use" : "180863056","mem_in_use_peak" : "261308496","output_type_shape" : [{"float":[1,96,142080]}],"provider" : "CPUExecutionProvider","mem_arena_held" : "536870992","mem_requested_in_use_delta" : "0","activation_size" : "109117440","op_name" : "Add","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [284160], "core": 10, "Distribution": 1, "DistributionEnqueue": 0, "Run": 4063, "Wait": 28, "WaitRevoke": 2}, "sub_threads": {"20368": {"num_run": 110, "core": 12},"50944": {"num_run": 110, "core": 2},"26660": {"num_run": 109, "core": 5},"4492": {"num_run": 110, "core": 11},"58992": {"num_run": 110, "core": 14},"6948": {"num_run": 110, "core": 18},"23204": {"num_run": 110, "core": 8},"38556": {"num_run": 109, "core": 9},"60516": {"num_run": 110, "core": 3},"17584": {"num_run": 110, "core": 15},"59336": {"num_run": 110, "core": 19}}},"mem_in_use_delta" : "0","output_size" : "54558720","node_index" : "719","parameter_size" : "0","input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,142080]}],"mem_arena_held_delta" : "0","mem_bytes_requested_in_use" : "166477904"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :3808,"ts" :2517225610,"ph" : "X","name" :"node_conv1d_28_kernel_time","args" : {"mem_in_use_delta" : "568320","mem_bytes_in_use" : "59763792","activation_size" : "54558720","mem_bytes_requested_in_use" : "57928784","node_index" : "760","mem_arena_held_delta" : "0","input_type_shape" : [{"float":[1,96,142080]},{"float":[1,96,7]},{"float":[1]}],"op_name" : "FusedConv","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [1], "core": 9, "Distribution": 2, "DistributionEnqueue": 0, "Run": 3195, "Wait": 467, "WaitRevoke": 4}, "sub_threads": {"20368": {"num_run": 111, "core": 12},"50944": {"num_run": 111, "core": 2},"26660": {"num_run": 110, "core": 10},"4492": {"num_run": 111, "core": 14},"58992": {"num_run": 111, "core": 11},"6948": {"num_run": 111, "core": 20},"23204": {"num_run": 111, "core": 8},"38556": {"num_run": 110, "core": 9},"60516": {"num_run": 111, "core": 15},"17584": {"num_run": 111, "core": 21},"59336": {"num_run": 111, "core": 19}}},"mem_in_use_peak" : "261308496","provider" : "CPUExecutionProvider","mem_requested_in_use_delta" : "568320","parameter_size" : "2692","output_type_shape" : [{"float":[1,1,142080]}],"mem_arena_held" : "536870992","output_size" : "568320"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :38,"ts" :2517229448,"ph" : "X","name" :"node_view_32_kernel_time","args" : {"output_type_shape" : [{"float":[1,142080]}],"mem_arena_held" : "536870992","parameter_size" : "16","mem_in_use_delta" : "0","mem_in_use_peak" : "261308496","activation_size" : "568320","mem_bytes_in_use" : "5205072","mem_bytes_requested_in_use" : "3370064","node_index" : "722","output_size" : "568320","input_type_shape" : [{"float":[1,1,142080]},{"int64":[2]}],"mem_requested_in_use_delta" : "0","provider" : "CPUExecutionProvider","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 9, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 111, "core": 12},"50944": {"num_run": 111, "core": 2},"26660": {"num_run": 110, "core": 10},"4492": {"num_run": 111, "core": 14},"58992": {"num_run": 111, "core": 11},"6948": {"num_run": 111, "core": 20},"23204": {"num_run": 111, "core": 8},"38556": {"num_run": 110, "core": 9},"60516": {"num_run": 111, "core": 15},"17584": {"num_run": 111, "core": 21},"59336": {"num_run": 111, "core": 19}}},"mem_arena_held_delta" : "0","op_name" : "Reshape"}},
|
||||
{"cat" : "Node","pid" :38024,"tid" :24636,"dur" :43,"ts" :2517229558,"ph" : "X","name" :"node_slice_43_kernel_time","args" : {"provider" : "CPUExecutionProvider","node_index" : "723","activation_size" : "568320","mem_in_use_peak" : "261308496","parameter_size" : "32","output_type_shape" : [{"float":[1,3840]}],"mem_arena_held_delta" : "0","mem_arena_held" : "536870992","mem_bytes_in_use" : "5220432","output_size" : "15360","mem_bytes_requested_in_use" : "3385424","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "24636", "block_size": [], "core": 9, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"20368": {"num_run": 111, "core": 12},"50944": {"num_run": 111, "core": 2},"26660": {"num_run": 110, "core": 10},"4492": {"num_run": 111, "core": 14},"58992": {"num_run": 111, "core": 11},"6948": {"num_run": 111, "core": 20},"23204": {"num_run": 111, "core": 8},"38556": {"num_run": 110, "core": 9},"60516": {"num_run": 111, "core": 15},"17584": {"num_run": 111, "core": 21},"59336": {"num_run": 111, "core": 19}}},"op_name" : "Slice","mem_in_use_delta" : "15360","input_type_shape" : [{"float":[1,142080]},{"int64":[1]},{"int64":[1]},{"int64":[1]},{"int64":[1]}],"mem_requested_in_use_delta" : "15360"}},
|
||||
{"cat" : "Session","pid" :38024,"tid" :24636,"dur" :2204385,"ts" :2515025229,"ph" : "X","name" :"SequentialExecutor::Execute","args" : {}},
|
||||
{"cat" : "Session","pid" :38024,"tid" :24636,"dur" :2204525,"ts" :2515025176,"ph" : "X","name" :"model_run","args" : {}}
|
||||
]
|
||||
+20
@@ -0,0 +1,20 @@
|
||||
{
|
||||
"scope": "compiler bisection component, not a vocoder waveform or TTS stream",
|
||||
"source_sha256": "e563541bf77200ac4c4ca9d6e01cd7e25c09f9274233a8d82eeccc57580830d2",
|
||||
"source_node_count": 712,
|
||||
"cut_one_based": 521,
|
||||
"terminal_node": "node_sin_1",
|
||||
"terminal_op": "Sin",
|
||||
"terminal_output": "sin_1",
|
||||
"boundary_inputs": [
|
||||
"mul_94"
|
||||
],
|
||||
"extracted_node_count": 1,
|
||||
"extracted_ops": {
|
||||
"Sin": 1
|
||||
},
|
||||
"output_type": "tensor_type {\n elem_type: 1\n shape {\n dim {\n dim_value: 1\n }\n dim {\n dim_value: 1536\n }\n dim {\n dim_value: 296\n }\n }\n}\n",
|
||||
"candidate_file": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\qwen3tts_vitisai_local_sin0_20260924.onnx",
|
||||
"candidate_bytes": 1640,
|
||||
"candidate_sha256": "da6bfdbefab41639c15506156b56f6a68f77487f960228cdf256b39615fc2702"
|
||||
}
|
||||
+41
@@ -0,0 +1,41 @@
|
||||
{
|
||||
"scope": "compiler bisection component, not a vocoder waveform or TTS stream",
|
||||
"source_sha256": "e563541bf77200ac4c4ca9d6e01cd7e25c09f9274233a8d82eeccc57580830d2",
|
||||
"source_node_count": 712,
|
||||
"cut_one_based": 521,
|
||||
"terminal_node": "node_sin_1",
|
||||
"terminal_op": "Sin",
|
||||
"terminal_output": "sin_1",
|
||||
"boundary_inputs": [
|
||||
"mul_94"
|
||||
],
|
||||
"extracted_node_count": 1,
|
||||
"extracted_ops": {
|
||||
"Sin": 1
|
||||
},
|
||||
"output_type": "tensor_type {\n elem_type: 1\n shape {\n dim {\n dim_value: 1\n }\n dim {\n dim_value: 1536\n }\n dim {\n dim_value: 296\n }\n }\n}\n",
|
||||
"candidate_file": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\qwen3tts_vitisai_local_sin0_20260924.onnx",
|
||||
"candidate_bytes": 1640,
|
||||
"candidate_sha256": "da6bfdbefab41639c15506156b56f6a68f77487f960228cdf256b39615fc2702",
|
||||
"os": "Windows-11-10.0.26200-SP0",
|
||||
"onnxruntime_version": "1.30.0",
|
||||
"fixture_sha256": null,
|
||||
"input_provenance": "synthetic fixed-seed normal",
|
||||
"status": "component_not_qualified",
|
||||
"cpu_output_shape": [
|
||||
1,
|
||||
1536,
|
||||
296
|
||||
],
|
||||
"cpu_output_finite": true,
|
||||
"cpu_inference_s": 0.002224600058980286,
|
||||
"vitisai_npu_device_count": 1,
|
||||
"vitisai_session_create_s": 2.127084600040689,
|
||||
"vitisai_inference_s": 0.001873199944384396,
|
||||
"vitisai_output_finite": true,
|
||||
"relative_l2_vs_cpu": 0.0,
|
||||
"profile_file": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\results\\e2e_expansion_20260924\\evidence\\qwen_tts_amd_npu_vocoder\\local_sin0_profile_2026-09-24_19-51-29_472.json",
|
||||
"node_providers": {
|
||||
"CPUExecutionProvider": 1
|
||||
}
|
||||
}
|
||||
BIN
Binary file not shown.
+7
@@ -0,0 +1,7 @@
|
||||
[
|
||||
{"cat" : "Session","pid" :36516,"tid" :14724,"dur" :6051,"ts" :17,"ph" : "X","name" :"model_loading_uri","args" : {}},
|
||||
{"cat" : "Session","pid" :36516,"tid" :14724,"dur" :2115946,"ts" :7077,"ph" : "X","name" :"session_initialization","args" : {}},
|
||||
{"cat" : "Node","pid" :36516,"tid" :14724,"dur" :1531,"ts" :2130605,"ph" : "X","name" :"node_sin_1_kernel_time","args" : {"mem_requested_in_use_delta" : "1818624","thread_scheduling_stats" : {"main_thread": {"thread_pool_name": "session-2-intra-op", "thread_id": "14724", "block_size": [], "core": -1, "Distribution": 0, "DistributionEnqueue": 0, "Run": 0, "Wait": 0, "WaitRevoke": 0}, "sub_threads": {"44916": {"num_run": 0, "core": -1},"53564": {"num_run": 0, "core": -1},"38880": {"num_run": 0, "core": -1},"37780": {"num_run": 0, "core": -1},"32360": {"num_run": 0, "core": -1},"16312": {"num_run": 0, "core": -1},"66248": {"num_run": 0, "core": -1},"51088": {"num_run": 0, "core": -1},"41124": {"num_run": 0, "core": -1},"45940": {"num_run": 0, "core": -1},"13528": {"num_run": 0, "core": -1}}},"mem_arena_held_delta" : "2097152","output_type_shape" : [{"float":[1,1536,296]}],"mem_bytes_in_use" : "2097152","output_size" : "1818624","node_index" : "0","activation_size" : "1818624","op_name" : "Sin","provider" : "CPUExecutionProvider","parameter_size" : "0","mem_in_use_peak" : "2097152","input_type_shape" : [{"float":[1,1536,296]}],"mem_in_use_delta" : "2097152","mem_arena_held" : "2097152","mem_bytes_requested_in_use" : "1818624"}},
|
||||
{"cat" : "Session","pid" :36516,"tid" :14724,"dur" :1582,"ts" :2130596,"ph" : "X","name" :"SequentialExecutor::Execute","args" : {}},
|
||||
{"cat" : "Session","pid" :36516,"tid" :14724,"dur" :1683,"ts" :2130542,"ph" : "X","name" :"model_run","args" : {}}
|
||||
]
|
||||
@@ -59,7 +59,7 @@ NOT E2E means no complete device/model workload was verified. “Scoped E2E” i
|
||||
| PC HX370 + RTX 5090 Laptop / WSL | profile completed | profile completed | scoped E2E: text + image | scoped E2E: text/image/audio → speech | synthetic policy pass: admitted Omni CUDA |
|
||||
| PC HX370 + RTX 5090 Laptop / Windows | scoped E2E: Omni Spark 1.7B GGUF text on RTX Vulkan; fresh restart after in-flight cancel (separate 4B BF16 CUDA profile) | scoped E2E: Omni RTX Vulkan talker/codec + CPU predictor complete WAV and restart (separate CUDA stream has playback jitter) | scoped E2E: Omni FP8 Triton text+image on RTX; separate NVFP4 Windows startup failed | scoped E2E: text/image/audio → speech | synthetic policy pass: admitted Omni CUDA |
|
||||
| PC HX370 + Radeon 890M / Windows worker | scoped E2E: Omni Spark text; fresh restart after in-flight cancel | scoped E2E: Omni Radeon talker/codec + CPU predictor; fresh restart after in-flight cancel | scoped E2E: Omni Q4_K_M GGUF Radeon text+image (20 each; slower than CPU here) | scoped E2E: Omni Radeon+CPU image+audio → text+speech (native-storage 20-run profile) | synthetic policy pass: Omni CPU+Radeon Cosmos (WSL/native Windows) |
|
||||
| PC HX370 + AMD NPU / Windows worker | NOT E2E (output-head component passed) | NOT E2E (real Code2Wav prefixes to 200 nodes executed on NPU; 1D decoder compiler crash isolated; 2D rewrite exact on CPU, full NPU waveform unqualified) | NOT E2E | NOT E2E | NOT E2E |
|
||||
| PC HX370 + AMD NPU / Windows worker | NOT E2E (output-head component passed) | NOT E2E (real Code2Wav prefixes ran on NPU; 2D decoder rewrite enabled mixed NPU/CPU short window, but waveform failed at 15.7% relative L2) | NOT E2E | NOT E2E | NOT E2E |
|
||||
| PC CPU+iGPU+NPU +/- discrete GPU, joint model execution | NOT E2E | NOT E2E | NOT E2E | NOT E2E | NOT E2E |
|
||||
| PC Snapdragon X Elite CRD / AI Hub | NOT E2E (one Spark attention layer on NPU) | NOT E2E (CPU talker/vocoder steps; two-frame QNN vocoder on NPU, component RTF 22.89) | NOT E2E | NOT E2E (NPU speech-head step profiled) | NOT E2E (Cosmos NPU encoder profiled) |
|
||||
| Mobile Galaxy S25 / Snapdragon 8 Elite for Galaxy | NOT E2E (one Spark attention layer on NPU) | NOT E2E (FP16 talker token mismatch; CPU talker + vocoder profiled; 25-frame and two-frame QNN vocoder memory failures; historical 25-frame TFLite mixed vocoder component RTF 0.420; pinned 25-frame mixed CPU/GPU vocoder profiled at RTF 0.335; generated-code waveform measured; short chunk RTF 3.49) | NOT E2E | NOT E2E (NPU speech head step profiled) | NOT E2E (Cosmos NPU encoder profiled) |
|
||||
@@ -97,7 +97,7 @@ NOT E2E means no complete device/model workload was verified. “Scoped E2E” i
|
||||
| PC HX370 + Radeon 890M / Windows worker | MiniCPM-o 4.5 | SCOPED_E2E_OMNI_COMPLETE_REQUEST_HYBRID; NATIVE_STORAGE_PROFILED | The pinned Q4_K_M/F16 GGUF combined synthetic spoken-question+JPEG → text+speech route passed one warmup and 20/20 serial complete requests through a bounded Omni whole-session stage with weights on native NTFS. Nearest-rank wall p50/p95 was **16.35/17.20 s**, range 14.08–17.30 s, excluding 8.75 s startup; all requests returned the red-square sentence and nonzero 2.08–2.88 s 24 kHz speech with terminal audio events. The first WAV exactly matched pinned Whisper tiny.en ASR (WER 0, one-output intelligibility proxy). All 21 successful worker logs identified Radeon 890M Vulkan0 language (37/37 layers) and vision plus CPU Token2Wav, with zero prefetch warnings; sampled RSS peaked at 15.30 GB. The 21 GiB shared-RAM reservation admitted after file-cache reclaim; an initial identical attempt was explicitly refused before model load when available RAM had fallen below reservation. Cancellation left no stale output or reservation. A sequential same-artifact one-request UNC control took 90.63 s versus 16.89 s native and logged two prefetch warnings; the previous UNC 20-request profile remains p50/p95 87.27/91.45 s for that path. Storage is strongly associated with the slowdown, but OS cache/run order are uncontrolled and the separate CPU/Radeon profiles are not a qualified iGPU speedup comparison. This is CPU+iGPU joint execution, not all-Radeon, NPU, general quality, playable streaming or sustained thermal/power qualification. | Validate real multimodal quality, playable streaming, post-cancel restart, concurrency, loading peak and sustained power/thermal behavior; capture matched OS/shared-iGPU memory traces. [Native/UNC raw evidence](../../../e2e_expansion_20260923/evidence/minicpmo_omni_native_weights_io/README.md), [earlier UNC 20-request evidence](../../../e2e_expansion_20260923/evidence/minicpmo_omni_radeon_profile20/README.md). |
|
||||
| PC HX370 + Radeon 890M / Windows worker | InternVLA-A1 | SYNTHETIC_POLICY_PASS_HYBRID_OMNI; NOT_TASK_E2E | The real Place_Markpen checkpoint ran in admitted Omni whole-policy stages on both WSL CPU+Radeon and native Windows CPU+Radeon. In each, the BF16 Qwen3-VL/flow action policy stayed on CPU and a pinned six-frame FP32 Cosmos encoder used Omni's external DirectML worker; the selected Radeon 890M and graph output device were verified, without internal per-op attribution. Each placement returned 20/20 identical finite `[1,50,32]` actions after one warmup. WSL hybrid complete-request p50/p95 was 3.120/3.197 s versus its separate CPU baseline 3.175/3.219 s, with action relative L2 difference 2.305%. Native Windows hybrid was 4.575/4.725 s versus its separate CPU baseline 4.878/4.902 s, with action relative L2 difference 2.4391%. Native hybrid startup was 140.31 s versus CPU 135.60 s. These are separate one-fixture serial runs, not paired speedup or task-quality proof. FP32 encoder is an explicit precision change after DirectML BF16 aborted. Both stages verified hashes, reserved 16 GiB shared host RAM, rejected insufficient demand before launch, emitted terminal actions through public `AsyncOmni.generate`, and released reservations after in-flight cancellation/shutdown. An initial WSL hybrid shutdown quarantined 16 GiB; the lifecycle fix and reruns cleared it. The older direct hybrid zero-input profile is a different experiment. | Validate real observations/reference actions, physical units/order/step time, post-cancel restart, loading peak, concurrency and sustained tail/power before deployment; [WSL Omni evidence](../../../e2e_expansion_20260923/evidence/internvla_omni_policy/README.md), [native Windows Omni evidence](../../../e2e_expansion_20260923/evidence/internvla_omni_windows_hybrid/README.md), [earlier direct component evidence](../../../e2e_expansion_20260923/evidence/internvla_cosmos_radeon890m/README.md). |
|
||||
| PC HX370 + AMD NPU / Windows worker | Spark-X2.5 | COMPONENT_PASS; NOT_E2E_PROFILEABLE | The real 1.7B output head (RMS norm and full 131,072-logit projection) ran through Omni `external.graph.v1` with VitisAI: one fused NPU partition and seven CPU nodes per request. The A16W8 graph matched top-1 on four captured activations (full-logit SNR 55.43–56.81 dB). One warmup plus 20 serial repeated-input component requests gave p50/p95 10.21/12.44 ms, versus 17.97/20.29 ms for the original FP32 output head on the same Omni CPU stage. NPU startup was 18.21 s versus 4.48 s for FP32 CPU, and NPU worker peak RSS was 3.52 GiB versus 2.06 GiB. No full prefill/decode/KV/sampling, real handoff, power, or sustained run was verified. | Measure an actual vLLM-to-output-head handoff and whole-generation cost, state/cancellation, memory admission and quality before considering a split plan; [component evidence](../../../e2e_expansion_20260923/evidence/spark_amd_npu_output_head/README.md). |
|
||||
| PC HX370 + AMD NPU / Windows worker | Qwen3-TTS 0.6B CustomVoice | PREFIX_NPU_COMPONENT_PASS; DECODER_2D_REWRITE_CPU_PARITY_PASS; NOT_E2E_PROFILEABLE | The original real-weight FP32 25-frame and pinned two-frame Code2Wav graphs reproduced retained CPU waveforms, but VitisAI EP 1.8.63.0 crashed during session creation. Four extracted two-frame prefixes (18/50/97/192 nodes) then each executed one actual VitisAI NPU partition, with one-fixture intermediate relative L2 0.958%/1.059%/0.391%/1.083% versus CPU; these are not waveform or task-quality passes. An isolated original 1D decoder ConvTranspose reproduced the native LLVM ArrayRef assertion. Expressing it as an equivalent 2D convolution compiled and ran on one NPU node; its synthetic-input output differed 1.636% from CPU. Rewriting all six decoder upsampling convolutions made the full two-frame CPU waveform bitwise identical to the source. Full rewritten NPU waveform, stage handoff, whole TTS stream, latency and power remain unverified. The historical export revision is unattested; the two-frame source is pinned to CustomVoice revision 85e237c. | Complete full-graph NPU compilation and waveform/numeric/listening gates; profile actual placement, memory and coarse-stage benefit, then run the complete Omni TTS workload with state, cancellation and admission. [Raw AMD NPU bisection and rewrite evidence](../../../e2e_expansion_20260924/evidence/qwen_tts_amd_npu_vocoder/README.md). |
|
||||
| PC HX370 + AMD NPU / Windows worker | Qwen3-TTS 0.6B CustomVoice | PREFIX_NPU_COMPONENT_PASS; MIXED_NPU_CPU_WAVEFORM_NUMERIC_FAILED; NOT_E2E_PROFILEABLE | The original real-weight FP32 25-frame and pinned two-frame Code2Wav graphs reproduced retained CPU waveforms, but VitisAI EP 1.8.63.0 crashed during session creation. Four extracted two-frame prefixes (18/50/97/192 nodes) then each executed one actual VitisAI NPU partition, with one-fixture intermediate relative L2 0.958%/1.059%/0.391%/1.083% versus CPU; these are not waveform or task-quality passes. An isolated original 1D decoder ConvTranspose reproduced the native LLVM ArrayRef assertion. Expressing it as an equivalent 2D convolution compiled and ran on one NPU node; its synthetic-input output differed 1.636% from CPU. Rewriting all six decoder upsampling convolutions made the full two-frame CPU waveform bitwise identical to the source. The rewritten short graph then completed with two VitisAI and 139 CPU node events, but the one-fixture waveform missed the 1% gate at 15.696% relative L2 / 16.08 dB SNR. Its 2515 s session build and one cold 2.205 s inference for 0.16 s audio are component observations, not a steady profile. Whole TTS streaming, stage handoff, quality, memory and power remain unverified. The historical export revision is unattested; the two-frame source is pinned to CustomVoice revision 85e237c. | Localize the mixed-route waveform error and meet numerical/listening gates, then warm-profile placement, memory and coarse-stage benefit before running complete Omni TTS with state, cancellation and admission. [Raw AMD NPU bisection and rewrite evidence](../../../e2e_expansion_20260924/evidence/qwen_tts_amd_npu_vocoder/README.md). |
|
||||
| PC HX370 + AMD NPU / Windows worker | Qwen3.8-27B | NOT_E2E_PROFILEABLE | The tested A16W8 whole-vision-tower export failed NPU placement. This conclusion is specific to that export, not all future Qwen/NPU combinations. | Validate a supported export or smaller useful component, including same-checkpoint numerical quality. |
|
||||
| PC HX370 + AMD NPU / Windows worker | MiniCPM-o 4.5 | NOT_E2E_PROFILEABLE | No placement- and quality-verified whole-model graph bundle/stateful adapter for this model on this AMD route. Small backend graphs do not establish model support. | Supply and validate the missing matching artifact/backend, then run the complete specified workload. |
|
||||
| PC HX370 + AMD NPU / Windows worker | InternVLA-A1 | COMPONENT_EXPORT_CPU_PASS; NPU_ARTIFACTS_REJECTED; NOT_E2E_PROFILEABLE | The real Place_Markpen Cosmos CI8x8 encoder exported to fixed FP32 [6,3,256,256] -> [6,16,32,32] ONNX; ORT CPU matched the source on two fixtures with relative L2 8.74e-7/2.29e-6. A16W8 Conv+MatMul QDQ changed encoder output by 11.77%/5.03% on CPU and the VitisAI compiler emitted a missing-scale fatal assertion. MatMul-only A16W8 retained near-source CPU parity, but its original and ORT-preprocessed graphs each hit a native SmallVector compiler assertion. No VitisAI node executed, so this is not NPU component placement or complete InternVLA policy support. Failures are specific to these artifacts and EP 1.8.63.0. | Produce a VitisAI-supported whole-encoder or coarse substage artifact with representative calibration and numerical/policy tolerances; then verify actual NPU nodes, same-device handoff, full-policy behavior and memory/power before changing this disposition. [raw export and failure evidence](../../../e2e_expansion_20260923/evidence/internvla_cosmos_amd_npu/README.md). |
|
||||
|
||||
Reference in new issue
Block a user