Add local E2E profiling evidence and support roadmap

This commit is contained in:
tzhouam committed 2026-09-22 19:25:02 +08:00
1 parent ab2f2a3d65
commit 75b65f859b
955 files changed
+3607925

No files matched your search

+167
View File
@@ -0,0 +1,167 @@
# Local model qualification and profiling
These runners exercise existing Omni implementations with real weights. They
do not add device or model support. A completed timing run is distinct from
reference-quality, streaming, fault-recovery and release qualification.
## Matrix and prerequisites
The [60-cell audit](results/model_device_matrix_20260922/README.md) covers twelve
PC/mobile/embedded configurations and five model families. Its raw evidence
distinguishes complete pipelines from components and backend-only probes.
Unavailable complete pipelines retain a reason and next repair step; a missing
measurement is never represented as zero latency.
Use the actual installed runtime and exact checkpoint identified in the result,
including quantization, rather than substituting another family member. The
current Spark CPU runner uses 1.7B INT8 and the CUDA runner uses 4B BF16. Their
results do not establish same-model acceleration. Qwen3-TTS uses the pinned
0.6B CustomVoice checkpoint, English/Vivian, through both Omni stages.
Windows and WSL are distinct configurations on the same physical laptop.
Run benchmarks serially: they share CPU, physical RAM, GPU and power limits.
GPU board power is not whole-device energy. Windows used RAM includes WSL;
do not add Windows and WSL counters as independent memory pools.
## Run the workload
Run from the repository root using the model's validated Python environment:
```bash
PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 \
python benchmarks/edge_harness/profile_local_text.py \
--model /absolute/path/to/checkpoint --out /absolute/path/to/new-run
PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 \
python benchmarks/edge_harness/profile_local_tts.py \
--model /absolute/path/to/customvoice-checkpoint --out /absolute/path/to/new-run
```
Set the validated CPU thread/KV-cache settings or CUDA compiler environment
before launching. Native Windows requires UTF-8 Python mode before interpreter
startup (`PYTHONUTF8=1`, `PYTHONIOENCODING=utf-8`). The common benchmark helper
uses the active environment's `torch/lib/cudart64_13.dll` when present and a
short `~/c29` vLLM cache path unless explicitly overridden. These reproduce
settings required by the tested Windows installation; they are not a general
claim about other CUDA/runtime versions.
Both runners require a new output directory and default to:
- Three input lengths × concurrency 1/2/4 × 20 measured requests per group.
- Separate warmup requests, excluded from group percentiles.
- At least 1800 seconds of continuous medium-input requests.
- Slow-consumer, cancellation and subsequent-request checks.
Text timing forces 128 output tokens with greedy sampling and records actual
input lengths, token IDs, sequence/epoch metadata and queue high-water marks.
It does not recommend those sampling settings for applications. TTS requires
DELTA output, records every audio chunk including terminal audio, verifies
finite PCM, and archives warmup float32 chunks with hashes. Playback underruns
are simulated from chunk arrivals; no sound-device playback or perceptual
quality is implied.
`profile_host_command.py` wraps an explicit command on Windows to collect
one-second host-memory, AC/battery and whole-NVIDIA-device telemetry. Each host
directory retains the exact command, exit status and combined log. Existing
disk/JIT caches are used. Constructor time is not a cold-disk measurement and
must remain separate from request latency. Sampled memory peaks are lower
bounds, not proof that every transient allocation was observed.
On Windows, a live reader can deny replacement of a report snapshot. The
writer defers such running updates, records the permission error, and requires
the final snapshot to persist. Request JSONL is the primary sample record.
Read live reports through Linux when they reside in WSL, or use a Windows
reader that permits file deletion/replacement. Failed profile/trace reports
produce a nonzero exit code in the current runners; historical attempts may
require inspection of the report rather than relying on the process exit code.
## Separate diagnostics
After timing runs finish, use `profile_trace_diagnostic.py --kind spark|tts`
with the same `--model` and a fresh `--out`. It invokes Omni's profiler RPCs and
measures three requests before, during and after tracing. Current text traces
use 32 generated tokens and disable expensive shape/memory instrumentation.
Compare paired diagnostic requests, not these 32-token times against the
128-token baseline. Profiler start/stop/export costs are recorded separately
when supported. The initial archived CPU diagnostic used full instrumentation
and 128 tokens; its configuration and limitations are retained in its report.
Run `check_text_reliability.py` or `check_tts_reliability.py` separately. They
test real-model interruption/recovery and deliberately terminate a worker
belonging to their own engine after verifying process ancestry. Text also
checks actual consumer-queue saturation, stale handles and oversized-plan
rejection. TTS's slow consumer does not prove saturation of every internal
buffer. Inspect individual outcomes: `status=completed` means the probe ran,
not that all checks passed. Any forced cleanup remains a finding.
## Analyze and qualify
For a separate TTS stage-attribution diagnostic, enable the existing
`VLLM_OMNI_STEP_STATS_DIR=/absolute/path/to/counters` hook and use
`VLLM_OMNI_STEP_STATS_SYNC=0`. Run `profile_local_tts.py` with
`--length-band medium --concurrency 1 --repeats 20 --sustained-seconds 0`
and a fresh output directory. This is not a full baseline run. The counters
include warmup, slow-consumer, abort and recovery activity, and nested timers
overlap. Preserve per-process summaries rather than pooling their percentiles.
These are host-side timers without accelerator synchronization. Periodic
flushing can omit the final counter tail after forced process termination.
Comparisons with an uninstrumented baseline must retain cache/thermal and
stochastic speech-length caveats.
Core-step counts include idle/no-work iterations. The current orchestrator
dispatch hook is only in the optional event-driven loop; the default loop
does not produce that counter. Absent counters are not zero-time measurements.
```bash
python benchmarks/edge_harness/summarize_e2e_profiles.py \
--matrix benchmarks/edge_harness/results/model_device_matrix_20260922/matrix.json \
--runs /absolute/path/to/run-root --out /absolute/path/to/summary
python benchmarks/edge_harness/analyze_profile_resources.py \
--runs /absolute/path/to/run-root --out /absolute/path/to/resource-summary.json
```
Use run directory names `spark-cpu-wsl`, `spark-cuda-wsl`,
`spark-cuda-windows`, `tts-cuda-wsl` and `tts-cuda-windows`, with `-host`,
`-trace` and `-reliability` suffixes for their corresponding records. The matrix
summarizer verifies all sixty pairings and the original evidence hashes. It
reports nearest-rank p50/p95 and sample counts, checks per-group coverage,
flags recorded output-contract violations, and retains unavailable metrics.
Batch-dependent greedy outputs are a numerical/reproducibility finding;
timings alone cannot establish whether the cause is numerical or state-related.
Delivery-spacing statistics pool adjacent intervals within each request; their
sample count is the number of intervals. Text output updates may coalesce
tokens, so this is delivery timing rather than isolated kernel inter-token
latency. Effective prefill throughput includes all work before the first output.
Parse large traces only after inference timing has finished. The resource
analyzer streams trace JSON, separates summed event duration from interval
union, and excludes telemetry gaps over five seconds from energy integration.
Actual device placement, fallback, transfer and synchronization conclusions
must be supported by the trace/runtime records, not merely the intended plan.
The TTS diagnostic starts each stage with a distinct profiler prefix because
both workers have rank 0 and the current runtime otherwise overwrites their
shared trace filename. Both stages are active during traced requests. Sequential
stop/export RPCs can extend later-stage trace windows with idle/export time;
trace-window length is not model execution time or GPU utilization.
Startup summaries retain both constructor time and inclusive host-launch to
first warmup submission/output. The latter includes artifact hashing, plan
construction and imports; constructor timing alone excludes that preparation.
Keep compile/load/run failures and their exact configurations. Before declaring
a pairing qualified, review model-specific reference quality, complete declared
modalities, state/stream correctness, memory admission, executed placement and
the performance protocol. Missing artifacts, backends, device access, sensors
or reference suites require explicit reasons and repair actions.
After every writer exits, archive evidence with reversible compression of large
uncompressed files and an original/stored byte-hash manifest:
```bash
python benchmarks/edge_harness/archive_profiles.py create /path/to/run-root /path/to/new-archive
python benchmarks/edge_harness/archive_profiles.py verify /path/to/new-archive
python benchmarks/edge_harness/archive_profiles.py restore /path/to/new-archive /path/to/new-run-root
```
Restore before using original report-relative paths for compressed artifacts.
The utility does not rewrite raw reports. Integrity verification establishes
that archived bytes match, not that a model passes its qualification gates.
@@ -0,0 +1,299 @@
# SPDX-License-Identifier: Apache-2.0
"""Summarize raw host telemetry and traces without adding overlapping timings."""
import argparse
import gzip
import json
import math
import re
from collections import defaultdict
from pathlib import Path
from summarize_e2e_profiles import read_lines, stats
def interval_union(intervals):
total = 0.0
end = None
for start, stop in sorted(intervals):
if stop <= start:
continue
total += stop - start if end is None or start >= end else max(0, stop - end)
end = stop if end is None else max(end, stop)
return total
def trace_events(path):
"""Read one event at a time, avoiding a multi-GB decoded trace document."""
opener = gzip.open if path.suffix == ".gz" else open
with opener(path, "rt", encoding="utf-8") as stream:
buffer = ""
while True:
block = stream.read(65536)
if not block:
raise ValueError("No traceEvents array")
buffer += block
match = re.search(r'"traceEvents"\s*:\s*\[', buffer)
if match:
buffer = buffer[match.end() :]
break
if len(buffer) > 8 * 1024 * 1024:
raise ValueError("Trace header exceeds 8 MiB")
decoder = json.JSONDecoder()
while True:
buffer = buffer.lstrip(" \t\r\n,")
if buffer.startswith("]"):
return
try:
event, end = decoder.raw_decode(buffer)
except json.JSONDecodeError:
block = stream.read(65536)
if not block:
raise ValueError("Truncated traceEvents array") from None
buffer += block
if len(buffer) > 16 * 1024 * 1024:
raise ValueError("One trace event exceeds 16 MiB") from None
continue
buffer = buffer[end:]
yield event
def trace_summary(path):
categories, ops = defaultdict(list), defaultdict(list)
for event in trace_events(path):
if event.get("ph") != "X" or not isinstance(event.get("dur"), (int, float)):
continue
categories[event.get("cat", "uncategorized")].append((event["ts"], event["ts"] + event["dur"]))
ops[(event.get("cat", ""), event.get("name", ""))].append(float(event["dur"]))
return {
"source": str(path),
"scope": "one process trace; event duration sums overlap and are not E2E time",
"categories": {
name: {
"events": len(group),
"duration_sum_us": sum(b - a for a, b in group),
"busy_union_us": interval_union(group),
}
for name, group in categories.items()
},
"largest_ops_by_duration_sum": sorted(
[
{"category": cat, "name": name, "duration_sum_us": sum(values), "duration_us": stats(values)}
for (cat, name), values in ops.items()
],
key=lambda r: r["duration_sum_us"],
reverse=True,
)[:40],
}
def telemetry_summary(path, start=None, stop=None):
rows = [
r for r in read_lines(path) if (start is None or r["unix"] >= start) and (stop is None or r["unix"] <= stop)
]
series = defaultdict(list)
power = []
for row in rows:
series["host_available_bytes"].append(row["host_memory"]["available"])
series["host_used_bytes"].append(row["host_memory"]["used"])
series["host_cpu_percent"].append(row.get("host_cpu_percent"))
fields = row.get("gpu_csv", "").split(",")
if len(fields) != 10:
continue
for index, name in [
(2, "gpu_memory_mib"),
(4, "gpu_temperature_c"),
(5, "gpu_power_w"),
(6, "gpu_sm_clock_mhz"),
(7, "gpu_mem_clock_mhz"),
(8, "gpu_utilization_percent"),
]:
try:
value = float(fields[index])
except ValueError:
continue
if not math.isfinite(value):
continue
series[name].append(value)
if index == 5:
power.append((row["unix"], value))
gaps = [b["unix"] - a["unix"] for a, b in zip(rows, rows[1:])]
intervals = [(a, b) for a, b in zip(power, power[1:]) if 0 < b[0] - a[0] <= 5]
energy = sum((b[0] - a[0]) * (a[1] + b[1]) / 2 for a, b in intervals)
return {
"source": str(path),
"samples": len(rows),
"span_s": rows[-1]["unix"] - rows[0]["unix"] if len(rows) >= 2 else None,
"requested_window": {"start": start, "stop": stop},
"sampling_gap_s": stats(gaps),
"gaps_over_5s": sum(g > 5 for g in gaps),
"metrics": {key: stats(values) for key, values in series.items()},
"ac_states": sorted({r["power"]["ACLineStatus"] for r in rows if "power" in r}),
"whole_gpu_energy_j_over_observed_intervals": energy if intervals else None,
"energy_observed_duration_s": sum(b[0] - a[0] for a, b in intervals),
"energy_scope": (
"Whole NVIDIA GPU incl. other processes; trapezoids skip gaps >5s; not whole-system, CPU or NPU energy."
),
}
def main():
p = argparse.ArgumentParser(description=__doc__)
p.add_argument("--runs", type=Path, required=True)
p.add_argument("--out", type=Path, required=True)
p.add_argument(
"--skip-traces", action="store_true", help="Summarize telemetry only while inference timing is still running."
)
a = p.parse_args()
result = {"telemetry": {}, "traces": [], "trace_analysis": "deferred" if a.skip_traces else "requested"}
for host in sorted(a.runs.glob("*-host")):
raw = host / "telemetry.jsonl"
if not raw.is_file():
continue
name = host.name.removesuffix("-host")
record = {"whole_run": telemetry_summary(raw)}
report_path = a.runs / name / "report.json"
if report_path.is_file():
report = json.loads(report_path.read_text(encoding="utf-8"))
host_report_path = host / "status.json"
host_report = json.loads(host_report_path.read_text(encoding="utf-8")) if host_report_path.is_file() else {}
rows = read_lines(a.runs / name / "requests.jsonl")
warmups = [r for r in rows if r.get("phase") == "warmup"]
launch, report_start = host_report.get("start_unix"), report.get("start_unix")
log_path = host / "command.log"
timing_lines = []
log_lines = []
if log_path.is_file():
log_lines = log_path.read_text(encoding="utf-8", errors="replace").splitlines()
timing_lines = [
line
for line in log_lines
if any(
marker in line
for marker in (
"Loading model weights took",
"Model loading took",
"init engine (",
"torch.compile took",
"Captured talker_mtp graphs",
"engine startup completed",
)
)
]
record["lifecycle_log_observations"] = {
"scope": "Counts are log lines, not request counts or a correctness verdict. Inspect source logs.",
"markers": {},
}
for marker in ("Dropping output for unknown req", "force killing remaining process "):
matches = [line for line in log_lines if marker in line]
record["lifecycle_log_observations"]["markers"][marker] = {
"count": len(matches),
"examples": matches[:3] + matches[-3:] if len(matches) > 6 else matches,
}
first_submit = warmups[0].get("submitted_unix") if warmups else None
first_latency = warmups[0].get("ttft_s") if warmups else None
if first_latency is None and warmups and warmups[0].get("ttfa_ms") is not None:
first_latency = warmups[0]["ttfa_ms"] / 1000
record["startup"] = {
"cache_condition": report.get("cache_condition", "See source report"),
"constructor_s": report.get("startup_s"),
"host_launch_to_benchmark_report_start_s": report_start - launch if launch and report_start else None,
"host_launch_to_first_request_s": first_submit - launch if first_submit and launch else None,
"host_launch_to_first_output_s": (
first_submit - launch + first_latency
if first_submit and launch and first_latency is not None
else None
),
"inclusive_startup_scope": (
"Host launch through first warmup submission/output includes imports, artifact hashing, "
"plan construction and engine startup; uses recorded host/engine wall timestamps. "
"Constructor timing alone excludes preparation before the constructor."
),
"pre_constructor_scope": (
"Host launch to report creation includes Python/import/preparation work; "
"not isolated OS process creation."
),
"first_warmup": {
key: warmups[0].get(key)
for key in (
"request_id",
"length_band",
"concurrency",
"wall_s",
"ttft_s",
"total_wall_s",
"ttfa_ms",
"rtf_total",
)
}
if warmups
else None,
"runtime_loading_compilation_evidence": timing_lines,
"scope": (
"Runtime-reported component lines retain original boundaries; "
"do not sum parallel-stage times into startup latency."
),
}
start, duration = report.get("sustained_start_unix"), report.get("sustained_wall_s")
if start and duration:
record["sustained"] = telemetry_summary(raw, start, start + duration)
record["sustained_first_5min"] = telemetry_summary(raw, start, start + 300)
record["sustained_last_5min"] = telemetry_summary(raw, start + duration - 300, start + duration)
record["sustained_last_60s"] = telemetry_summary(raw, start + duration - 60, start + duration)
requests = [r for r in rows if r.get("phase") == "sustained"]
record["sustained_request_summary"] = {
"n": len(requests),
"rtf_above_one_requests": sum((r.get("rtf_total") or 0) > 1 for r in requests),
"simulated_playback_deficit_requests": sum((r.get("stall_at_ttfa_ms") or 0) > 0 for r in requests),
"rtf_total": stats([r.get("rtf_total") for r in requests]),
"scope": "All sustained requests; timing/real-time gates are separate from successful completion.",
}
record["sustained_request_trends"] = {}
for label, begin, end in [
("first_5min", start, start + 300),
("last_5min", start + duration - 300, start + duration),
("last_60s", start + duration - 60, start + duration),
]:
window = [r for r in requests if begin <= r.get("submitted_unix", -1) < end]
record["sustained_request_trends"][label] = {
"n": len(window),
"window_basis": "request submission time",
"metrics": {
metric: stats([r.get(metric) for r in window])
for metric in (
"wall_s",
"ttft_s",
"decode_tok_per_s",
"total_wall_s",
"ttfa_ms",
"rtf_total",
"stall_at_ttfa_ms",
)
},
}
result["telemetry"][name] = record
for path in [] if a.skip_traces else sorted(a.runs.glob("*trace*/traces/**/*")):
if path.is_file() and (path.name.endswith(".json") or path.name.endswith(".json.gz")):
report_path = a.runs / path.relative_to(a.runs).parts[0] / "report.json"
if (
not report_path.is_file()
or json.loads(report_path.read_text(encoding="utf-8")).get("status") != "completed"
):
result["traces"].append(
{
"source": str(path),
"status": "not_analyzed",
"reason": "Diagnostic has no completed report; trace may be incomplete.",
}
)
continue
try:
result["traces"].append(trace_summary(path))
except Exception as error:
result["traces"].append({"source": str(path), "error": repr(error)})
a.out.write_text(json.dumps(result, indent=2) + "\n", encoding="utf-8")
print(f"Summarized {len(result['telemetry'])} telemetry runs and {len(result['traces'])} traces")
if __name__ == "__main__":
main()
+124
View File
@@ -0,0 +1,124 @@
# SPDX-License-Identifier: Apache-2.0
"""Archive profiling evidence with byte hashes and reversible large-file compression.
Run only after all writers exit. No benchmark result is changed by this utility.
"""
import argparse
import gzip
import hashlib
import json
import shutil
from pathlib import Path
def digest(path, compressed=False):
hasher = hashlib.sha256()
size = 0
opener = gzip.open if compressed else open
with opener(path, "rb") as stream:
for chunk in iter(lambda: stream.read(1024 * 1024), b""):
hasher.update(chunk)
size += len(chunk)
return hasher.hexdigest(), size
def verify(root):
manifest = json.loads((root / "manifest.json").read_text(encoding="utf-8"))
for record in manifest["files"]:
path = root / record["stored_path"]
assert path.resolve().is_relative_to(root.resolve()), "Archive path escapes root"
assert digest(path) == (record["stored_sha256"], record["stored_bytes"]), path
assert digest(path, record["encoding"] == "gzip") == (record["sha256"], record["bytes"]), path
return len(manifest["files"])
def archive(source, destination):
assert source.resolve() != destination.resolve()
assert not destination.resolve().is_relative_to(source.resolve())
destination.mkdir(parents=True, exist_ok=False)
records = []
for path in sorted(source.rglob("*")):
relative = path.relative_to(source)
if not path.is_file() or "__pycache__" in relative.parts or path.suffix in (".pyc", ".tmp"):
continue
assert not path.is_symlink(), f"Unexpected evidence symlink: {relative}"
original_hash, original_size = digest(path)
compress = original_size > 50 * 1024 * 1024 and path.suffix != ".gz"
stored = Path("evidence") / relative
if compress:
stored = stored.with_name(stored.name + ".archive.gz")
target = destination / stored
target.parent.mkdir(parents=True, exist_ok=True)
if compress:
with path.open("rb") as reader, target.open("wb") as writer:
with gzip.GzipFile(filename="", mode="wb", fileobj=writer, mtime=0) as packed:
shutil.copyfileobj(reader, packed, length=1024 * 1024)
else:
shutil.copyfile(path, target)
stored_hash, stored_size = digest(target)
assert digest(path) == (original_hash, original_size), f"Source changed during archive: {relative}"
records.append(
{
"source_path": relative.as_posix(),
"stored_path": stored.as_posix(),
"sha256": original_hash,
"bytes": original_size,
"stored_sha256": stored_hash,
"stored_bytes": stored_size,
"encoding": "gzip" if compress else "identity",
}
)
(destination / "manifest.json").write_text(
json.dumps(
{
"schema": 1,
"scope": "Raw evidence bytes; hashes establish integrity, not model correctness or qualification.",
"files": records,
},
indent=2,
)
+ "\n",
encoding="utf-8",
)
(destination / ".gitattributes").write_text("evidence/** -text -whitespace\n", encoding="utf-8")
return verify(destination)
def restore(root, destination):
verify(root)
destination.mkdir(parents=True, exist_ok=False)
manifest = json.loads((root / "manifest.json").read_text(encoding="utf-8"))
for record in manifest["files"]:
target = destination / record["source_path"]
assert target.resolve().is_relative_to(destination.resolve()), "Restore path escapes root"
target.parent.mkdir(parents=True, exist_ok=True)
opener = gzip.open if record["encoding"] == "gzip" else open
with opener(root / record["stored_path"], "rb") as reader, target.open("wb") as writer:
shutil.copyfileobj(reader, writer, length=1024 * 1024)
assert digest(target) == (record["sha256"], record["bytes"])
def main():
parser = argparse.ArgumentParser(description=__doc__)
sub = parser.add_subparsers(dest="operation", required=True)
create = sub.add_parser("create")
create.add_argument("source", type=Path)
create.add_argument("destination", type=Path)
check = sub.add_parser("verify")
check.add_argument("archive", type=Path)
unpack = sub.add_parser("restore")
unpack.add_argument("archive", type=Path)
unpack.add_argument("destination", type=Path)
args = parser.parse_args()
if args.operation == "create":
print(f"Archived and verified {archive(args.source, args.destination)} files")
elif args.operation == "verify":
print(f"Verified {verify(args.archive)} files")
else:
restore(args.archive, args.destination)
print(f"Restored evidence to {args.destination}")
if __name__ == "__main__":
main()
@@ -0,0 +1,175 @@
# SPDX-License-Identifier: Apache-2.0
"""Isolated real-model stream saturation, cancellation and owned-worker failure checks."""
import argparse
import asyncio
import copy
import os
import sys
import time
import traceback
from pathlib import Path
from profile_local_text import save
async def run(args):
import psutil
from vllm_omni.edge.local.engine import LocalTextEngine
from vllm_omni.edge.local.plan import plan_text_session
args.out.mkdir(parents=True, exist_ok=False)
report = {
"status": "running",
"start_unix": time.time(),
"argv": sys.argv,
"scope": (
"LocalTextEngine consumer queue and actual owned engine-process failure; "
"not proof of every internal queue being bounded"
),
}
engine = None
owned = []
save(args.out / "report.json", report)
try:
plan = plan_text_session(
args.model, max_model_len=4096, max_num_seqs=4, max_num_batched_tokens=512, enforce_eager=True
)
report["plan"] = plan.to_dict()
if not plan.admitted:
report["status"] = "rejected"
return
oversized = plan_text_session(
args.model, max_model_len=4096, max_num_seqs=100000, max_num_batched_tokens=512, enforce_eager=True
)
report["oversized_plan"] = oversized.to_dict()
report["oversized_plan_refused"] = not oversized.admitted
engine = LocalTextEngine(plan)
await engine.start()
prompt = "Describe a quiet garden with trees, flowers and a pond."
async def request(saturate=False):
session = engine.open_session()
rid, stream = await engine.submit(
session, prompt, max_tokens=128, temperature=0, ignore_eos=True, max_chunks=4
)
if saturate:
# Wait for actual capacity, rather than guessing a delay from device speed.
deadline = time.monotonic() + 30
while stream.stats()["high_water_chunks"] < 4 and time.monotonic() < deadline:
await asyncio.sleep(0.05)
report["saturated_queue_before_drain"] = stream.stats()
events = [e.to_dict() async for e in stream]
record = engine.records[rid].to_dict()
record["stream"] = stream.stats()
record["events"] = events
engine.close_session(session.session_id)
assert record["finished"] and not record["error"] and record["output_tokens"] == 128
return record
report["baseline"] = await request()
report["saturated"] = await request(saturate=True)
report["saturation_reached"] = report["saturated_queue_before_drain"]["high_water_chunks"] == 4
report["same_tokens_after_saturation"] = (
report["baseline"]["output_token_ids"] == report["saturated"]["output_token_ids"]
)
session = engine.open_session()
stale = copy.deepcopy(session)
rid, stream = await engine.submit(session, prompt, max_tokens=512, ignore_eos=True, max_chunks=4)
deadline = time.monotonic() + 30
while stream.stats()["high_water_chunks"] < 4 and time.monotonic() < deadline:
await asyncio.sleep(0.05)
report["cancel_queue_before"] = stream.stats()
report["cancel"] = await engine.cancel(rid)
report["cancel"]["late_events"] = [e.to_dict() async for e in stream]
try:
await engine.submit(stale, prompt, max_tokens=1)
except RuntimeError as error:
report["stale_handle_rejected"] = str(error)
else:
report["stale_handle_rejected"] = False
engine.close_session(session.session_id)
report["after_cancel"] = await request()
save(args.out / "report.json", report)
# Process handles come from this engine's actual manager, then must also
# belong to this probe's process tree. Never select arbitrary system PIDs.
client = engine._omni.engine.stage_clients[0]
manager = client.resources.engine_manager
processes = [p for p in manager.processes if p.is_alive()]
descendants = {p.pid: p for p in psutil.Process().children(recursive=True)}
assert processes and all(p.pid in descendants for p in processes)
manager_tree = {}
for handle in processes:
core = descendants[handle.pid]
manager_tree[core.pid] = core
manager_tree.update({child.pid: child for child in core.children(recursive=True)})
owned = [(p.pid, p.create_time()) for p in manager_tree.values()]
target = processes[0]
session = engine.open_session()
rid, stream = await engine.submit(session, prompt, max_tokens=512, ignore_eos=True)
first = await asyncio.wait_for(stream.get(), 30)
assert first is not None and first.kind == "token", "No token before worker-failure injection"
report["crash_first"] = first.to_dict()
report["crash_injection"] = {
"pid": target.pid,
"name": target.name,
"created": descendants[target.pid].create_time(),
"ownership": "engine manager handle and current process descendant",
}
start = time.perf_counter()
target.terminate()
async def drain():
return [e.to_dict() async for e in stream]
try:
events = await asyncio.wait_for(drain(), 30)
report["crash_injection"].update(
events=events,
observed_within_30s=True,
explicit_error_reported=bool(engine.records[rid].error) or any(e["kind"] == "error" for e in events),
request_record=engine.records[rid].to_dict(),
)
except asyncio.TimeoutError:
report["crash_injection"].update(observed_within_30s=False, error="No terminal stream event within 30s")
report["crash_injection"]["observation_s"] = time.perf_counter() - start
report["status"] = "completed"
except Exception as error:
report.update(status="failed", error=repr(error), traceback=traceback.format_exc())
traceback.print_exc()
finally:
if engine is not None:
try:
await engine.close()
except (Exception, asyncio.CancelledError) as error:
report.update(status="failed", cleanup_error=repr(error))
report.setdefault("error", f"Engine shutdown failed after probe: {error!r}")
await asyncio.sleep(2)
leftovers = []
for pid, created in owned:
try:
p = psutil.Process(pid)
if p.create_time() == created and p.is_running():
leftovers.append({"pid": pid, "created": created, "status": p.status()})
# Contain an isolated diagnostic's leak; report it, do not call cleanup a pass.
p.kill()
except psutil.NoSuchProcess:
pass
report["owned_processes_requiring_harness_cleanup"] = leftovers
report["end_unix"] = time.time()
save(args.out / "report.json", report)
return report["status"] == "completed"
if __name__ == "__main__":
p = argparse.ArgumentParser(description=__doc__)
p.add_argument("--model", required=True)
p.add_argument("--out", type=Path, required=True)
args = p.parse_args()
os.environ.setdefault("VLLM_WORKER_MULTIPROC_METHOD", "spawn")
from vllm_omni.windows.aio import install_selector_policy
install_selector_policy()
raise SystemExit(0 if asyncio.run(run(args)) else 1)
@@ -0,0 +1,172 @@
# SPDX-License-Identifier: Apache-2.0
"""Real-weight TTS slow consumer, abort/recovery and owned vocoder-process failure."""
import argparse
import asyncio
import os
import sys
import time
import traceback
from pathlib import Path
from profile_local_text import save
async def run(args):
import psutil
import torch
from transformers import AutoTokenizer
from vllm_omni import AsyncOmni
from vllm_omni.model_executor.models.qwen3_tts.configuration_qwen3_tts import Qwen3TTSConfig
from vllm_omni.model_executor.models.qwen3_tts.prompt_embeds_builder import Qwen3TTSPromptEmbedsBuilder
sys.path.insert(0, str(Path(__file__).resolve().parents[1] / "tts"))
from stream_latency_bench import _cat_audio
args.out.mkdir(parents=True, exist_ok=False)
report = {
"status": "running",
"argv": sys.argv,
"start_unix": time.time(),
"scope": (
"Short real audio delivery, slow consumer, abort fence/recovery, owned vocoder termination. "
"Not audio quality or 64 MiB buffer saturation."
),
}
omni, owned = None, []
save(args.out / "report.json", report)
try:
cfg = Qwen3TTSConfig.from_pretrained(args.model)
tok = AutoTokenizer.from_pretrained(args.model)
def prompt(text):
info = {"task_type": ["CustomVoice"], "text": [text], "language": ["English"], "speaker": ["Vivian"]}
length = Qwen3TTSPromptEmbedsBuilder.estimate_prompt_len_from_additional_information(
additional_information=info,
task_type="CustomVoice",
tokenize_prompt=lambda x: tok(x, padding=False)["input_ids"],
codec_language_id=cfg.talker_config.codec_language_id,
spk_is_dialect=cfg.talker_config.spk_is_dialect,
)
return {"prompt_token_ids": [0] * length, "additional_information": info}
short = prompt("The garden is quiet. We can hear the birds singing.")
long = prompt("This longer sentence keeps the speech model generating while we test interruption. " * 12)
omni = AsyncOmni(model=args.model, deploy_profile="edge", stage_init_timeout=180)
params = omni.resolve_sampling_params_list(None, allow_delta_coercion=True)
def event(output, rid):
assert output.request_id == rid, "Unexpected request ID in audio stream"
mm = output.outputs[0].multimodal_output if output.outputs else None
audio = _cat_audio(mm.get("audio") if mm else None)
return {
"request_id": output.request_id,
"finished": output.finished,
"samples": int(audio.numel()) if audio is not None else 0,
"finite": bool(torch.isfinite(audio).all()) if audio is not None else True,
}
async def first_audio(stream, rid):
async for output in stream:
row = event(output, rid)
if row["samples"]:
assert row["finite"], "Nonfinite audio before fault probe"
return row
raise RuntimeError("No audio before fault probe")
async def collect(stream, rid, pause=False):
rows = []
async for output in stream:
rows.append(event(output, rid))
if pause and len(rows) == 1:
await asyncio.sleep(3)
return rows
for rid, slow in [("baseline", False), ("slow-consumer", True)]:
rows = await collect(omni.generate(short, request_id=rid, sampling_params_list=params), rid, slow)
report[rid] = rows
assert any(r["finished"] for r in rows) and any(r["samples"] for r in rows)
assert all(r["finite"] for r in rows)
rid = "abort-probe"
stream = omni.generate(long, request_id=rid, sampling_params_list=params)
first = await asyncio.wait_for(first_audio(stream, rid), 60)
start = time.perf_counter()
await omni.abort(rid)
report["abort"] = {"first": first, "ack_s": time.perf_counter() - start}
try:
late = await asyncio.wait_for(collect(stream, rid), 10)
report["abort"]["late_events"] = late
report["abort"]["late_audio_samples"] = sum(r["samples"] for r in late)
except asyncio.CancelledError:
report["abort"]["terminal"] = "CancelledError"
except Exception as error:
report["abort"]["terminal_error"] = repr(error)
rid = "after-abort"
rows = await collect(omni.generate(short, request_id=rid, sampling_params_list=params), rid)
report[rid] = rows
assert any(r["finished"] for r in rows) and any(r["samples"] for r in rows)
save(args.out / "report.json", report)
descendants = {p.pid: p for p in psutil.Process().children(recursive=True)}
core_handles = [
p for client in omni.engine.stage_clients for p in client.resources.engine_manager.processes if p.is_alive()
]
assert core_handles and all(p.pid in descendants for p in core_handles)
manager_tree = {}
for handle in core_handles:
core = descendants[handle.pid]
manager_tree[core.pid] = core
manager_tree.update({p.pid: p for p in core.children(recursive=True)})
owned = [(p.pid, p.create_time()) for p in manager_tree.values()]
target = omni.engine.stage_clients[-1].resources.engine_manager.processes[0]
rid = "vocoder-crash"
stream = omni.generate(long, request_id=rid, sampling_params_list=params)
report["crash_first"] = await asyncio.wait_for(first_audio(stream, rid), 60)
report["crash"] = {"pid": target.pid, "name": target.name, "created": descendants[target.pid].create_time()}
start = time.perf_counter()
target.terminate()
try:
report["crash"]["events"] = await asyncio.wait_for(collect(stream, rid), 30)
report["crash"]["explicit_error_reported"] = False
except asyncio.TimeoutError:
report["crash"]["timeout"] = True
except (Exception, asyncio.CancelledError) as error:
report["crash"].update(explicit_error_reported=True, error=repr(error))
report["crash"]["observation_s"] = time.perf_counter() - start
report["status"] = "completed"
except Exception as error:
report.update(status="failed", error=repr(error), traceback=traceback.format_exc())
traceback.print_exc()
finally:
if omni is not None:
try:
omni.shutdown()
except (Exception, asyncio.CancelledError) as error:
report.update(status="failed", cleanup_error=repr(error))
report.setdefault("error", f"Engine shutdown failed after probe: {error!r}")
await asyncio.sleep(2)
leftovers = []
for pid, created in owned:
try:
p = psutil.Process(pid)
if p.create_time() == created and p.is_running():
leftovers.append({"pid": pid, "created": created, "status": p.status()})
p.kill()
except psutil.NoSuchProcess:
pass
report["owned_processes_requiring_harness_cleanup"] = leftovers
report["end_unix"] = time.time()
save(args.out / "report.json", report)
return report["status"] == "completed"
if __name__ == "__main__":
p = argparse.ArgumentParser(description=__doc__)
p.add_argument("--model", required=True)
p.add_argument("--out", type=Path, required=True)
args = p.parse_args()
os.environ.setdefault("VLLM_WORKER_MULTIPROC_METHOD", "spawn")
from vllm_omni.windows.aio import install_selector_policy
install_selector_policy()
raise SystemExit(0 if asyncio.run(run(args)) else 1)
@@ -0,0 +1,91 @@
# SPDX-License-Identifier: Apache-2.0
"""Run one explicit benchmark command with Windows host and whole-GPU telemetry."""
import argparse
import ctypes
import json
import os
import platform
import subprocess
import sys
import time
from pathlib import Path
import psutil
class PowerStatus(ctypes.Structure):
_fields_ = [
("ACLineStatus", ctypes.c_byte),
("BatteryFlag", ctypes.c_byte),
("BatteryLifePercent", ctypes.c_byte),
("SystemStatusFlag", ctypes.c_byte),
("BatteryLifeTime", ctypes.c_ulong),
("BatteryFullLifeTime", ctypes.c_ulong),
]
def main():
p = argparse.ArgumentParser(description=__doc__)
p.add_argument("--out", type=Path, required=True)
p.add_argument("--cwd", type=Path, required=True)
p.add_argument("command", nargs=argparse.REMAINDER)
a = p.parse_args()
command = a.command[1:] if a.command[:1] == ["--"] else a.command
a.out.mkdir(parents=True, exist_ok=False)
status = {
"command": command,
"cwd": str(a.cwd),
"host": platform.platform(),
"scope": "Windows RAM includes WSL; GPU counters are whole-device, not model-exclusive",
"sample_interval_s": 1,
"start_unix": time.time(),
"status": "running",
}
if os.name == "nt":
status["power_scheme"] = subprocess.run(
["powercfg", "/getactivescheme"], capture_output=True, text=True, errors="replace"
).stdout
log = (a.out / "command.log").open("w", encoding="utf-8")
child = subprocess.Popen(command, cwd=a.cwd, stdout=log, stderr=subprocess.STDOUT)
status["pid"] = child.pid
(a.out / "status.json").write_text(json.dumps(status, indent=2), encoding="utf-8")
with (a.out / "telemetry.jsonl").open("w", encoding="utf-8") as f:
while child.poll() is None:
sample = {
"unix": time.time(),
"monotonic": time.monotonic(),
"host_memory": psutil.virtual_memory()._asdict(),
"host_cpu_percent": psutil.cpu_percent(),
}
if os.name == "nt":
power = PowerStatus()
if ctypes.windll.kernel32.GetSystemPowerStatus(ctypes.byref(power)):
sample["power"] = {name: getattr(power, name) for name, _ in power._fields_}
try:
gpu = subprocess.run(
[
"nvidia-smi",
"--query-gpu=uuid,name,memory.used,memory.total,temperature.gpu,power.draw,clocks.sm,clocks.mem,utilization.gpu,pstate",
"--format=csv,noheader,nounits",
],
capture_output=True,
text=True,
timeout=5,
)
sample["gpu_csv"] = gpu.stdout.strip()
sample["gpu_returncode"] = gpu.returncode
except Exception as error:
sample["gpu_error"] = repr(error)
f.write(json.dumps(sample) + "\n")
f.flush()
time.sleep(1)
log.close()
status.update(status="exited", returncode=child.returncode, end_unix=time.time())
(a.out / "status.json").write_text(json.dumps(status, indent=2), encoding="utf-8")
print(json.dumps(status), flush=True)
return child.returncode
if __name__ == "__main__":
sys.exit(main())
@@ -0,0 +1,200 @@
# SPDX-License-Identifier: Apache-2.0
"""Measure the existing Omni local text path; do not infer model quality from speed."""
import argparse
import asyncio
import json
import os
import platform
import sys
import time
import traceback
from pathlib import Path
def configure_host_environment():
"""Reuse the native Windows settings established by the acceptance runs."""
if os.name == "nt":
cudart = Path(sys.prefix) / "Lib/site-packages/torch/lib/cudart64_13.dll"
if cudart.is_file():
os.environ.setdefault("VLLM_CUDART_SO_PATH", str(cudart))
os.environ.setdefault("VLLM_CACHE_ROOT", str(Path.home() / "c29"))
return {
key: os.environ[key]
for key in ("VLLM_CUDART_SO_PATH", "VLLM_CACHE_ROOT", "CUDA_HOME", "PYTHONUTF8", "PYTHONIOENCODING")
if key in os.environ
}
HOST_ENVIRONMENT = configure_host_environment()
def save(path, value):
temp = path.with_suffix(".tmp")
temp.write_text(json.dumps(value, indent=2, default=str) + "\n", encoding="utf-8")
try:
temp.replace(path)
except PermissionError as error:
# Windows readers may deny replacement while holding the previous
# snapshot open. Keep request JSONL authoritative and defer a running
# snapshot rather than blocking concurrent inference on file I/O.
if value.get("status") == "running" and path.is_file():
value["report_write_permission_errors"] = value.get("report_write_permission_errors", 0) + 1
value["last_report_write_error"] = repr(error)
print(f"Deferred report snapshot after PermissionError: {path}", file=sys.stderr, flush=True)
return
# Initial/final snapshots must persist. This wait is outside measured
# request execution; a persistent permission failure remains an error.
for _ in range(20):
time.sleep(0.05)
try:
temp.replace(path)
return
except PermissionError:
pass
raise
async def run(args):
from vllm_omni.edge.local.engine import LocalTextEngine, apply_runtime_env
from vllm_omni.edge.local.plan import plan_text_session
args.out.mkdir(parents=True, exist_ok=False)
report = {
"status": "running",
"scope": "complete local text generation; quality gate separate",
"argv": sys.argv,
"platform": platform.platform(),
"python": sys.executable,
"start_unix": time.time(),
"runtime_env": apply_runtime_env(),
"host_environment": HOST_ENVIRONMENT,
"settings": vars(args),
"cache_condition": "existing disk/JIT cache; not cold disk",
"trace": "untraced; API event timings",
"requests": 0,
}
save(args.out / "report.json", report)
engine = None
try:
plan = plan_text_session(
args.model,
max_model_len=4096,
max_num_seqs=4,
max_num_batched_tokens=512,
enforce_eager=True,
digest_weights=True,
)
report["plan"] = plan.to_dict()
if not plan.admitted:
report["status"] = "rejected"
return
engine = LocalTextEngine(plan)
start = time.perf_counter()
await engine.start()
report["startup_s"] = time.perf_counter() - start
report["placement"] = engine.report_placement()
save(args.out / "report.json", report)
# Repeated natural text gives reproducible length bands; record actual token counts.
prompts = {
name: ("The garden has trees, flowers, and a small pond. " * n) + "\nDescribe the garden in detail."
for name, n in [("short", 4), ("medium", 40), ("long", 160)]
}
samples = (args.out / "requests.jsonl").open("a", encoding="utf-8")
counter = 0
async def request(name, concurrency, phase, slow=False):
nonlocal counter
counter += 1
session = engine.open_session()
start = time.perf_counter()
rid, stream = await engine.submit(
session, prompts[name], max_tokens=128, temperature=0.0, ignore_eos=True, max_chunks=4 if slow else 64
)
arrivals = []
try:
async for event in stream:
arrivals.append(
{
"elapsed_s": time.perf_counter() - start,
"kind": event.kind,
"sequence": event.seq,
"epoch": event.epoch,
}
)
if slow:
await asyncio.sleep(0.03)
rec = engine.records[rid].to_dict()
rec.update(
phase=phase,
length_band=name,
concurrency=concurrency,
wall_s=time.perf_counter() - start,
arrivals=arrivals,
stream=stream.stats(),
)
samples.write(json.dumps(rec) + "\n")
samples.flush()
if rec["error"] or rec["output_tokens"] != 128 or not rec["finished"]:
raise RuntimeError(f"Incomplete request: {rid}: {rec['error']}")
report["requests"] = counter
save(args.out / "report.json", report)
finally:
engine.close_session(session.session_id)
for concurrency in (1, 2, 4):
for name in prompts:
await asyncio.gather(*(request(name, concurrency, "warmup") for _ in range(concurrency)))
for i in range(0, args.repeats, concurrency):
await asyncio.gather(
*(request(name, concurrency, "measured") for _ in range(min(concurrency, args.repeats - i)))
)
print(f"profiled {name} concurrency={concurrency}", flush=True)
thermal_start = time.perf_counter()
report["sustained_start_unix"] = time.time()
while time.perf_counter() - thermal_start < args.sustained_seconds:
await request("medium", 1, "sustained")
report["sustained_wall_s"] = time.perf_counter() - thermal_start
await request("short", 1, "slow_consumer", slow=True)
session = engine.open_session()
rid, stream = await engine.submit(session, prompts["short"], max_tokens=512, ignore_eos=True)
seen = 0
async for event in stream:
if event.kind == "token":
seen += 1
if seen >= 8:
break
start = time.perf_counter()
report["cancel"] = await engine.cancel(rid)
report["cancel"]["latency_s"] = time.perf_counter() - start
report["cancel"]["remaining_events"] = [e.to_dict() async for e in stream]
engine.close_session(session.session_id)
await request("short", 1, "after_cancel")
samples.close()
report["usage"] = engine.report_usage()
report["status"] = "completed"
report["quality_gate"] = "not rerun against high precision reference; see separate acceptance evidence"
except Exception as error:
report.update(status="failed", error=repr(error), traceback=traceback.format_exc())
traceback.print_exc()
finally:
if engine is not None:
await engine.close()
report["usage_after_close"] = engine.report_usage()
report["end_unix"] = time.time()
save(args.out / "report.json", report)
return report["status"] == "completed"
if __name__ == "__main__":
p = argparse.ArgumentParser(description=__doc__)
p.add_argument("--model", required=True)
p.add_argument("--out", type=Path, required=True)
p.add_argument("--repeats", type=int, default=20)
p.add_argument("--sustained-seconds", type=float, default=1800)
args = p.parse_args()
os.environ.setdefault("VLLM_WORKER_MULTIPROC_METHOD", "spawn")
from vllm_omni.windows.aio import install_selector_policy
install_selector_policy()
raise SystemExit(0 if asyncio.run(run(args)) else 1)
@@ -0,0 +1,227 @@
# SPDX-License-Identifier: Apache-2.0
"""Profile real Qwen3-TTS streams through AsyncOmni, retaining terminal audio separately."""
import argparse
import asyncio
import hashlib
import json
import os
import platform
import sys
import time
import traceback
from pathlib import Path
from profile_local_text import HOST_ENVIRONMENT, save
async def run(args):
import torch
from transformers import AutoTokenizer
from vllm_omni import AsyncOmni
from vllm_omni.edge.local.engine import MemorySampler
from vllm_omni.edge.local.manifest import runtime_versions
from vllm_omni.model_executor.models.qwen3_tts.configuration_qwen3_tts import Qwen3TTSConfig
from vllm_omni.model_executor.models.qwen3_tts.prompt_embeds_builder import Qwen3TTSPromptEmbedsBuilder
sys.path.insert(0, str(Path(__file__).resolve().parents[1] / "tts"))
from stream_latency_bench import _cat_audio, _sample_rate
from stream_latency_metrics import request_metrics, underruns_if_start_at
args.out.mkdir(parents=True, exist_ok=False)
report = {
"status": "running",
"argv": sys.argv,
"python": sys.executable,
"host_environment": HOST_ENVIRONMENT,
"platform": platform.platform(),
"runtime": runtime_versions().to_dict(),
"settings": vars(args),
"start_unix": time.time(),
"requests": 0,
"cache_condition": "existing disk/JIT caches; not cold disk",
"quality_gate": "finite PCM checks only; ASR/speaker/listening reference gates pending",
"playback_scope": "arrival-based simulated playback; no sound-device measurement",
"terminal_audio": (
"DELTA output required; terminal audio is included once in complete playback metrics "
"and archived separately"
),
}
save(args.out / "report.json", report)
sampler = MemorySampler()
sampler.start()
omni = None
try:
cfg = Qwen3TTSConfig.from_pretrained(args.model)
tokenizer = AutoTokenizer.from_pretrained(args.model)
texts = {
"short": "Hello, this is a speech test.",
"medium": (
"The garden has trees, flowers, and a small pond. We walk along the path and listen to the birds."
),
"long": (
"Today we are testing a local speech system. "
"It should speak clearly and keep the audio flowing smoothly. " * 4
),
}
prompts = {}
for name, text in texts.items():
info = {"task_type": ["CustomVoice"], "text": [text], "language": ["English"], "speaker": ["Vivian"]}
length = Qwen3TTSPromptEmbedsBuilder.estimate_prompt_len_from_additional_information(
additional_information=info,
task_type="CustomVoice",
tokenize_prompt=lambda x: tokenizer(x, padding=False)["input_ids"],
codec_language_id=cfg.talker_config.codec_language_id,
spk_is_dialect=cfg.talker_config.spk_is_dialect,
)
prompts[name] = {"prompt_token_ids": [0] * length, "additional_information": info}
report["prompts"] = prompts
start = time.perf_counter()
omni = AsyncOmni(model=args.model, deploy_profile="edge", stage_init_timeout=180)
report["startup_s"] = time.perf_counter() - start
from vllm.sampling_params import RequestOutputKind
sampling_params = omni.resolve_sampling_params_list(None, allow_delta_coercion=True)
report["sampling_params"] = [repr(p) for p in sampling_params]
if sampling_params[-1].output_kind != RequestOutputKind.DELTA:
raise RuntimeError("Final TTS stage must emit DELTA audio for this playback benchmark")
report["memory_after_load"] = sampler.peaks()
save(args.out / "report.json", report)
counter = 0
samples = (args.out / "requests.jsonl").open("a", encoding="utf-8")
async def request(name, concurrency, phase, slow=False):
nonlocal counter
counter += 1
rid = f"{phase}-{name}-{concurrency}-{counter}"
chunks, buffers = [], []
submitted_unix = time.time()
start = time.perf_counter()
finished, sr = False, 24000
async for output in omni.generate(prompts[name], request_id=rid, sampling_params_list=sampling_params):
if output.request_id != rid:
raise RuntimeError(f"Unexpected output request ID: {output.request_id}; expected {rid}")
elapsed = (time.perf_counter() - start) * 1000
mm = output.outputs[0].multimodal_output if output.outputs else None
sr = _sample_rate(mm, sr)
audio = _cat_audio(mm.get("audio") if mm else None)
raw = audio.numpy().tobytes() if audio is not None else b""
finite = bool(torch.isfinite(audio).all()) if audio is not None else True
chunks.append(
{
"idx": len(chunks),
"t_ms": elapsed,
"samples": len(raw) // 4,
"sr": sr,
"request_id": output.request_id,
"terminal": output.finished,
"sha256": hashlib.sha256(raw).hexdigest(),
"finite": finite,
}
)
if phase == "warmup":
buffers.append(raw)
finished = finished or output.finished
if not finite:
raise RuntimeError(f"Nonfinite audio: {rid}")
if slow:
await asyncio.sleep(0.2)
wall = time.perf_counter() - start
streamed = [c for c in chunks if not c["terminal"]]
terminal = [c for c in chunks if c["terminal"]]
rec = {
"request_id": rid,
"phase": phase,
"length_band": name,
"submitted_unix": submitted_unix,
"finished_unix": time.time(),
"concurrency": concurrency,
"sr": sr,
"chunks_all": chunks,
"finished": finished,
"terminal_audio_s": sum(c["samples"] for c in terminal) / sr,
"prefix_metrics": request_metrics(streamed, sr, wall),
**request_metrics(chunks, sr, wall),
}
rec["underruns"] = underruns_if_start_at(chunks, sr, rec["ttfa_ms"]) if rec["ttfa_ms"] is not None else []
# Preserve each raw warmup chunk, including the terminal event, without guessing concatenation semantics.
if buffers:
audio_dir = args.out / "audio_chunks"
audio_dir.mkdir(exist_ok=True)
for i, raw in enumerate(buffers):
(audio_dir / f"{rid}-{i}.f32").write_bytes(raw)
samples.write(json.dumps(rec) + "\n")
samples.flush()
if not finished or not any(c["samples"] for c in chunks):
raise RuntimeError(f"Missing completion/audio: {rid}")
report["requests"] = counter
save(args.out / "report.json", report)
for concurrency in (args.concurrency,) if args.concurrency is not None else (1, 2, 4):
for name in (args.length_band,) if args.length_band else prompts:
await asyncio.gather(*(request(name, concurrency, "warmup") for _ in range(concurrency)))
for i in range(0, args.repeats, concurrency):
await asyncio.gather(
*(request(name, concurrency, "measured") for _ in range(min(concurrency, args.repeats - i)))
)
print(f"profiled {name} concurrency={concurrency}", flush=True)
report["sustained_wall_s"] = 0.0
if args.sustained_seconds > 0:
start = time.perf_counter()
report["sustained_start_unix"] = time.time()
while time.perf_counter() - start < args.sustained_seconds:
await request("medium", 1, "sustained")
report["sustained_wall_s"] = time.perf_counter() - start
await request("medium", 1, "slow_consumer", slow=True)
stream = omni.generate(prompts["long"], request_id="cancel-probe", sampling_params_list=sampling_params)
async for output in stream:
if output.outputs:
break
start = time.perf_counter()
await omni.abort("cancel-probe")
await stream.aclose()
report["cancel"] = {
"abort_ack_s": time.perf_counter() - start,
"scope": "abort acknowledgement and subsequent request; late-event gate not verified",
}
await request("short", 1, "after_cancel")
samples.close()
report["status"] = "completed"
except Exception as error:
report.update(status="failed", error=repr(error), traceback=traceback.format_exc())
traceback.print_exc()
finally:
if omni is not None:
omni.shutdown()
sampler.stop()
report["memory"] = sampler.peaks()
report["end_unix"] = time.time()
save(args.out / "report.json", report)
return report["status"] == "completed"
if __name__ == "__main__":
p = argparse.ArgumentParser(description=__doc__)
p.add_argument("--model", required=True)
p.add_argument("--out", required=True, type=Path)
p.add_argument("--repeats", default=20, type=int)
p.add_argument("--sustained-seconds", default=1800, type=float)
p.add_argument(
"--length-band",
choices=("short", "medium", "long"),
help="Select one band for a separate instrumentation diagnostic.",
)
p.add_argument(
"--concurrency",
type=int,
choices=(1, 2, 4),
help="Select one concurrency for a separate instrumentation diagnostic.",
)
args = p.parse_args()
os.environ.setdefault("VLLM_WORKER_MULTIPROC_METHOD", "spawn")
os.environ.setdefault("VLLM_USE_FLASHINFER_SAMPLER", "0")
from vllm_omni.windows.aio import install_selector_policy
install_selector_policy()
raise SystemExit(0 if asyncio.run(run(args)) else 1)
@@ -0,0 +1,198 @@
# SPDX-License-Identifier: Apache-2.0
"""Separate paired untraced/traced requests through Omni's existing profiler RPC."""
import argparse
import asyncio
import hashlib
import os
import platform
import statistics
import sys
import time
import traceback
from pathlib import Path
from profile_local_text import save
async def run(args):
from vllm_omni import AsyncOmni
from vllm_omni.edge.local.engine import apply_runtime_env
from vllm_omni.edge.local.manifest import runtime_versions
args.out = args.out.resolve()
args.out.mkdir(parents=True, exist_ok=False)
trace_dir = (args.out / "traces").resolve()
report = {
"status": "running",
"start_unix": time.time(),
"argv": sys.argv,
"python": sys.executable,
"platform": platform.platform(),
"runtime": runtime_versions().to_dict(),
"environment": apply_runtime_env(),
"scope": "diagnostic paired profiling overhead; not steady-state latency percentiles",
"text_output_tokens": 32,
"requests": [],
}
config = {
"profiler": "torch",
"torch_profiler_dir": str(trace_dir),
"torch_profiler_with_stack": False,
"torch_profiler_record_shapes": False,
"torch_profiler_with_memory": False,
# Archive compression happens after writers exit, avoiding async gzip/hash races.
"torch_profiler_use_gzip": False,
"torch_profiler_dump_cuda_time_total": False,
}
report["profiler_config"] = config
save(args.out / "report.json", report)
omni = None
profiling = False
try:
params = None
if args.kind == "spark":
from vllm import SamplingParams
from vllm_omni.edge.local.plan import plan_text_session
plan = plan_text_session(
args.model, max_model_len=4096, max_num_seqs=4, max_num_batched_tokens=512, enforce_eager=True
)
report["plan"] = plan.to_dict()
if not plan.admitted:
report["status"] = "rejected"
return
kwargs = plan.engine_kwargs
prompt = "The garden has trees, flowers, and a small pond. Describe the garden in detail."
params = SamplingParams(temperature=0, max_tokens=32, ignore_eos=True)
else:
from transformers import AutoTokenizer
from vllm_omni.model_executor.models.qwen3_tts.configuration_qwen3_tts import Qwen3TTSConfig
from vllm_omni.model_executor.models.qwen3_tts.prompt_embeds_builder import Qwen3TTSPromptEmbedsBuilder
cfg = Qwen3TTSConfig.from_pretrained(args.model)
tok = AutoTokenizer.from_pretrained(args.model)
info = {
"task_type": ["CustomVoice"],
"text": ["Hello, this is a speech test."],
"language": ["English"],
"speaker": ["Vivian"],
}
length = Qwen3TTSPromptEmbedsBuilder.estimate_prompt_len_from_additional_information(
additional_information=info,
task_type="CustomVoice",
tokenize_prompt=lambda x: tok(x, padding=False)["input_ids"],
codec_language_id=cfg.talker_config.codec_language_id,
spk_is_dialect=cfg.talker_config.spk_is_dialect,
)
prompt = {"prompt_token_ids": [0] * length, "additional_information": info}
kwargs = {"deploy_profile": "edge", "stage_init_timeout": 180}
start = time.perf_counter()
omni = AsyncOmni(model=args.model, **kwargs, profiler_config=config)
report["startup_s"] = time.perf_counter() - start
async def request(phase, number):
start = time.perf_counter()
outputs = 0
finished = False
audio_samples = 0
async for output in omni.generate(prompt, sampling_params=params, request_id=f"{phase}-{number}"):
outputs += 1
finished = finished or output.finished
if args.kind == "tts" and output.outputs:
mm = output.outputs[0].multimodal_output
audio = mm.get("audio") if mm else None
parts = audio if isinstance(audio, list) else [audio]
audio_samples += sum(int(part.numel()) for part in parts if part is not None)
row = {
"phase": phase,
"index": number,
"wall_s": time.perf_counter() - start,
"events": outputs,
"finished": finished,
"audio_samples": audio_samples,
}
report["requests"].append(row)
save(args.out / "report.json", report)
if not finished or not outputs:
raise RuntimeError(f"Incomplete diagnostic request: {row}")
await request("warmup", 0)
for i in range(3):
await request("untraced_before", i)
rpc_started = time.perf_counter()
profiling = True
if args.kind == "tts":
# Both workers are rank 0. A shared prefix overwrites the first stage's trace.
report["stage_trace_prefixes"] = {str(stage): f"e2e-stage{stage}" for stage in (0, 1)}
report["start_rpc"] = [
await omni.start_profile(profile_prefix=prefix, stages=[int(stage)])
for stage, prefix in report["stage_trace_prefixes"].items()
]
else:
report["start_rpc"] = await omni.start_profile(profile_prefix="e2e-diagnostic")
report["start_rpc_s"] = time.perf_counter() - rpc_started
profiling = True
for i in range(3):
await request("traced", i)
rpc_started = time.perf_counter()
report["stop_rpc"] = await omni.stop_profile()
report["stop_rpc_s"] = time.perf_counter() - rpc_started
profiling = False
for i in range(3):
await request("untraced_after", i)
medians = {
phase: statistics.median(r["wall_s"] for r in report["requests"] if r["phase"] == phase)
for phase in ("untraced_before", "traced", "untraced_after")
}
report["median_wall_s"] = medians
report["traced_over_untraced_before"] = medians["traced"] / medians["untraced_before"]
report["traced_over_untraced_after"] = medians["traced"] / medians["untraced_after"]
if args.kind == "tts":
report["overhead_caveat"] = (
"Same prompt but speech generation can vary; compare audio_samples alongside wall-time ratios."
)
report["traces"] = [
{
"path": str(f.relative_to(args.out)),
"bytes": f.stat().st_size,
"sha256": hashlib.sha256(f.read_bytes()).hexdigest(),
}
for f in trace_dir.rglob("*")
if f.is_file()
]
if not report["traces"]:
raise RuntimeError("Profiler RPC returned but no trace artifact was written")
for prefix in report.get("stage_trace_prefixes", {}).values():
if not any(prefix in trace["path"] and ".json" in trace["path"] for trace in report["traces"]):
raise RuntimeError(f"Missing trace artifact for {prefix}")
report["status"] = "completed"
except Exception as error:
report.update(status="failed", error=repr(error), traceback=traceback.format_exc())
traceback.print_exc()
finally:
if profiling and omni is not None:
try:
await omni.stop_profile()
except Exception as error:
report["stop_error"] = repr(error)
if omni is not None:
omni.shutdown()
report["end_unix"] = time.time()
save(args.out / "report.json", report)
return report["status"] == "completed"
if __name__ == "__main__":
p = argparse.ArgumentParser(description=__doc__)
p.add_argument("--kind", choices=["spark", "tts"], required=True)
p.add_argument("--model", required=True)
p.add_argument("--out", type=Path, required=True)
args = p.parse_args()
os.environ.setdefault("VLLM_WORKER_MULTIPROC_METHOD", "spawn")
from vllm_omni.windows.aio import install_selector_policy
install_selector_policy()
raise SystemExit(0 if asyncio.run(run(args)) else 1)
@@ -0,0 +1 @@
evidence/** -text -whitespace
@@ -0,0 +1,67 @@
# PC/mobile E2E check and profiling — 2026-09-22
**60 device/model pairs checked; five current desktop paths profiled; 55 retain
explicit complete-pipeline blockers.** The five paths completed 900 measured
requests in total and at least 30 minutes of sustained generation each.
Completed performance protocols do not establish full release qualification.
- [Final findings and measured results](evidence/FINAL_REVIEW.md)
- [Complete configuration × model matrix and repair steps](evidence/summary/README.md)
- [Implementation roadmap for all configurations and models](../../../../docs/design/omni_edge_e2e_roadmap.md)
- [Requirement-by-requirement audit](evidence/requirements-audit.json)
- [Raw performance summary](evidence/summary/matrix.json)
- [Memory, startup, power, sustained trends and trace analysis](evidence/resource-summary.json)
- [Separate TTS stage counters](evidence/attribution-summary.json)
- [Completion and artifact-integrity checks](evidence/completion-integrity.json)
- [Chronological experiments, failures and retries](evidence/README.md)
- [Reproduction harness and measurement boundaries](../../PROFILING.md)
## Main findings
Spark text ran on WSL CPU and on CUDA in WSL/native Windows. CPU uses 1.7B INT8;
CUDA uses 4B BF16, so these are not same-model speedup comparisons. Batch-dependent
greedy outputs remain a reference/reproducibility investigation item.
Qwen3-TTS 0.6B CustomVoice ran both stages on CUDA in WSL/native Windows.
The measured groups had simulated playback deficits in 1/180 WSL requests and
49/180 native Windows requests. Windows sustained generation slowed late in the
run: the final-minute RTF p50 was 1.316, with five requests in that window. A later
driver snapshot reported a 33 W GPU power ceiling; the evidence does not establish
when or why it changed. Actual sound-device playback and speech reference quality
remain unqualified. WSL loading headroom and normal vocoder shutdown also need work.
The other cells retain specific runtime, artifact, registration, memory-feasibility
or device-access gaps. AI Hub component evidence is not promoted to complete
mobile generation, playback or sustained co-residency. No missing latency is zero,
and a rejected export is not a permanent rejection of the model/device family.
## Verify and reproduce
From the repository root:
```bash
python benchmarks/edge_harness/archive_profiles.py verify \
benchmarks/edge_harness/results/e2e_profiling_20260922
python benchmarks/edge_harness/archive_profiles.py restore \
benchmarks/edge_harness/results/e2e_profiling_20260922 /absolute/path/to/new-run-root
python benchmarks/edge_harness/summarize_e2e_profiles.py \
--matrix /absolute/path/to/new-run-root/prior-matrix/matrix.json \
--runs /absolute/path/to/new-run-root --out /absolute/path/to/new-summary
python benchmarks/edge_harness/analyze_profile_resources.py \
--runs /absolute/path/to/new-run-root --out /absolute/path/to/new-resource-summary.json
```
[manifest.json](manifest.json) records original and stored hashes/sizes. Large
uncompressed files are stored as `.archive.gz`; restore before replaying original
relative trace paths. Raw reports retain their original platform paths and
measurement metadata. The portable harness is documented separately; historical
supervisor scripts contain this run's local paths and process identities.
Evidence bytes are protected from Git newline conversion by local attributes.
Hash verification proves archive integrity, not numerical/model correctness.
The harness's 17 focused tests and pinned Ruff 0.14.10 checks passed. All trace and
counter diagnostics finished before archiving; failures and interrupted attempts
remain available with their original configurations.
@@ -0,0 +1,58 @@
# End-to-end check and profiling review — 2026-09-22
All 60 device/model pairs have a disposition. Five current desktop execution paths were selected for profiling; the other 55 retain concrete complete-pipeline blockers. This is a check of the current implementation, not a claim that all planned backends or release gates are implemented.
The [full matrix](summary/README.md) contains all cells and next steps. [Requirement audit](requirements-audit.json), [raw performance](summary/matrix.json), [resource/trace analysis](resource-summary.json), and [stage counters](attribution-summary.json) retain the evidence and limits.
## Executed timing protocol
Twenty measured requests per short/medium/long × concurrency 1/2/4 group; separate warmups, a 30-minute medium/concurrency-1 sustained phase, and separate trace/fault diagnostics. Nearest-rank percentiles describe measured requests. Existing disk/JIT caches were retained.
| Path | Protocol complete | Normal requests checked | Constructor startup s | Sustained s | Medium c1 latency p50 / p95 | Medium c1 rate p50 |
|---|---|---:|---:|---:|---|---|
| pc_cpu_wsl / Spark-X2.5 | True | 405 | 20.767 | 1805.768 | 0.762 / 0.801 s | 15.663 token/s |
| pc_cuda_wsl / Spark-X2.5 | True | 839 | 23.693 | 1802.602 | 0.090 / 0.103 s | 46.545 token/s |
| pc_cuda_wsl / Qwen3-TTS 0.6B CustomVoice | True | 1472 | 345.168 | 1801.183 | 73.956 / 111.604 ms | 0.175 RTF |
| pc_cuda_windows / Spark-X2.5 | True | 708 | 95.155 | 1803.249 | 0.100 / 0.129 s | 44.656 token/s |
| pc_cuda_windows / Qwen3-TTS 0.6B CustomVoice | True | 1290 | 79.792 | 1804.298 | 111.521 / 302.522 ms | 0.178 RTF |
Constructor startup excludes earlier imports, artifact hashing and plan construction. Resource analysis also retains inclusive host-launch-to-first-request/output timing. Native Windows Spark reads its checkpoint through the WSL UNC path; native Windows TTS uses a local Windows copy. Startup comparisons therefore include filesystem and preparation differences. Spark CPU uses 1.7B INT8; CUDA Spark uses 4B BF16. These are not same-model speedup comparisons. TTS is the pinned 0.6B CustomVoice checkpoint, English/Vivian. Other voices, languages and TTS modes are unqualified.
## Reliability and output checks
| Path | Recorded normal-output invariants | Targeted probe status | Cancellation / failure observation |
|---|---|---|---|
| pc_cpu_wsl / spark | True | completed | queue saturation=True; same tokens after drain=True; oversized refusal=True; post-cancel events=0; worker error=True, 5.907 s; harness cleanup processes=0 |
| pc_cuda_wsl / spark | True | completed | queue saturation=True; same tokens after drain=True; oversized refusal=True; post-cancel events=0; worker error=True, 4.160 s; harness cleanup processes=0 |
| pc_cuda_wsl / tts | True | completed | abort ack=0.002 s; late PCM samples=0; worker error=True, 4.107 s; harness cleanup processes=0 |
| pc_cuda_windows / spark | True | completed | queue saturation=True; same tokens after drain=True; oversized refusal=True; post-cancel events=0; worker error=True, 0.315 s; harness cleanup processes=0 |
| pc_cuda_windows / tts | True | completed | abort ack=0.003 s; late PCM samples=0; worker error=True, 0.269 s; harness cleanup processes=0 |
A completed probe means it ran. Inspect each outcome. Oversized admission is not an induced OOM; the TTS slow-consumer probe does not saturate every internal buffer. Targeted checks do not establish perceptual/reference quality or all possible state transitions.
## Findings requiring follow-up
- pc_cpu_wsl Spark: 35 measured concurrency-2/4 requests produced a token sequence absent from the corresponding concurrency-1 set. This is a reproducibility/reference gap; timing evidence alone does not identify numerical or state-related causes.
- pc_cuda_wsl Spark: 32 measured concurrency-2/4 requests produced a token sequence absent from the corresponding concurrency-1 set. This is a reproducibility/reference gap; timing evidence alone does not identify numerical or state-related causes.
- pc_cuda_wsl TTS: 1/180 measured requests had a simulated post-startup playback deficit. Raw chunk timings/underruns are retained. Actual sound-device playback, speech tail/reference agreement, ASR and perceptual/speaker quality remain unqualified.
- pc_cuda_wsl TTS sustained: 0/1269 requests had RTF above 1; 0 had simulated playback deficits. Requests submitted in the final 60 seconds: n=42, RTF p50/p95=0.180/0.185. This tail window is separate from the full-run and first/last-five-minute distributions.
- pc_cuda_windows Spark: 40 measured concurrency-2/4 requests produced a token sequence absent from the corresponding concurrency-1 set. This is a reproducibility/reference gap; timing evidence alone does not identify numerical or state-related causes.
- pc_cuda_windows TTS: 49/180 measured requests had a simulated post-startup playback deficit. Raw chunk timings/underruns are retained. Actual sound-device playback, speech tail/reference agreement, ASR and perceptual/speaker quality remain unqualified.
- pc_cuda_windows TTS sustained: 21/1087 requests had RTF above 1; 98 had simulated playback deficits. Requests submitted in the final 60 seconds: n=5, RTF p50/p95=1.316/1.337. This tail window is separate from the full-run and first/last-five-minute distributions.
- WSL TTS startup briefly coincided with only 24,514,560 bytes of available Windows RAM. The retained minimum sample includes other processes. Native-stage migration into the shared memory ledger and loading/workspace headroom still need work; sampled peaks are lower bounds, not allocation accounting.
- The normal WSL TTS baseline required forced vocoder shutdown after its grace period. The isolated worker-failure probe later retired owned workers; that does not erase the baseline shutdown finding.
- The original TTS profiler used the same rank-0 filename for both stages. The diagnostic workaround uses separate public-API stage prefixes. Original collided traces and their logs are preserved under trace-collision-1; production profiler naming remains a repair item.
- Native Windows TTS slowed substantially at the end of sustained execution while GPU telemetry reported P5 and an 810 MHz memory clock. AC/Performance conditions were still recorded. A subsequent 18:21 driver snapshot reports software power capping active, a 33 W current ceiling versus 95 W default, and inactive GPU thermal slowdown flags ([raw snapshot](gpu-low-clock-diagnostic.txt)). This spot check does not establish when or why the platform changed the limit. The clock transition and latency change are not proof of a thermal cause. Investigate power-state/clock behavior before claiming sustained real-time speech.
- CPU TTS has a vLLM/Omni compatibility blocker; native Windows CPU lacks the needed attention operators. Pin and qualify matching backend builds before claiming those cells.
- Qwen3.8-27B lacks the current public Omni pipeline registration; historical bare-vLLM text and vision-component results do not qualify its complete multimedia route.
- Matching full MiniCPM-o 4.5 and InternVLA-A1 checkpoints/stage artifacts are absent from checked roots. Obtain pinned artifacts, establish desktop reference outputs, then repeat the appropriate modality/action suites.
- AMD 890M evidence remains a vision component; the tested NPU whole-vision artifacts were rejected. Complete downstream adapters and compatible compiled artifacts are missing. Joint CPU/iGPU/NPU/GPU execution has no complete co-resident serial/overlap comparison.
- Mobile/embedded and X Elite targets lack device-local application access and integrated stateful model pipelines. AI Hub components do not supply the prefill/decode/KV/sampling loop, playback, co-residency or sustained device thermals. Do not deploy through AI Hub.
## Measurement limits
Windows physical RAM includes WSL; WSL quota, process RSS/PSS and VRAM are distinct scopes and must not be added. Power/temperature/clock samples cover the whole NVIDIA GPU, including other applications. CPU package temperature and CPU/NPU/whole-device energy are unavailable in these environments. CPU effective-frequency trends were not captured; the separate WMI check exposes nominal/aggregate counters, not a validated per-core frequency trace. No model-exclusive energy or causal thermal-throttling claim is made.
Text delivery intervals can combine tokens into output updates. Effective prefill includes queue, host and first-output costs. Torch category duration sums overlap; interval unions are not additive across categories. Sequential profiler stop/export can extend trace windows with idle time. TTS trace overhead comparisons retain speech-length variation. StepStats counters use host timing with synchronization disabled, overlapping scopes and per-process reservoirs; they are not pooled stage GPU latencies. Baseline-versus-counter ratios also include different observed power/clock conditions after the GPU limit change; they are not isolated instrumentation overhead. Engine-core step counters include idle/no-work iterations. The existing orchestrator-dispatch hook is only in the optional event-driven loop, which these runs did not enable; no dispatch latency is inferred from its absent counter.
Failures and corrected retries remain archived. The Windows TTS report-write failure interrupted its first sustained phase; that attempt is not a sustained pass. No universal model/device release qualification follows from a completed performance protocol.
@@ -0,0 +1,467 @@
# E2E checks and profiling — 2026-09-22
This file is a chronological experiment log, including intermediate states.
The final review is generated as `FINAL_REVIEW.md` after all serial jobs exit;
use it together with `summary/README.md` for the final dispositions.
User scope: finish checking and profiling the accepted mobile/PC × model plan;
where the current implementation does not support a complete pipeline, record
the reason for later repair. Do not convert component results into E2E claims.
## Current experiment
The prior 60-cell audit is the input backlog. Current read-only preflights in
`preflight-windows.json` and `preflight-wsl-cpu.json` use real filesystem paths
(the older Windows audit included a PowerShell provider-prefixed workspace
path). They retain missing/broken artifact links explicitly. No Android device
is attached; no complete MiniCPM-o 4.5 or InternVLA-A1 checkpoint is available
in the checked roots. MiniCPM5-2B is a different model and is not substituted.
Five currently runnable complete request paths are being measured serially:
1. Spark 1.7B INT8, WSL CPU, existing vLLM 0.28 CPU build.
2. Spark 4B BF16, WSL CUDA, vLLM 0.29.
3. Spark 4B BF16, native Windows CUDA, vLLM 0.29+cu134.
4. Qwen3-TTS 0.6B CustomVoice, WSL CUDA, edge deployment profile.
5. The same pinned Qwen3-TTS checkpoint, native Windows CUDA.
The CPU run started first. `run_remaining.py` waits for its actual live WSL
process to exit and its host collector to finalize, then runs the four GPU
benchmarks serially. Inspect actual process/session state before restarting
anything. `queue.json` is written once the initial wait finishes.
Each run measures three length bands × concurrency 1/2/4 × 20 requests, excluding
warmups, followed by 1800 seconds of continuous medium-length requests. Spark
forces 128 output tokens for timing; this is not recommended application
sampling. Actual prompt token counts are archived. TTS retains terminal audio
separately from nonterminal chunks and records hashes/finite checks. Warmup PCM
chunks are archived individually as float32 bytes, with rate/order in JSON.
Terminal incremental/cumulative semantics and perceptual quality remain separate
qualification gates. Playback stalls are simulated from arrivals, not measured
through an audio output device.
Update: inspection of `resolve_sampling_params_list`, `drain_delta_payload` and
the output processor confirms DELTA payload draining. The TTS recorder now
resolves and checks the final stage's actual DELTA output setting, includes
terminal audio once in the primary complete playback metrics, and keeps
prefix-only metrics and raw terminal bytes separately. Waveform/reference
quality and correct flush boundaries still require their own evidence.
Each `<run>-host` directory contains the exact command, combined log, process
exit status and one-second Windows RAM/whole-NVIDIA-device telemetry. AC status
is sampled. GPU power is not whole-system/CPU/NPU energy. Background desktop
activity is not disabled. Brief read-only inventory and test-runner development
occurred during the initial CPU sweep; results are observational and carry
these conditions, not isolated laboratory SLA claims. The initial CPU collector
could not decode the localized power-scheme label; AC and battery telemetry
remain available. The collector's decoding was corrected for subsequent runs.
Model startup uses existing disk/JIT caches. No cold-disk startup or component
timing sum is reported as E2E latency. Memory peaks sampled by the engine are
lower bounds; Windows RAM and WSL RAM must not be added.
## Scripts
Source lives in `vllm-omni-edge/benchmarks/edge_harness/`:
- `profile_local_text.py`: existing Omni local text API, raw events, requests,
lengths/concurrency, sustained run, slow consumer and cancellation/recovery.
- `profile_local_tts.py`: public AsyncOmni, pinned real weights, raw chunk
arrivals, finite checks, terminal samples, sustained run and abort/recovery.
- `profile_host_command.py`: Windows host telemetry around one explicit command.
- `summarize_e2e_profiles.py`: checks all 60 pairings and raw-evidence hashes;
joins the five profiling runs; unavailable E2E paths keep their exact reasons.
- `test_summarize_e2e_profiles.py`: nearest-rank percentile, per-configuration
coverage, warmup exclusion and thermal-duration gate tests (3 passed).
- `profile_trace_diagnostic.py`: three untraced / three traced / three untraced
diagnostic requests using existing Omni profiler RPCs. Executed separately
after all sweep/thermal runs by `run_diagnostics.py`; its supervisor verifies
the live predecessor process identity before waiting. Three samples are
diagnostic overhead observations, not latency percentiles.
- `analyze_profile_resources.py`: whole-GPU telemetry/energy integration and
trace category/event summaries. Concurrent event durations are not added
and called wall time; long telemetry gaps are excluded from energy
integration. Two resource-accounting tests pass (5 analyzer tests total).
CPU sensor probe results: Windows ACPI query returns access denied; WSL exposes
no hwmon/thermal-zone temperature inputs. CPU package temperature/energy cannot
be claimed. GPU temperature/power and sustained CPU throughput remain measured.
The Windows power-scheme query confirms Performance mode; raw probe saved.
The completed CPU sweep exposes a numerical/reproducibility qualification gap:
all 20 long-prompt concurrency-1 requests share one output sequence, while
concurrency 2 has two sequences (10 each) and concurrency 4 has four sequences
(5 each). Inputs all contain 1928 tokens and force 128 output tokens. First
differences from the c1 sequence appear at output indices 1–4 for differing
variants. Raw examples are in `spark-cpu-concurrency-output-variants.json`.
Without captured reference logits, this does not establish state contamination
or its cause. Do not promote successful timing completion into batch-invariant
quality acceptance. Snapshot sequence/epoch/queue-bound checks found no stream
invariant failures; final cancellation checks still run after the sustained phase.
Generate/update the current report from the implementation repository:
```bash
../.venvs/omni-cpu/bin/python benchmarks/edge_harness/summarize_e2e_profiles.py \
--matrix benchmarks/edge_harness/results/model_device_matrix_20260922/matrix.json \
--runs ../analysis/experiments/e2e_profiling_20260922 \
--out ../analysis/experiments/e2e_profiling_20260922/summary
```
## Completion requirements still open
Progress at 2026-09-22 15:05 local time:
- CPU sweep completed all nine groups × 20 measured requests, plus warmups,
1805.77 seconds sustained generation, slow-consumer and after-cancel requests
(405 recorded normal requests). Cancellation acknowledged backend abort,
producer stopped, zero in-flight requests, and no delivered stale events.
Original CPU workers exited. CPU queue-saturation backpressure still needs
a stronger delay probe: the original 30 ms consumer delay can be faster than
CPU production, so a bounded queue alone does not prove backpressure engaged.
- CPU diagnostic completed, with 3 before / 3 traced / 3 after requests and a
74,474,545-byte compressed trace. Traced median request time was 1.232× before;
this excludes profiler start/stop/export cost. Trace postprocessing reached
roughly 27 GiB worker RSS under the 30.9 GiB WSL quota. It completed before
any manual intervention; shutdown used a forced process-manager cleanup.
The original full instrumentation script is archived as
`profile_trace_diagnostic_full.py`. Future diagnostics use 32 text output
tokens and disable shape/memory instrumentation; comparisons remain paired
within the same diagnostic configuration, separate from 128-token baselines.
- Initial GPU launches failed before model execution: unquoted inherited Windows
PATH expansion in WSL, and native Python's GBK default decoding a Torch template.
They are harness failures, not hardware/model failures. Preserved under
`launcher-failures-1/`. Retried commands use a minimal Linux PATH and
`PYTHONUTF8=1` / `PYTHONIOENCODING=utf-8`. The host wrapper now propagates child
exit status rather than always returning zero.
- `run_retry.py` serializes corrected sweeps then diagnostics. Its live status
is `retry-status.json`; `queue.json` records the current sweep supervisor.
WSL CUDA Spark has loaded and is generating requests successfully. Do not
restart live runs based only on an observation timeout.
Wait for and inspect all five real runs, diagnose runner failures if any, then
derive p50/p95 by exact configuration from raw samples. Inspect actual device
placement, state/recovery results, TTS final-tail correctness, memory and
thermal trends. Run separate diagnostic profiling where the runtime supports
it, keeping traced latency separate and quantifying overhead. Recheck all
unavailable pairings against current artifacts/runtime evidence and record
specific repair actions. Publish a reproducible evidence bundle and update
the fork only after the final matrix and hashes verify. Do not mark the goal
complete while benchmark processes or required checks remain outstanding.
### Profiling supervision update — 15:28 local
The completed CPU run has 405 request records with no recorded sequence,
epoch, completion or queue-bound violations. Batch-dependent token differences
remain a separate qualification gap. The summarizer now includes recorded
output invariants and separate trace/reliability reports without treating probe
completion as a pass. Ten focused analyzer tests pass.
`run_reliability.py` waits for the corrected sweep/trace supervisor, then runs
three isolated Spark checks. `run_tts_reliability.py` waits for that supervisor
and runs WSL/native Windows TTS interruption, recovery, slow-consumer and owned
vocoder-failure probes. Fault injection selects process handles belonging to
the probe's own engine and confirms process ancestry. Forced cleanup, if needed,
is retained as a finding. TTS slow-consumer tests do not claim to saturate the
internal 64 MiB transport buffer.
`run_final_analysis.py` waits for both reliability sequences before parsing
large traces, keeping that CPU/memory overhead outside timing runs. Its queue
record is `analysis-queue.json`. Final publication still requires review of the
actual results, finalized requirement dispositions, reproducible evidence and
hash checks; none of these supervisors automatically push changes.
### Profiling update — 15:47 local
WSL CUDA Spark completed 839 normal request records, including all 180 measured
requests and 1802.60 seconds sustained generation. Recorded sequence/epoch/
completion/queue checks pass. Cancellation acknowledged backend abort, stopped
the producer, left zero in flight and delivered no remaining stale events.
Short/medium/long concurrency-1 TTFT p50 values are 0.0352/0.0901/0.3633 s;
decode p50 values are 50.20/46.55/48.21 tokens/s (4B BF16, forced 128 outputs).
These are not same-model CPU/GPU comparisons.
Native Windows Spark's second launcher attempt failed before model execution:
`VLLM_CUDART_SO_PATH` was omitted. The benchmark common helper now reuses the
acceptance environment's torch DLL and short `~/c29` cache directory; native
Omni import passed. Before trace diagnostics, `run_diagnostics.py` will archive
this specific failed attempt under `launcher-failures-2` and retry its full
baseline after other sweeps finish. This keeps GPU workloads serial. Future
native TTS/trace/reliability launches inherit the same helper via their shared
benchmark import. No runtime wheel was changed.
WSL TTS loaded both real-weight stages and initialized in about 345 seconds,
including graph capture under substantial GPU/host memory pressure. It completed
the short concurrency-1 group and continues. Preserve this startup behavior;
do not substitute the earlier 40-second diagnostic initialization measurement.
### Profiling update — 16:23 local
WSL TTS completed all 180 measured requests and 1801.18 seconds sustained
operation: 1472 normal request records total. Recorded output invariants pass.
Concurrency-1 short/medium/long TTFA p50 values are 67.58/73.96/68.52 ms; p95
values are 91.83/111.60/100.57 ms. Corresponding RTF p50 values are
0.2033/0.1748/0.1758. One of the 180 measured requests (medium, concurrency 4)
has a 0.66094 ms simulated playback deficit. Actual sound-device playback and
perceptual/reference speech quality remain unqualified. All 223 archived
warmup PCM chunks match their hashes and sample counts; see
`tts-cuda-wsl-warmup-audio-integrity.json`.
Important qualification gaps remain: startup took 345.17 s, whole-GPU memory
peaked around 23.3 GiB, and whole-Windows-host available RAM briefly reached
24,514,560 bytes (about 23.4 MiB). The raw minimum sample is retained in
`tts-cuda-wsl-memory-headroom.json`; it includes other processes and is not
exclusive model attribution. Normal shutdown force-killed the remaining
vocoder stage after its grace interval; both stage PIDs and the controller were
subsequently confirmed absent. Abort acknowledgement took 35.3 ms and the next
request completed; late-event fencing still needs the queued reliability probe.
Native Windows TTS has passed the corrected import and reached stage startup.
The Windows Spark baseline retry follows that run before diagnostics. All runs
remain serialized. The harness now passes the repository-pinned Ruff 0.14.10
checks and 12 focused analyzer tests. See the new `PROFILING.md` in the harness
for portable per-run commands; supervisor scripts here are historical local
orchestration records with specific process IDs, not generic rerun entrypoints.
### Reporting failure and serial retry — 16:40 local
The first native Windows TTS sweep completed all 180 measured requests. It had
26 simulated underruns (positive durations 8.05–46.87 ms), and all 219 archived
warmup chunks passed integrity checks. Its sustained phase then stopped at 245
normal request records because `Path.replace(report.tmp, report.json)` raised
Windows access denied. This is a reporting failure, not a model-execution
failure, and the interrupted phase is not a 30-minute sustained pass.
A native Windows reproducer in `report-write-lock-probe/` confirms that a reader
without FILE_SHARE_DELETE blocks replacement on this workspace UNC path. The
shared report writer now defers running snapshots under this contention (raw
request JSONL remains authoritative), records the permission error, and requires
initial/final snapshots to persist with a bounded retry. Two regression tests
and the real Windows lock probe pass. Profile and trace CLIs now return a
nonzero exit code for failed reports. The earlier host exit code 0 must not be
mistaken for a successful TTS profile.
Read live reports using `inspect_live.py` with WSL Python. Avoid Windows
Get-Content/native readers on live report files: the currently running native
Spark process loaded the earlier writer before the fix. It has completed its
180-request sweep and is in sustained generation.
`run_windows_tts_retry.py` (queue: `windows-tts-retry-queue.json`) waits for the
existing sweep/trace/reliability/analysis chain to exit, then preserves the
interrupted native TTS run under `reporting-failures-1/` and performs a complete
fresh baseline. It reuses a completed, hash-verified paired trace if available,
otherwise reruns it; then performs native TTS reliability checks and regenerates
the final analyses. This additional supervisor must finish before publication
or goal completion. All inference and heavy trace analysis remain serial.
### Additional stage attribution
`run_attribution.py` waits for `run_windows_tts_retry.py` to finish, then runs
one medium-input/concurrency-1 TTS diagnostic per OS using the existing
`VLLM_OMNI_STEP_STATS_DIR` hooks, 20 measured requests and no sustained phase.
These directories are explicitly separate from the five full baselines.
`VLLM_OMNI_STEP_STATS_SYNC=0` keeps their counters as host-side timing;
Torch traces provide separate accelerator evidence. Warmup, slow-consumer,
abort and recovery calls also contribute to the per-process counters. Nested
counter durations must not be added into E2E latency. The existing counter
percentiles use rounded sample indices/a capped reservoir and are not pooled
across processes; forced shutdown may lose the final unflushed counter tail.
The attribution report compares 20 matched input/concurrency requests against
the uninstrumented baseline, retaining speech-length metrics and the caveat
that separate-process cache/thermal history and stochastic speech preclude a
pure causal overhead interpretation. Final task completion also requires
`attribution-queue.json` to be terminal and its actual process to have exited.
### Final diagnostic and archive preparation
`run_cpu_trace_refresh.py` waits for the attribution supervisor, preserves the
earlier full CPU diagnostic under `spark-cpu-wsl-trace-full`, and runs the same
lightweight 32-token diagnostic used for CUDA. The original full CPU trace did
not record profiler start/stop RPC durations; this separate run fills that
measurement gap without changing any baseline. Its queue must also be terminal
before final review/publication.
The summarizer now reports pooled within-request delivery intervals and
effective prefill throughput. Text timestamps are output-update timestamps and
can represent coalesced tokens; they are not per-token kernel measurements.
Intervals never cross request boundaries. Audio intervals exclude empty chunks
and retain nonempty terminal audio. Fifteen focused analyzer/report-writer tests
pass after adding this check.
The evidence archive utility preserves original file bytes and hashes. Files
larger than 50 MiB that are not already gzip are reversibly compressed with an
explicit original-to-stored mapping in the manifest. In particular, native
Windows Spark produced a roughly 194 MiB uncompressed trace, which cannot be
committed directly to GitHub. Restore the archive before replaying original
report-relative trace paths; unchanged original reports retain original hashes.
### Reliability results — 17:36 local
All three Spark probes reached the four-chunk queue capacity, preserved the
baseline token sequence after draining, rejected stale post-cancel handles and
oversized admission plans, and returned no late events after cancellation.
Terminating an owned model worker produced an explicit request error in
5.907 s (CPU WSL), 4.160 s (CUDA WSL), and 0.315 s (native Windows CUDA).
No owned process required harness cleanup. These target specific scenarios;
they do not prove every internal queue, reference-quality gate or memory-pressure
case. The oversized-plan check is admission rejection, not destructive OOM.
WSL TTS's slow consumer completed. Abort after the first nonempty finite audio
chunk acknowledged in 2.438 ms, delivered only an empty terminal event after
acknowledgement, and the following request completed with finite PCM. Killing
the owned vocoder produced `OmniEngineDeadError` after 4.107 s. No owned process
required harness cleanup. This does not qualify perceptual quality or saturation
of the internal 64 MiB buffer. See the `*-reliability/report.json` records.
### TTS trace filename collision found during evidence review
The first paired TTS diagnostics each produced only one trace. Both stage logs
explicitly exported to the same `trace_rank0.json`: stage 1 overwrote stage 0.
These records measure paired RPC/request overhead but preserve only the vocoder
trace, so they cannot establish full two-stage attribution. The runtime's
profiler artifact naming needs a stage identifier for general multi-stage use.
The diagnostic harness works around this through the existing public API:
`start_profile(profile_prefix="e2e-stage0", stages=[0])` and a distinct
`e2e-stage1` prefix for stage 1, with both active for the traced requests.
It requires an artifact for each stage. Background gzip is disabled for new
diagnostics; archive compression occurs after every writer has exited, avoiding
hashing a file still being compressed.
`run_tts_trace_refresh.py` waits for the final CPU diagnostic, preserves the
earlier TTS trace/host directories under `trace-collision-1/`, repeats both OS
diagnostics, then regenerates analyses. Its actual process and
`tts-trace-refresh-queue.json` must be terminal before publication. Baseline
timings are unchanged. Windows Spark's trace and both retained vocoder traces
contain actual CUDA kernel, memcpy and runtime events; file existence alone
was not used to infer accelerator capture.
### Native TTS retry and final audit preparation — 18:05 local
The fresh native Windows TTS run completed its full 180-request measured sweep
and is in sustained generation. This sweep has 49 simulated playback deficits,
positive durations 1.130–136.304 ms; its largest measured RTF is 0.3525. Thus
RTF below one does not imply the proposed zero-underrun gate passed. The earlier
interrupted attempt's 26/180 count remains a separate record, not pooled with
this rerun. Constructor startup is 79.792 s for the fresh run.
The resource analyzer now retains inclusive host-launch-to-first-request/output
timing, which includes imports, plan construction and artifact hashing before
the constructor. For example, native Spark's constructor took 95.155 s, while
host launch to first request was 175.590 s. Its checkpoint was accessed over the
WSL UNC path; native TTS uses a local Windows checkpoint copy. These are recorded
conditions, not an isolated OS startup comparison.
Sixteen focused tests now pass, including a check that missing desktop MiniCPM-o
and InternVLA checkpoints remain the primary machine-readable blocker. A single
Windows WMI frequency inventory is recorded separately; it is not a sustained
CPU effective-frequency trace. `render_final_review.py` and
`finalize_requirements.py` require terminal diagnostic queues before resolving
the final review and all 23 requirement groups. The evidence secret scan and
archive verification must run after all writers exit.
### All five baselines complete — 18:17 local
Native Windows TTS completed 1290 normal requests and 1804.298 seconds sustained
generation. All recorded normal-output invariants pass, and all 218 archived
warmup PCM chunks match their hashes and lengths. Normal shutdown retired both
stages without a forced-kill log. Its separate fault probe completed: abort
acknowledged in 3.488 ms with no late PCM, the following request completed, and
vocoder termination produced an explicit error in 0.269 s. No owned worker
required harness cleanup.
Sustained real-time performance failed despite functional completion. Of 1087
sustained requests, 21 had RTF above one and 98 had simulated playback deficits.
The first five minutes had RTF p50 0.1775 (n=208); requests submitted in the final
60 seconds had RTF p50/p95 1.3163/1.3370 (n=5), TTFA p50 346.34 ms and simulated
playback deficit p50 3674.54 ms. The full-run RTF p95 is only 0.2065, illustrating
why aggregate request percentiles alone hide this late slowdown. GPU telemetry
in the last minute reports an 810 MHz memory clock throughout, P5 in raw samples,
temperature p50 57 C and whole-GPU power p50 33.62 W. These are correlated
observations, not proof of a thermal cause. AC/Performance conditions remained
recorded. See `tts-cuda-windows-sustained-tail-check.json` and the raw telemetry.
The resource analyzer now includes the whole sustained request distribution,
RTF-above-one/deficit counts and a final-60-second window, alongside the existing
first/last-five-minute windows. Stage attribution and refreshed traces continue
serially after these completed baselines.
At 18:21, `nvidia-smi -q -d PERFORMANCE,POWER,CLOCK,TEMPERATURE` reported
software power capping active, a current GPU ceiling of 33 W versus a 95 W
default, P5 and an 810 MHz memory clock. GPU hardware/software thermal slowdown
flags were inactive at that instant; cumulative reason counters are not scoped
to this run. The raw snapshot is `gpu-low-clock-diagnostic.txt`. This later spot
check does not prove when or why the platform reduced its limit. No power-policy
setting was changed by this profiling task. Baseline-versus-stage-counter ratios
therefore include observed power/clock differences and cannot isolate profiler
overhead. Paired trace-before/during/after requests remain separately recorded.
### Diagnostic deadline correction — 18:36 local
The WSL stage-counter run reached engine readiness after 842.48 s, then its
900-second launcher deadline expired after one warmup and two measured requests.
The timeout/controller/owned stage PIDs were confirmed absent. This is an
insufficient diagnostic time allowance under the observed conditions, not a
claim that the model cannot execute. The raw last snapshot remains `running`;
the host exit code 124 is authoritative. The summarizer now resolves such stale
snapshots as failed/interrupted without editing the original data; 17 tests pass.
Only the still-waiting TTS trace supervisor was replaced, before it launched any
model, to extend its future WSL deadline to 1800 s. Its prior queue record is
`tts-trace-refresh-supervisor-superseded.json`. `run_attribution_retry.py` waits
for those traces, preserves the interrupted WSL counter run and original summary
under `attribution-timeouts-1/`, and repeats the same 20-request diagnostic with
an 1800-second allowance. It retains the completed native counter run and
regenerates summaries. Final review/publication also requires this retry queue
and actual supervisor process to be terminal. No ongoing inference was restarted
merely because an observation wait expired.
The native counter run completed all 20 measured requests (RTF p50 1.4450 in
the reduced-power conditions). Both stage counter files are present. Engine
step counts include idle/no-work iterations; the default orchestrator loop has
no dispatch counter hook, so an absent counter is not reported as zero latency.
The lightweight CPU trace also completed: paired request medians were
1.8122/1.9962/1.8516 seconds (before/traced/after), with profiler stop/export RPC
21.5903 seconds. The earlier full CPU trace remains under `spark-cpu-wsl-trace-full`.
## Corrected two-stage trace results
Both TTS trace refreshes completed with separate `e2e-stage0` and `e2e-stage1`
artifacts. WSL constructor startup was 937.495 s; before/traced/after request
medians were 5.0944/4.7426/4.3724 s and stop/export RPC was 15.5334 s. Native
Windows startup was 56.8888 s; corresponding medians were
4.2874/4.4784/4.5978 s and stop/export RPC was 18.0903 s. These are the separate
reduced-power diagnostic conditions, not replacements for baseline timings or
isolated OS/instrumentation effects. Speech lengths may differ.
The resource analyzer found actual CUDA kernel, memcpy and runtime events in
both stages on both OS paths. Stage-0/stage-1 kernel event counts were
196,938/10,977 for WSL and 54,380/10,977 for native Windows. Event counts are
trace evidence, not throughput or interchangeable work counts across builds.
Nested event sums and per-stage interval unions must not be added into E2E time.
The old collided traces remain under `trace-collision-1/`.
The WSL stage-counter retry began at 19:00 after the trace supervisor and its
analysis exited. It preserves the first timed-out attempt, retains the completed
native counter run, and repeats the unchanged 20-request medium/c1 workload.
## Terminal review and publication checks
The WSL counter retry completed all 20 medium/c1 measured requests with exit 0,
constructor startup 917.27 s and RTF p50 1.4879 under the recorded reduced-power
conditions. Normal shutdown completed; both known stage processes and the
supervisor were confirmed absent. The native counter run also has 20 measured
requests and both stage counter files. Their timings are not an isolated
instrumentation-overhead estimate.
`FINAL_REVIEW.md` is the canonical human review. All 23 groups in
`requirements-audit.json` now have terminal dispositions, including explicit
implementation, reference-quality and sensor gaps. `completion-integrity.json`
verifies all 60 cells, the 900 measured baseline requests, and original hashes
for the final trace/counter artifacts. The verifier normalizes Windows path
separators when reading native reports on Linux; raw reports are unchanged.
All five baselines completed at least 1800 seconds of sustained generation.
The 245-file text evidence scan had one reviewed false positive: the Qualcomm
helper selects a client using a token read from stdin/configuration; the flagged
assignment contains no string literal. The scan reports locations, never values,
and remains a heuristic rather than proof of absence. See `secret-scan.json`.
@@ -0,0 +1,39 @@
{
"status": "exited",
"pid": 61376,
"predecessor_pid": 61368,
"predecessor_created": 1790061648.4950807,
"jobs": [
{
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\summarize_e2e_profiles.py",
"--matrix",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\results\\model_device_matrix_20260922\\matrix.json",
"--runs",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\summary"
],
"status": "exited",
"start": 1790069742.699028,
"returncode": 0,
"end": 1790069744.9127042
},
{
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\analyze_profile_resources.py",
"--runs",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\resource-summary.json"
],
"status": "exited",
"start": 1790069744.9172206,
"returncode": 0,
"end": 1790069790.9965253
}
],
"end": 1790069791.0010314
}
@@ -0,0 +1,55 @@
{
"status": "exited",
"pid": 27528,
"predecessor_pid": 60180,
"predecessor_created": 1790066472.3919215,
"jobs": [
{
"name": "tts-cuda-wsl-attribution",
"status": "exited",
"start": 1790072195.7733316,
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 VLLM_OMNI_STEP_STATS_DIR=/home/zhout/project/edge_infer/analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl-attribution-step-stats VLLM_OMNI_STEP_STATS_SYNC=0 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/lib/wsl/lib timeout 900 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_local_tts.py --model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5 --out ../analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl-attribution --length-band medium --concurrency 1 --repeats 20 --sustained-seconds 0"
],
"step_stats_dir": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\tts-cuda-wsl-attribution-step-stats",
"returncode": 124,
"end": 1790073097.2235334,
"benchmark_status": "running",
"error": null
},
{
"name": "tts-cuda-windows-attribution",
"status": "exited",
"start": 1790073097.3751867,
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_local_tts.py",
"--model",
"C:\\Users\\zhout\\w2\\models\\Qwen3-TTS-0.6B-85e237c",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\tts-cuda-windows-attribution",
"--length-band",
"medium",
"--concurrency",
"1",
"--repeats",
"20",
"--sustained-seconds",
"0"
],
"step_stats_dir": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\tts-cuda-windows-attribution-step-stats",
"returncode": 0,
"end": 1790073445.3144553,
"benchmark_status": "completed",
"error": null
}
],
"end": 1790073477.1781323,
"analysis_returncode": 0
}
@@ -0,0 +1,30 @@
{
"status": "exited",
"pid": 53412,
"predecessor_pid": 58756,
"predecessor_created": 1790073287.6435695,
"reason": "842 s startup consumed the first diagnostic deadline; retain exact workload and allow 1800 s.",
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_host_command.py",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\tts-cuda-wsl-attribution-host",
"--cwd",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge",
"--",
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 VLLM_OMNI_STEP_STATS_DIR=/home/zhout/project/edge_infer/analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl-attribution-step-stats VLLM_OMNI_STEP_STATS_SYNC=0 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/lib/wsl/lib timeout --kill-after=30 1800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_local_tts.py --model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5 --out ../analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl-attribution --length-band medium --concurrency 1 --repeats 20 --sustained-seconds 0"
],
"start": 1790074824.016412,
"returncode": 0,
"benchmark_status": "completed",
"error": null,
"summarize_e2e_profiles.py": 0,
"analyze_profile_resources.py": 0,
"end": 1790076079.2944703
}
@@ -0,0 +1,665 @@
{
"runs": [
{
"run": "tts-cuda-wsl-attribution",
"status": "completed",
"counter_files": [
{
"path": "tts-cuda-wsl-attribution-step-stats/stage0_1628534.json",
"sha256": "cf3c11fd9475d555ec339ae6cdc51f9a3ca508d0ce3343a7a1c0c96e7cc13b78",
"record": {
"role": "stage0",
"pid": 1628534,
"started_at": 1790074873.1754153,
"dumped_at": 1790076024.4103425,
"counters": {
"predictor.substep_ms": {
"count": 120,
"sum_ms": 7268.254211987369,
"mean_ms": 60.56878509989474,
"p50_ms": 0.961597019340843,
"p95_ms": 2.17054202221334,
"max_ms": 7133.578689012211
},
"predictor.loop_ms": {
"count": 8,
"sum_ms": 7268.873039050959,
"mean_ms": 908.6091298813699,
"p50_ms": 22.658564033918083,
"p95_ms": 7152.572002960369,
"max_ms": 7152.572002960369
},
"sched.schedule_ms": {
"count": 2313,
"sum_ms": 256.26453541917726,
"mean_ms": 0.11079314112372558,
"p50_ms": 0.10492000728845596,
"p95_ms": 0.14752004062756896,
"max_ms": 0.49802300054579973
},
"model.forward_ms": {
"count": 2290,
"sum_ms": 1034.0027296333574,
"mean_ms": 0.451529576259108,
"p50_ms": 0.3149589756503701,
"p95_ms": 0.49462204333394766,
"max_ms": 54.31275995215401
},
"model.sample_meta_ms": {
"count": 2290,
"sum_ms": 0.9397446410730481,
"mean_ms": 0.0004103688388965276,
"p50_ms": 0.0003809691406786442,
"p95_ms": 0.0005720066837966442,
"max_ms": 0.01026899553835392
},
"model.sample_async_ids_ms": {
"count": 2290,
"sum_ms": 39.81349611422047,
"mean_ms": 0.017385806163415052,
"p50_ms": 0.01623999560251832,
"p95_ms": 0.023073982447385788,
"max_ms": 0.1180170220322907
},
"sampler.apply_penalties_ms": {
"count": 2290,
"sum_ms": 1226.4269451843575,
"mean_ms": 0.5355576179844356,
"p50_ms": 0.47708500642329454,
"p95_ms": 0.6348550086840987,
"max_ms": 86.28930401755497
},
"sampler.apply_logits_processors_ms": {
"count": 2290,
"sum_ms": 1259.1862814733759,
"mean_ms": 0.5498630050102078,
"p50_ms": 0.48752600559964776,
"p95_ms": 0.6532209808938205,
"max_ms": 86.38409397099167
},
"sampler.apply_temperature_ms": {
"count": 2290,
"sum_ms": 64.28353069350123,
"mean_ms": 0.02807141078318831,
"p50_ms": 0.02267397940158844,
"p95_ms": 0.04401401383802295,
"max_ms": 0.1371709513477981
},
"sampler.topk_topp_ms": {
"count": 2290,
"sum_ms": 729.5759441331029,
"mean_ms": 0.31859211534196635,
"p50_ms": 0.30417798552662134,
"p95_ms": 0.42165000922977924,
"max_ms": 2.613923978060484
},
"sampler.sample_ms": {
"count": 2290,
"sum_ms": 859.5011509605683,
"mean_ms": 0.37532801351989886,
"p50_ms": 0.35392201971262693,
"p95_ms": 0.4792950348928571,
"max_ms": 4.110737005248666
},
"model.sampler_call_ms": {
"count": 2290,
"sum_ms": 2282.2709786705673,
"mean_ms": 0.9966248815155315,
"p50_ms": 0.9120219619944692,
"p95_ms": 1.1731770355254412,
"max_ms": 86.92520199110731
},
"model.sample_ms": {
"count": 2290,
"sum_ms": 2386.9292719173245,
"mean_ms": 1.0423271929769975,
"p50_ms": 0.9468179778195918,
"p95_ms": 1.232420967426151,
"max_ms": 86.97341399965808
},
"model.talker_mtp_ms": {
"count": 2290,
"sum_ms": 11.977064074017107,
"mean_ms": 0.005230158984286947,
"p50_ms": 0.0050800153985619545,
"p95_ms": 0.006122048944234848,
"max_ms": 0.03696500789374113
},
"core.step_ms": {
"count": 2331,
"sum_ms": 271306.1447388609,
"mean_ms": 116.3904524834238,
"p50_ms": 100.1368110300973,
"p95_ms": 219.5127209997736,
"max_ms": 2936.512135027442
},
"model.mtp_graph_ms": {
"count": 2266,
"sum_ms": 1461.396706989035,
"mean_ms": 0.644923524708312,
"p50_ms": 0.4726369515992701,
"p95_ms": 0.9436720283702016,
"max_ms": 5.637370049953461
},
"sched.update_from_output_ms": {
"count": 2311,
"sum_ms": 309.0322069474496,
"mean_ms": 0.1337222877314797,
"p50_ms": 0.12907502241432667,
"p95_ms": 0.17726700752973557,
"max_ms": 0.3616770263761282
},
"hop.enqueue_to_put_ms": {
"count": 165,
"sum_ms": 138.64356075646356,
"mean_ms": 0.8402640045846276,
"p50_ms": 0.7961459923535585,
"p95_ms": 1.216763979755342,
"max_ms": 2.3823289666324854
},
"hop.put_ms": {
"count": 165,
"sum_ms": 112.92395403143018,
"mean_ms": 0.684387600190486,
"p50_ms": 0.4018829786218703,
"p95_ms": 1.2243650271557271,
"max_ms": 9.436159976758063
}
}
}
},
{
"path": "tts-cuda-wsl-attribution-step-stats/stage1_1628537.json",
"sha256": "0109a0871a4db87778f62ffad628e93c29ace126f28bb69784ec95978e8802c4",
"record": {
"role": "stage1",
"pid": 1628537,
"started_at": 1790075749.1656597,
"dumped_at": 1790076028.3616571,
"counters": {
"sched.schedule_ms": {
"count": 167100,
"sum_ms": 7824.627129069995,
"mean_ms": 0.046826015135068795,
"p50_ms": 0.03524700878188014,
"p95_ms": 0.12697099009528756,
"max_ms": 1.571886008605361
},
"hop.poll_miss_ms": {
"count": 175136,
"sum_ms": 3761.5090771578252,
"mean_ms": 0.021477646384283216,
"p50_ms": 0.009789015166461468,
"p95_ms": 0.04539696965366602,
"max_ms": 10.570660990197212
},
"core.step_ms": {
"count": 167124,
"sum_ms": 82695.41027443483,
"mean_ms": 0.4948146901368734,
"p50_ms": 0.13065902749076486,
"p95_ms": 0.5800509825348854,
"max_ms": 802.1825209725648
},
"sched.update_from_output_ms": {
"count": 167100,
"sum_ms": 1061.3675203057937,
"mean_ms": 0.0063516907259473,
"p50_ms": 0.005030015017837286,
"p95_ms": 0.017723010387271643,
"max_ms": 0.1861940254457295
},
"hop.get_ms": {
"count": 165,
"sum_ms": 406.41176007920876,
"mean_ms": 2.4631015762376287,
"p50_ms": 0.37855899427086115,
"p95_ms": 17.446473997551948,
"max_ms": 29.045357019640505
},
"hop.put_to_get_ms": {
"count": 161,
"sum_ms": 659.8684787750244,
"mean_ms": 4.098561979969095,
"p50_ms": 3.2584667205810547,
"p95_ms": 8.987665176391602,
"max_ms": 55.704355239868164
}
}
}
}
],
"counter_scope": "Existing StepStats with accelerator sync disabled; host timers, including warmup/slow-consumer/cancel/recovery. Nested counters overlap and must not be summed.",
"percentiles": "Per-process native summaries use rounded sample indices and a capped 20000-value reservoir; not pooled percentiles. Periodic flush every 500 adds can omit final unflushed samples after forced shutdown.",
"comparison_caveat": "Separate processes, cache/thermal history, observed GPU power-limit/clock changes and stochastic speech length; ratios do not isolate causal instrumentation overhead.",
"measurements": {
"baseline": {
"n": 20,
"metrics": {
"ttfa_ms": {
"n": 20,
"p50": 73.95587698556483,
"p95": 111.6037190076895,
"mean": 82.00832199654542,
"min": 61.904292029794306,
"max": 120.206103019882
},
"rtf_total": {
"n": 20,
"p50": 0.17484790242607118,
"p95": 0.18156117586462786,
"mean": 0.17587882179426131,
"min": 0.16880525449539022,
"max": 0.18910141749840573
},
"total_wall_s": {
"n": 20,
"p50": 1.413438674993813,
"p95": 1.5395039209979586,
"mean": 1.4156809555424843,
"min": 1.2201264539617114,
"max": 1.6022564800223336
},
"streamed_audio_s": {
"n": 20,
"p50": 8.08,
"p95": 8.96,
"mean": 8.052,
"min": 6.96,
"max": 9.12
},
"stall_at_ttfa_ms": {
"n": 20,
"p50": 0.0,
"p95": 0.0,
"mean": 0.0,
"min": 0.0,
"max": 0.0
}
}
},
"instrumented": {
"n": 20,
"metrics": {
"ttfa_ms": {
"n": 20,
"p50": 342.58199797477573,
"p95": 421.667154005263,
"mean": 352.4672636005562,
"min": 299.4830930256285,
"max": 442.02674098778516
},
"rtf_total": {
"n": 20,
"p50": 1.4878854080854902,
"p95": 1.50512873101348,
"mean": 1.487856525494632,
"min": 1.4634246867271286,
"max": 1.5164822405090994
},
"total_wall_s": {
"n": 20,
"p50": 11.830615125014447,
"p95": 12.930477646994404,
"mean": 11.945222201602883,
"min": 10.965414740028791,
"max": 13.10240655799862
},
"streamed_audio_s": {
"n": 20,
"p50": 7.92,
"p95": 8.64,
"mean": 8.028,
"min": 7.44,
"max": 8.64
},
"stall_at_ttfa_ms": {
"n": 20,
"p50": 5044.175343960524,
"p95": 5706.730038009118,
"mean": 5151.192271945183,
"min": 4553.2861830084585,
"max": 5718.030323006678
}
}
}
},
"p50_ratios": {
"ttfa_ms": 4.632248469471102,
"rtf_total": 8.509598270500241,
"total_wall_s": 8.370094390594081
},
"error": null
},
{
"run": "tts-cuda-windows-attribution",
"status": "completed",
"counter_files": [
{
"path": "tts-cuda-windows-attribution-step-stats\\stage0_62016.json",
"sha256": "7ff79e2d17f2d1016a7239ccf70c0a6e2df601443fd63284b17d2437cb701a39",
"record": {
"role": "stage0",
"pid": 62016,
"started_at": 1790073165.4458413,
"dumped_at": 1790073440.672833,
"counters": {
"predictor.substep_ms": {
"count": 120,
"sum_ms": 2170.633799629286,
"mean_ms": 18.088614996910717,
"p50_ms": 1.3053000438958406,
"p95_ms": 4.019099986180663,
"max_ms": 1958.1519999774173
},
"predictor.loop_ms": {
"count": 8,
"sum_ms": 2171.2651001289487,
"mean_ms": 271.4081375161186,
"p50_ms": 26.180900051258504,
"p95_ms": 2008.0400999868289,
"max_ms": 2008.0400999868289
},
"sched.schedule_ms": {
"count": 2321,
"sum_ms": 322.5164996692911,
"mean_ms": 0.13895583785837617,
"p50_ms": 0.12260000221431255,
"p95_ms": 0.219399924390018,
"max_ms": 0.4651999333873391
},
"model.forward_ms": {
"count": 2299,
"sum_ms": 943.1032991269603,
"mean_ms": 0.41022327060763825,
"p50_ms": 0.2707999665290117,
"p95_ms": 0.5948999896645546,
"max_ms": 50.39360001683235
},
"model.sample_meta_ms": {
"count": 2299,
"sum_ms": 1.3182996772229671,
"mean_ms": 0.0005734230870913298,
"p50_ms": 0.000500003807246685,
"p95_ms": 0.000900006853044033,
"max_ms": 0.0513000413775444
},
"model.sample_async_ids_ms": {
"count": 2299,
"sum_ms": 48.52789896540344,
"mean_ms": 0.021108264012789663,
"p50_ms": 0.01859990879893303,
"p95_ms": 0.0342000275850296,
"max_ms": 0.6634999299421906
},
"sampler.apply_penalties_ms": {
"count": 2299,
"sum_ms": 1294.0585998585448,
"mean_ms": 0.5628789038097194,
"p50_ms": 0.44620002154260874,
"p95_ms": 0.8712999988347292,
"max_ms": 107.70519997458905
},
"sampler.apply_logits_processors_ms": {
"count": 2299,
"sum_ms": 1367.7481028717011,
"mean_ms": 0.594931754185168,
"p50_ms": 0.4560999805107713,
"p95_ms": 0.9077000431716442,
"max_ms": 107.76120005175471
},
"sampler.apply_temperature_ms": {
"count": 2299,
"sum_ms": 56.23930005822331,
"mean_ms": 0.024462505462472077,
"p50_ms": 0.021400046534836292,
"p95_ms": 0.03530003596097231,
"max_ms": 0.40909997187554836
},
"sampler.topk_topp_ms": {
"count": 2299,
"sum_ms": 758.5363987600431,
"mean_ms": 0.32994188723794826,
"p50_ms": 0.28739997651427984,
"p95_ms": 0.606300076469779,
"max_ms": 1.3716999674215913
},
"sampler.sample_ms": {
"count": 2299,
"sum_ms": 959.8485981114209,
"mean_ms": 0.41750700222332354,
"p50_ms": 0.3290000604465604,
"p95_ms": 0.6967999506741762,
"max_ms": 13.907099957577884
},
"model.sampler_call_ms": {
"count": 2299,
"sum_ms": 2569.4051028694957,
"mean_ms": 1.1176185745408855,
"p50_ms": 0.8521000854671001,
"p95_ms": 1.658800058066845,
"max_ms": 108.27870003413409
},
"model.sample_ms": {
"count": 2298,
"sum_ms": 2823.2405986636877,
"mean_ms": 1.228564229183502,
"p50_ms": 0.8909999160096049,
"p95_ms": 1.7435000045225024,
"max_ms": 108.32220001611859
},
"model.talker_mtp_ms": {
"count": 2298,
"sum_ms": 20.363500458188355,
"mean_ms": 0.008861401417836534,
"p50_ms": 0.0073999399319291115,
"p95_ms": 0.017600017599761486,
"max_ms": 0.112100038677454
},
"core.step_ms": {
"count": 2342,
"sum_ms": 258657.2268991731,
"mean_ms": 110.44288082799876,
"p50_ms": 99.19139998964965,
"p95_ms": 189.25329996272922,
"max_ms": 433.346499921754
},
"model.mtp_graph_ms": {
"count": 2275,
"sum_ms": 1167.3956015147269,
"mean_ms": 0.5131409237427371,
"p50_ms": 0.4879999905824661,
"p95_ms": 0.7125000702217221,
"max_ms": 1.5753000043332577
},
"sched.update_from_output_ms": {
"count": 2319,
"sum_ms": 339.383996441029,
"mean_ms": 0.14634928695171584,
"p50_ms": 0.13069994747638702,
"p95_ms": 0.2188000362366438,
"max_ms": 0.3192999865859747
},
"hop.enqueue_to_put_ms": {
"count": 164,
"sum_ms": 125.88319950737059,
"mean_ms": 0.7675804848010402,
"p50_ms": 0.7604999700561166,
"p95_ms": 1.0597000364214182,
"max_ms": 1.5655000461265445
},
"hop.put_ms": {
"count": 164,
"sum_ms": 232.17200033832341,
"mean_ms": 1.415682928892216,
"p50_ms": 1.3822999317198992,
"p95_ms": 1.8699000356718898,
"max_ms": 11.974900029599667
}
}
}
},
{
"path": "tts-cuda-windows-attribution-step-stats\\stage1_13708.json",
"sha256": "b098ac3e0e0caca3bb5ab7f3ed0d31c5228c02af82c836af9fcdd99bc5c153f5",
"record": {
"role": "stage1",
"pid": 13708,
"started_at": 1790073177.6347456,
"dumped_at": 1790073441.6315687,
"counters": {
"sched.schedule_ms": {
"count": 126342,
"sum_ms": 11502.04039295204,
"mean_ms": 0.09103892919972804,
"p50_ms": 0.08160003926604986,
"p95_ms": 0.16679998952895403,
"max_ms": 1.9160000374540687
},
"core.step_ms": {
"count": 126365,
"sum_ms": 84130.90257858858,
"mean_ms": 0.6657769364823216,
"p50_ms": 0.2631000243127346,
"p95_ms": 0.5684000207111239,
"max_ms": 492.3127999063581
},
"hop.poll_miss_ms": {
"count": 14122,
"sum_ms": 643.9709080150351,
"mean_ms": 0.04560054581610502,
"p50_ms": 0.03729993477463722,
"p95_ms": 0.06999995093792677,
"max_ms": 10.960499988868833
},
"sched.update_from_output_ms": {
"count": 126341,
"sum_ms": 1451.4887656550854,
"mean_ms": 0.011488659783087718,
"p50_ms": 0.009999959729611874,
"p95_ms": 0.021499930880963802,
"max_ms": 0.5358000053092837
},
"hop.get_ms": {
"count": 165,
"sum_ms": 344.0312007442117,
"mean_ms": 2.0850375802679495,
"p50_ms": 1.9307000329717994,
"p95_ms": 3.1490999972447753,
"max_ms": 9.901299956254661
},
"hop.put_to_get_ms": {
"count": 165,
"sum_ms": 1471.541166305542,
"mean_ms": 8.91843131094268,
"p50_ms": 9.002923965454102,
"p95_ms": 15.682697296142578,
"max_ms": 20.177602767944336
}
}
}
}
],
"counter_scope": "Existing StepStats with accelerator sync disabled; host timers, including warmup/slow-consumer/cancel/recovery. Nested counters overlap and must not be summed.",
"percentiles": "Per-process native summaries use rounded sample indices and a capped 20000-value reservoir; not pooled percentiles. Periodic flush every 500 adds can omit final unflushed samples after forced shutdown.",
"comparison_caveat": "Separate processes, cache/thermal history and stochastic speech length; ratios are diagnostic observations, not isolated causal instrumentation overhead.",
"measurements": {
"baseline": {
"n": 20,
"metrics": {
"ttfa_ms": {
"n": 20,
"p50": 111.52050003875047,
"p95": 302.5222000433132,
"mean": 162.16730999294668,
"min": 91.81439992971718,
"max": 315.50799997057766
},
"rtf_total": {
"n": 20,
"p50": 0.1781915416682346,
"p95": 0.21040542452060176,
"mean": 0.1856964622860607,
"min": 0.1705916874925606,
"max": 0.21601451823395718
},
"total_wall_s": {
"n": 20,
"p50": 1.4388093000743538,
"p95": 1.658991500036791,
"mean": 1.464310554997064,
"min": 1.2228269999613985,
"max": 1.7842379999347031
},
"streamed_audio_s": {
"n": 20,
"p50": 7.84,
"p95": 8.48,
"mean": 7.884,
"min": 6.88,
"max": 9.2
},
"stall_at_ttfa_ms": {
"n": 20,
"p50": 0.0,
"p95": 40.77260001562536,
"mean": 4.166585000697523,
"min": 0.0,
"max": 42.55909999832511
}
}
},
"instrumented": {
"n": 20,
"metrics": {
"ttfa_ms": {
"n": 20,
"p50": 354.54690002370626,
"p95": 397.6043000584468,
"mean": 359.2399050015956,
"min": 321.42510008998215,
"max": 399.18359997682273
},
"rtf_total": {
"n": 20,
"p50": 1.4450212374940747,
"p95": 1.47655767440758,
"mean": 1.4417227106009558,
"min": 1.3939023665090327,
"max": 1.4862167954561298
},
"total_wall_s": {
"n": 20,
"p50": 11.558093100087717,
"p95": 13.13359290000517,
"mean": 11.718756790016778,
"min": 10.15871679992415,
"max": 13.212468800018542
},
"streamed_audio_s": {
"n": 20,
"p50": 8.0,
"p95": 8.96,
"mean": 8.128,
"min": 6.88,
"max": 8.96
},
"stall_at_ttfa_ms": {
"n": 20,
"p50": 4788.281400012784,
"p95": 5484.972200030461,
"mean": 4870.361790002789,
"min": 4307.558099995367,
"max": 5541.990600083955
}
}
}
},
"p50_ratios": {
"ttfa_ms": 3.1792083061007657,
"rtf_total": 8.109370534458272,
"total_wall_s": 8.033095907491303
}
}
]
}
@@ -0,0 +1,664 @@
{
"runs": [
{
"run": "tts-cuda-wsl-attribution",
"status": "running",
"counter_files": [
{
"path": "tts-cuda-wsl-attribution-step-stats\\stage0_1528777.json",
"sha256": "b8e4436b2dbc4a206efe354418643d5a6c8fc6bd2b5e517e0ab1f4aed5350b28",
"record": {
"role": "stage0",
"pid": 1528777,
"started_at": 1790072253.224225,
"dumped_at": 1790073094.2435145,
"counters": {
"predictor.substep_ms": {
"count": 120,
"sum_ms": 7114.086820045486,
"mean_ms": 59.284056833712384,
"p50_ms": 0.8641909807920456,
"p95_ms": 2.0049280137754977,
"max_ms": 6996.862919011619
},
"predictor.loop_ms": {
"count": 8,
"sum_ms": 7114.636765967589,
"mean_ms": 889.3295957459486,
"p50_ms": 15.883203013800085,
"p95_ms": 7017.380247008987,
"max_ms": 7017.380247008987
},
"sched.schedule_ms": {
"count": 325,
"sum_ms": 36.59702732693404,
"mean_ms": 0.11260623792902781,
"p50_ms": 0.10600103996694088,
"p95_ms": 0.15756901120766997,
"max_ms": 0.29125396395102143
},
"model.forward_ms": {
"count": 321,
"sum_ms": 208.49910972174257,
"mean_ms": 0.6495299368278584,
"p50_ms": 0.3144769580103457,
"p95_ms": 0.5147670162841678,
"max_ms": 70.683536992874
},
"model.sample_meta_ms": {
"count": 321,
"sum_ms": 0.11438841465860605,
"mean_ms": 0.0003563502014286793,
"p50_ms": 0.00033102696761488914,
"p95_ms": 0.0005310284905135632,
"max_ms": 0.0007519847713410854
},
"model.sample_async_ids_ms": {
"count": 321,
"sum_ms": 5.493110045790672,
"mean_ms": 0.017112492354488074,
"p50_ms": 0.016572012100368738,
"p95_ms": 0.022804015316069126,
"max_ms": 0.04093802999705076
},
"sampler.apply_penalties_ms": {
"count": 321,
"sum_ms": 265.68352698814124,
"mean_ms": 0.8276745389038668,
"p50_ms": 0.4828769597224891,
"p95_ms": 0.6523249903693795,
"max_ms": 93.48516998579726
},
"sampler.apply_logits_processors_ms": {
"count": 321,
"sum_ms": 270.7442201208323,
"mean_ms": 0.8434399380711287,
"p50_ms": 0.49439899157732725,
"p95_ms": 0.6830859929323196,
"max_ms": 93.54934201110154
},
"sampler.apply_temperature_ms": {
"count": 321,
"sum_ms": 8.218234404921532,
"mean_ms": 0.025601976339319415,
"p50_ms": 0.021701038349419832,
"p95_ms": 0.04351197276264429,
"max_ms": 0.19274099031463265
},
"sampler.topk_topp_ms": {
"count": 321,
"sum_ms": 100.41112406179309,
"mean_ms": 0.31280724006789123,
"p50_ms": 0.2993680536746979,
"p95_ms": 0.41781296022236347,
"max_ms": 0.5838240031152964
},
"sampler.sample_ms": {
"count": 321,
"sum_ms": 116.5034897858277,
"mean_ms": 0.36293922051659716,
"p50_ms": 0.3420389839448035,
"p95_ms": 0.5044480203650892,
"max_ms": 1.2833770015276968
},
"model.sampler_call_ms": {
"count": 321,
"sum_ms": 408.9381185476668,
"mean_ms": 1.2739505250706131,
"p50_ms": 0.9149680263362825,
"p95_ms": 1.2167709646746516,
"max_ms": 94.01413495652378
},
"model.sample_ms": {
"count": 321,
"sum_ms": 420.57027702685446,
"mean_ms": 1.3101877788998582,
"p50_ms": 0.9457849664613605,
"p95_ms": 1.253729045856744,
"max_ms": 94.06638395739719
},
"model.talker_mtp_ms": {
"count": 321,
"sum_ms": 1.7886252026073635,
"mean_ms": 0.005572041129617955,
"p50_ms": 0.005401030648499727,
"p95_ms": 0.006522051990032196,
"max_ms": 0.029686023481190205
},
"core.step_ms": {
"count": 326,
"sum_ms": 42604.8466093489,
"mean_ms": 130.6897135256101,
"p50_ms": 100.63512297347188,
"p95_ms": 341.00765601033345,
"max_ms": 3380.779776023701
},
"model.mtp_graph_ms": {
"count": 317,
"sum_ms": 207.45058997999877,
"mean_ms": 0.6544182649211318,
"p50_ms": 0.47454098239541054,
"p95_ms": 0.9955900022760034,
"max_ms": 4.248459008522332
},
"sched.update_from_output_ms": {
"count": 323,
"sum_ms": 43.56722842203453,
"mean_ms": 0.13488306013013787,
"p50_ms": 0.12877502012997866,
"p95_ms": 0.18921896116808057,
"max_ms": 0.31910103280097246
},
"hop.enqueue_to_put_ms": {
"count": 25,
"sum_ms": 19.593482953496277,
"mean_ms": 0.7837393181398511,
"p50_ms": 0.7369740051217377,
"p95_ms": 1.0607269941829145,
"max_ms": 1.0777040151879191
},
"hop.put_ms": {
"count": 25,
"sum_ms": 20.97717596916482,
"mean_ms": 0.8390870387665927,
"p50_ms": 0.48981100553646684,
"p95_ms": 1.1628659558482468,
"max_ms": 8.896563027519733
}
}
}
},
{
"path": "tts-cuda-wsl-attribution-step-stats\\stage1_1528780.json",
"sha256": "aacf10f1f5bf415eeca847f719e1340c29f8b3ff5f6936988e5c02fb9060fe4f",
"record": {
"role": "stage1",
"pid": 1528780,
"started_at": 1790073049.874202,
"dumped_at": 1790073096.2481904,
"counters": {
"sched.schedule_ms": {
"count": 26521,
"sum_ms": 1266.4158698171377,
"mean_ms": 0.04775143734463775,
"p50_ms": 0.03533699782565236,
"p95_ms": 0.12779299868270755,
"max_ms": 1.216873002704233
},
"core.step_ms": {
"count": 26524,
"sum_ms": 14961.606584722176,
"mean_ms": 0.5640780645725447,
"p50_ms": 0.13060797937214375,
"p95_ms": 0.5886380095034838,
"max_ms": 1493.6476459843107
},
"hop.poll_miss_ms": {
"count": 27883,
"sum_ms": 608.0980958649889,
"mean_ms": 0.021808919264963915,
"p50_ms": 0.010068994015455246,
"p95_ms": 0.04740001168102026,
"max_ms": 6.650844996329397
},
"sched.update_from_output_ms": {
"count": 26520,
"sum_ms": 186.78106227889657,
"mean_ms": 0.007043026481104697,
"p50_ms": 0.0055310083553195,
"p95_ms": 0.019346014596521854,
"max_ms": 0.16031000996008515
},
"hop.get_ms": {
"count": 26,
"sum_ms": 29.361987952142954,
"mean_ms": 1.129307228928575,
"p50_ms": 0.34868199145421386,
"p95_ms": 9.432343009393662,
"max_ms": 9.98165097553283
},
"hop.put_to_get_ms": {
"count": 26,
"sum_ms": 152.9715061187744,
"mean_ms": 5.8835194661067085,
"p50_ms": 5.380868911743164,
"p95_ms": 8.458614349365234,
"max_ms": 11.728525161743164
}
}
}
}
],
"counter_scope": "Existing StepStats with accelerator sync disabled; host timers, including warmup/slow-consumer/cancel/recovery. Nested counters overlap and must not be summed.",
"percentiles": "Per-process native summaries use rounded sample indices and a capped 20000-value reservoir; not pooled percentiles. Periodic flush every 500 adds can omit final unflushed samples after forced shutdown.",
"comparison_caveat": "Separate processes, cache/thermal history and stochastic speech length; ratios are diagnostic observations, not isolated causal instrumentation overhead.",
"measurements": {
"baseline": {
"n": 20,
"metrics": {
"ttfa_ms": {
"n": 20,
"p50": 73.95587698556483,
"p95": 111.6037190076895,
"mean": 82.00832199654542,
"min": 61.904292029794306,
"max": 120.206103019882
},
"rtf_total": {
"n": 20,
"p50": 0.17484790242607118,
"p95": 0.18156117586462786,
"mean": 0.17587882179426131,
"min": 0.16880525449539022,
"max": 0.18910141749840573
},
"total_wall_s": {
"n": 20,
"p50": 1.413438674993813,
"p95": 1.5395039209979586,
"mean": 1.4156809555424843,
"min": 1.2201264539617114,
"max": 1.6022564800223336
},
"streamed_audio_s": {
"n": 20,
"p50": 8.08,
"p95": 8.96,
"mean": 8.052,
"min": 6.96,
"max": 9.12
},
"stall_at_ttfa_ms": {
"n": 20,
"p50": 0.0,
"p95": 0.0,
"mean": 0.0,
"min": 0.0,
"max": 0.0
}
}
},
"instrumented": {
"n": 2,
"metrics": {
"ttfa_ms": {
"n": 2,
"p50": 337.1591470204294,
"p95": 340.1309869950637,
"mean": 338.64506700774655,
"min": 337.1591470204294,
"max": 340.1309869950637
},
"rtf_total": {
"n": 2,
"p50": 1.4524988110957677,
"p95": 1.4886727707446281,
"mean": 1.470585790920198,
"min": 1.4524988110957677,
"max": 1.4886727707446281
},
"total_wall_s": {
"n": 2,
"p50": 11.194819235999603,
"p95": 11.387590678990819,
"mean": 11.29120495749521,
"min": 11.194819235999603,
"max": 11.387590678990819
},
"streamed_audio_s": {
"n": 2,
"p50": 7.52,
"p95": 7.84,
"mean": 7.68,
"min": 7.52,
"max": 7.84
},
"stall_at_ttfa_ms": {
"n": 2,
"p50": 4646.4708539657295,
"p95": 4754.879253008403,
"mean": 4700.675053487066,
"min": 4646.4708539657295,
"max": 4754.879253008403
}
}
}
},
"p50_ratios": {
"ttfa_ms": 4.558922978984324,
"rtf_total": 8.307213246152097,
"total_wall_s": 7.92027233586813
}
},
{
"run": "tts-cuda-windows-attribution",
"status": "completed",
"counter_files": [
{
"path": "tts-cuda-windows-attribution-step-stats\\stage0_62016.json",
"sha256": "7ff79e2d17f2d1016a7239ccf70c0a6e2df601443fd63284b17d2437cb701a39",
"record": {
"role": "stage0",
"pid": 62016,
"started_at": 1790073165.4458413,
"dumped_at": 1790073440.672833,
"counters": {
"predictor.substep_ms": {
"count": 120,
"sum_ms": 2170.633799629286,
"mean_ms": 18.088614996910717,
"p50_ms": 1.3053000438958406,
"p95_ms": 4.019099986180663,
"max_ms": 1958.1519999774173
},
"predictor.loop_ms": {
"count": 8,
"sum_ms": 2171.2651001289487,
"mean_ms": 271.4081375161186,
"p50_ms": 26.180900051258504,
"p95_ms": 2008.0400999868289,
"max_ms": 2008.0400999868289
},
"sched.schedule_ms": {
"count": 2321,
"sum_ms": 322.5164996692911,
"mean_ms": 0.13895583785837617,
"p50_ms": 0.12260000221431255,
"p95_ms": 0.219399924390018,
"max_ms": 0.4651999333873391
},
"model.forward_ms": {
"count": 2299,
"sum_ms": 943.1032991269603,
"mean_ms": 0.41022327060763825,
"p50_ms": 0.2707999665290117,
"p95_ms": 0.5948999896645546,
"max_ms": 50.39360001683235
},
"model.sample_meta_ms": {
"count": 2299,
"sum_ms": 1.3182996772229671,
"mean_ms": 0.0005734230870913298,
"p50_ms": 0.000500003807246685,
"p95_ms": 0.000900006853044033,
"max_ms": 0.0513000413775444
},
"model.sample_async_ids_ms": {
"count": 2299,
"sum_ms": 48.52789896540344,
"mean_ms": 0.021108264012789663,
"p50_ms": 0.01859990879893303,
"p95_ms": 0.0342000275850296,
"max_ms": 0.6634999299421906
},
"sampler.apply_penalties_ms": {
"count": 2299,
"sum_ms": 1294.0585998585448,
"mean_ms": 0.5628789038097194,
"p50_ms": 0.44620002154260874,
"p95_ms": 0.8712999988347292,
"max_ms": 107.70519997458905
},
"sampler.apply_logits_processors_ms": {
"count": 2299,
"sum_ms": 1367.7481028717011,
"mean_ms": 0.594931754185168,
"p50_ms": 0.4560999805107713,
"p95_ms": 0.9077000431716442,
"max_ms": 107.76120005175471
},
"sampler.apply_temperature_ms": {
"count": 2299,
"sum_ms": 56.23930005822331,
"mean_ms": 0.024462505462472077,
"p50_ms": 0.021400046534836292,
"p95_ms": 0.03530003596097231,
"max_ms": 0.40909997187554836
},
"sampler.topk_topp_ms": {
"count": 2299,
"sum_ms": 758.5363987600431,
"mean_ms": 0.32994188723794826,
"p50_ms": 0.28739997651427984,
"p95_ms": 0.606300076469779,
"max_ms": 1.3716999674215913
},
"sampler.sample_ms": {
"count": 2299,
"sum_ms": 959.8485981114209,
"mean_ms": 0.41750700222332354,
"p50_ms": 0.3290000604465604,
"p95_ms": 0.6967999506741762,
"max_ms": 13.907099957577884
},
"model.sampler_call_ms": {
"count": 2299,
"sum_ms": 2569.4051028694957,
"mean_ms": 1.1176185745408855,
"p50_ms": 0.8521000854671001,
"p95_ms": 1.658800058066845,
"max_ms": 108.27870003413409
},
"model.sample_ms": {
"count": 2298,
"sum_ms": 2823.2405986636877,
"mean_ms": 1.228564229183502,
"p50_ms": 0.8909999160096049,
"p95_ms": 1.7435000045225024,
"max_ms": 108.32220001611859
},
"model.talker_mtp_ms": {
"count": 2298,
"sum_ms": 20.363500458188355,
"mean_ms": 0.008861401417836534,
"p50_ms": 0.0073999399319291115,
"p95_ms": 0.017600017599761486,
"max_ms": 0.112100038677454
},
"core.step_ms": {
"count": 2342,
"sum_ms": 258657.2268991731,
"mean_ms": 110.44288082799876,
"p50_ms": 99.19139998964965,
"p95_ms": 189.25329996272922,
"max_ms": 433.346499921754
},
"model.mtp_graph_ms": {
"count": 2275,
"sum_ms": 1167.3956015147269,
"mean_ms": 0.5131409237427371,
"p50_ms": 0.4879999905824661,
"p95_ms": 0.7125000702217221,
"max_ms": 1.5753000043332577
},
"sched.update_from_output_ms": {
"count": 2319,
"sum_ms": 339.383996441029,
"mean_ms": 0.14634928695171584,
"p50_ms": 0.13069994747638702,
"p95_ms": 0.2188000362366438,
"max_ms": 0.3192999865859747
},
"hop.enqueue_to_put_ms": {
"count": 164,
"sum_ms": 125.88319950737059,
"mean_ms": 0.7675804848010402,
"p50_ms": 0.7604999700561166,
"p95_ms": 1.0597000364214182,
"max_ms": 1.5655000461265445
},
"hop.put_ms": {
"count": 164,
"sum_ms": 232.17200033832341,
"mean_ms": 1.415682928892216,
"p50_ms": 1.3822999317198992,
"p95_ms": 1.8699000356718898,
"max_ms": 11.974900029599667
}
}
}
},
{
"path": "tts-cuda-windows-attribution-step-stats\\stage1_13708.json",
"sha256": "b098ac3e0e0caca3bb5ab7f3ed0d31c5228c02af82c836af9fcdd99bc5c153f5",
"record": {
"role": "stage1",
"pid": 13708,
"started_at": 1790073177.6347456,
"dumped_at": 1790073441.6315687,
"counters": {
"sched.schedule_ms": {
"count": 126342,
"sum_ms": 11502.04039295204,
"mean_ms": 0.09103892919972804,
"p50_ms": 0.08160003926604986,
"p95_ms": 0.16679998952895403,
"max_ms": 1.9160000374540687
},
"core.step_ms": {
"count": 126365,
"sum_ms": 84130.90257858858,
"mean_ms": 0.6657769364823216,
"p50_ms": 0.2631000243127346,
"p95_ms": 0.5684000207111239,
"max_ms": 492.3127999063581
},
"hop.poll_miss_ms": {
"count": 14122,
"sum_ms": 643.9709080150351,
"mean_ms": 0.04560054581610502,
"p50_ms": 0.03729993477463722,
"p95_ms": 0.06999995093792677,
"max_ms": 10.960499988868833
},
"sched.update_from_output_ms": {
"count": 126341,
"sum_ms": 1451.4887656550854,
"mean_ms": 0.011488659783087718,
"p50_ms": 0.009999959729611874,
"p95_ms": 0.021499930880963802,
"max_ms": 0.5358000053092837
},
"hop.get_ms": {
"count": 165,
"sum_ms": 344.0312007442117,
"mean_ms": 2.0850375802679495,
"p50_ms": 1.9307000329717994,
"p95_ms": 3.1490999972447753,
"max_ms": 9.901299956254661
},
"hop.put_to_get_ms": {
"count": 165,
"sum_ms": 1471.541166305542,
"mean_ms": 8.91843131094268,
"p50_ms": 9.002923965454102,
"p95_ms": 15.682697296142578,
"max_ms": 20.177602767944336
}
}
}
}
],
"counter_scope": "Existing StepStats with accelerator sync disabled; host timers, including warmup/slow-consumer/cancel/recovery. Nested counters overlap and must not be summed.",
"percentiles": "Per-process native summaries use rounded sample indices and a capped 20000-value reservoir; not pooled percentiles. Periodic flush every 500 adds can omit final unflushed samples after forced shutdown.",
"comparison_caveat": "Separate processes, cache/thermal history and stochastic speech length; ratios are diagnostic observations, not isolated causal instrumentation overhead.",
"measurements": {
"baseline": {
"n": 20,
"metrics": {
"ttfa_ms": {
"n": 20,
"p50": 111.52050003875047,
"p95": 302.5222000433132,
"mean": 162.16730999294668,
"min": 91.81439992971718,
"max": 315.50799997057766
},
"rtf_total": {
"n": 20,
"p50": 0.1781915416682346,
"p95": 0.21040542452060176,
"mean": 0.1856964622860607,
"min": 0.1705916874925606,
"max": 0.21601451823395718
},
"total_wall_s": {
"n": 20,
"p50": 1.4388093000743538,
"p95": 1.658991500036791,
"mean": 1.464310554997064,
"min": 1.2228269999613985,
"max": 1.7842379999347031
},
"streamed_audio_s": {
"n": 20,
"p50": 7.84,
"p95": 8.48,
"mean": 7.884,
"min": 6.88,
"max": 9.2
},
"stall_at_ttfa_ms": {
"n": 20,
"p50": 0.0,
"p95": 40.77260001562536,
"mean": 4.166585000697523,
"min": 0.0,
"max": 42.55909999832511
}
}
},
"instrumented": {
"n": 20,
"metrics": {
"ttfa_ms": {
"n": 20,
"p50": 354.54690002370626,
"p95": 397.6043000584468,
"mean": 359.2399050015956,
"min": 321.42510008998215,
"max": 399.18359997682273
},
"rtf_total": {
"n": 20,
"p50": 1.4450212374940747,
"p95": 1.47655767440758,
"mean": 1.4417227106009558,
"min": 1.3939023665090327,
"max": 1.4862167954561298
},
"total_wall_s": {
"n": 20,
"p50": 11.558093100087717,
"p95": 13.13359290000517,
"mean": 11.718756790016778,
"min": 10.15871679992415,
"max": 13.212468800018542
},
"streamed_audio_s": {
"n": 20,
"p50": 8.0,
"p95": 8.96,
"mean": 8.128,
"min": 6.88,
"max": 8.96
},
"stall_at_ttfa_ms": {
"n": 20,
"p50": 4788.281400012784,
"p95": 5484.972200030461,
"mean": 4870.361790002789,
"min": 4307.558099995367,
"max": 5541.990600083955
}
}
}
},
"p50_ratios": {
"ttfa_ms": 3.1792083061007657,
"rtf_total": 8.109370534458272,
"total_wall_s": 8.033095907491303
}
}
]
}
@@ -0,0 +1,247 @@
/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/transformers/modeling_rope_utils.py:1036: FutureWarning: `rope_config_validation` is deprecated and has been removed. Its functionality has been moved to RotaryEmbeddingConfigMixin.validate_rope method. PreTrainedConfig inherits this class, so please call self.validate_rope() instead. Also, make sure to use the new rope_parameters syntax. You can caINFO 09-22 18:16:48 [configuration_qwen3_tts.py:483] talker_config is None. Initializing talker model with default values
INFO 09-22 18:16:48 [configuration_qwen3_tts.py:486] speaker_encoder_config is None. Initializing talker model with default values
INFO 09-22 18:16:48 [configuration_qwen3_tts.py:437] code_predictor_config is None.[transformers] Model config: codec_eos_token_id must beINFO 09-22 18:16:48 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
INFO 09-22 18:16:49 [omni_base.py:216] [AsyncOmni] Initializing with model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5
INFO 09-22 18:16:49 [async_omni_engine.py:172] [AsyncOmniEngine] Initializing with model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5
ERROR 09-22 18:16:49 [repo_utils.py:119] Error parsing config for /ho[transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
[transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
[transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'mrope_section', 'interleaved'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'mrope_section', 'interleaved'}
[transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
[transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
[transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage1_replica0 pid=1528780) ␍Loading safetensors checkpoint shards: 0% Completed | 0/1 [00:00<?, ?it/s]
(StageEngineCoreProc_stage1_replica0 pid=1528780) ␍Loading safetensors checkpoint shards: 100% Completed | 1/1 [00:00<00:00, 1.12it/s]
(StageEngineCoreProc_stage1_replica0 pid=1528780) ␍Loading safetensors checkpoint shards: 100% Completed | 1/1 [00:00<00:00, 1.12it/s]
(StageEngineCoreProc_stage1_replica0 pid=1528780)
(StageEngineCoreProc_stage1_replica0 pid=1528780) ␍Loading safetensors checkpoint shards: 0% Completed | 0/1 [00:00<?, ?it/s]
(StageEngineCoreProc_stage0_replica0 pid=1528777) ␍Loading safetensors checkpoint shards: 0% Completed | 0/1 [00:00<?, ?it/s]
(StageEngineCoreProc_stage1_replica0 pid=1528780) ␍Loading safetensors checkpoint shards: 100% Completed | 1/1 [00:00<00:00, 1.50it/s]
(StageEngineCoreProc_stage1_replica0 pid=1528780) ␍Loading safetensors checkpoint shards: 100% Completed | 1/1 [00:00<00:00, 1.50it/s]
(StageEngineCoreProc_stage1_replica0 pid=1528780)
(StageEngineCoreProc_stage0_replica0 pid=1528777) ␍Loading safetensors checkpoint shards: 100% Completed | 1/1 [00:00<00:00, 1.03it/s]
(StageEngineCoreProc_stage0_replica0 pid=1528777) ␍Loading safetensors checkpoint shards: 100% Completed | 1/1 [00:00<00:00, 1.03it/s]
(StageEngineCoreProc_stage0_replica0 pid=1528777)
(StageEngineCoreProc_stage0_replica0 pid=1528777) ␍Loading safetensors checkpoint shards: 0% Completed | 0/1 [00:00<?, ?it/s]
(StageEngineCoreProc_stage0_replica0 pid=1528777) ␍Loading safetensors checkpoint shards: 100% Completed | 1/1 [00:00<00:00, 7.20it/s]
(StageEngineCoreProc_stage0_replica0 pid=1528777) ␍Loading safetensors checkpoint shards: 100% Completed | 1/1 [00:00<00:00, 7.19it/s]
(StageEngineCoreProc_stage0_replica0 pid=1528777)
(StageEngineCoreProc_stage0_replica0 pid=1528777) ␍Loading safetensors checkpoint shards: 0% Completed | 0/1 [00:00<?, ?it/s]
(StageEngineCoreProc_stage0_replica0 pid=1528777) ␍Loading safetensors checkpoint shards: 100% Completed | 1/1 [00:00<00:00, 25.31it/s]
(StageEngineCoreProc_stage0_replica0 pid=1528777)
(StageEngineCoreProc_stage0_replica0 pid=1528777) /home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/transformers/modeling_rope_utils.py:1036: FutureWarning: `rope_config_validation` is deprecated and has been removed. Its functionality has been moved to RotaryEmbeddingConfigMixin.validate_rope method. PreTrainedConfig inherits this class, so please call self.validate_rope() instead. Also, make sure to use the new rope_parameters syntax. You can call self.standardize_rope_params() in the meantime.
(StageEngineCoreProc_stage0_replica0 pid=1528777) warnings.warn(
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] Model config: codec_eos_token_id must be `None` or an integer within the vocabulary (between 0 and 3071), got 4198. This may result in unexpected behavior.
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage1_replica0 pid=1528780) ␍JIT kernel warmup (1 compile keys): 0%| | 0/1 [00:00<?, ?kernel/s](StageEngineCoreProc_stage0_replica0 pid=1528777) ␍JIT kernel warmup (1 compile keys): 0%| | 0/1 [00:00<?, ?kernel/s]␍JIT kernel warmup (1 compile keys): 100%|██████████| 1/1 [00:00<00:00, 224.27kernel/s, ComputeSlotMappingKernel (1 keys)]
␍JIT kernel warmup (1 compile keys): 100%|██████████| 1/1 [00:00<00:00, 210.09kernel/s, ComputeSlotMappingKernel (1 keys)]
(StageEngineCoreProc_stage1_replica0 pid=1528780) /home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/transformers/modeling_rope_utils.py:1036: FutureWarning: `rope_config_validation` is deprecated and has been removed. Its functionality has been moved to RotaryEmbeddingConfigMixin.validate_rope method. PreTrainedConfig inherits this class, so please call self.validate_rope() instead. Also, make sure to use the new rope_parameters syntax. You can call self.standardize_rope_params() in the meantime.
(StageEngineCoreProc_stage1_replica0 pid=1528780) warnings.warn(
(StageEngineCoreProc_stage1_replica0 pid=1528780) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage1_replica0 pid=1528780) [transformers] Model config: codec_eos_token_id must be `None` or an integer within the vocabulary (between 0 and 3071), got 4198. This may result in unexpected behavior.
(StageEngineCoreProc_stage1_replica0 pid=1528780) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage1_replica0 pid=1528780) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage1_replica0 pid=1528780) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) /home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/transformers/modeling_rope_utils.py:1036: FutureWarning: `rope_config_validation` is deprecated and has been removed. Its functionality has been moved to RotaryEmbeddingConfigMixin.validate_rope method. PreTrainedConfig inherits this class, so please call self.validate_rope() instead. Also, make sure to use the new rope_parameters syntax. You can call self.standardize_rope_params() in the meantime.
(StageEngineCoreProc_stage0_replica0 pid=1528777) warnings.warn(
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) 2026-09-22 18:17:16,027 - INFO - autotuner.py:2789 - flashinfer.jit: [Autotuner]: Loaded 0 configs from /home/zhout/.cache/vllm/flashinfer_autotune_cache/0.6.18/120f/950d410991c69fa2fad5df4e9799f92ecddcf5c5874e9f613a037097bbc1efcc/autotune_configs.json
(StageEngineCoreProc_stage0_replica0 pid=1528777) 2026-09-22 18:17:16,028 - INFO - autotuner.py:972 - flashinfer.jit: [Autotuner]: Autotuning process starts ...
(StageEngineCoreProc_stage0_replica0 pid=1528777) 2026-09-22 18:17:16,067 - INFO - autotuner.py:995 - flashinfer.jit: [Autotuner]: Autotuning process ends
(StageEngineCoreProc_stage1_replica0 pid=1528780) 2026-09-22 18:17:16,101 - INFO - autotuner.py:2789 - flashinfer.jit: [Autotuner]: Loaded 0 configs from /home/zhout/.cache/vllm/flashinfer_autotune_cache/0.6.18/120f/50f3f22d277815e34018a894a95ec6f31c44909c9954ca6981e93c164b765601/autotune_configs.json
(StageEngineCoreProc_stage1_replica0 pid=1528780) 2026-09-22 18:17:16,101 - INFO - autotuner.py:972 - flashinfer.jit: [Autotuner]: Autotuning process starts ...
(StageEngineCoreProc_stage0_replica0 pid=1528777) 2026-09-22 18:17:16,130 - INFO - autotuner.py:2652 - flashinfer.jit: [Autotuner]: Saved 0 configs to /home/zhout/.cache/vllm/flashinfer_autotune_cache/0.6.18/120f/950d410991c69fa2fad5df4e9799f92ecddcf5c5874e9f613a037097bbc1efcc/autotune_configs.json (0 new, 0 from previous config)
(StageEngineCoreProc_stage0_replica0 pid=1528777) ␍Capturing CUDA graphs (mixed prefill-decode, PIECEWISE): 0%| | 0/4 [00:00<?, ?it/s]␍Capturing CUDA graphs (mixed prefill-decode, PIECEWISE): 25%|██▌ | 1/4 [00:00<00:01, 1.65it/s]␍Capturing CUDA graphs (mixed prefill-decode, PIECEWISE): 50%|█████ | 2/4 [00:01<00:01, 1.49it/s]␍Capturing CUDA graphs (mixed prefill-decode, PIECEWISE): 75%|███████▌ | 3/4 [00:01<00:00, 2.01it/s]␍Capturing CUDA graphs (mixed prefill-decode, PIECEWISE): 100%|██████████| 4/4 [00:03<00:00, 1.11s/it]␍Capturing CUDA graphs (mixed prefill-decode, PIECEWISE): 100%|██████████| 4/4 [00:03<00:00, 1.09it/s]
(StageEngineCoreProc_stage0_replica0 pid=1528777) ␍Capturing CUDA graphs (decode, FULL): 0%| | 0/3 [00:00<?, ?it/s]␍Capturing CUDA graphs (decode, FULL): 33%|███▎ | 1/3 [00:00<00:00, 4.54it/s]␍Capturing CUDA graphs (decode, FULL): 100%|██████████| 3/3 [00:00<00:00, 9.50it/s]
(StageEngineCoreProc_stage0_replica0 pid=1528777) /home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/transformers/modeling_rope_utils.py:1036: FutureWarning: `rope_config_validation` is deprecated and has been removed. Its functionality has been moved to RotaryEmbeddingConfigMixin.validate_rope method. PreTrainedConfig inherits this class, so please call self.validate_rope() instead. Also, make sure to use the new rope_parameters syntax. You can call self.standardize_rope_params() in the meantime.
(StageEngineCoreProc_stage0_replica0 pid=1528777) warnings.warn(
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'interleaved', 'mrope_section'}
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'interleaved', 'mrope_section'}
(StageEngineCoreProc_stage1_replica0 pid=1528780) 2026-09-22 18:17:45,084 - INFO - autotuner.py:995 - flashinfer.jit: [Autotuner]: Autotuning process ends
(StageEngineCoreProc_stage1_replica0 pid=1528780) 2026-09-22 18:17:45,164 - INFO - autotuner.py:2652 - flashinfer.jit: [Autotuner]: Saved 0 configs to /home/zhout/.cache/vllm/flashinfer_autotune_cache/0.6.18/120f/50f3f22d277815e34018a894a95ec6f31c44909c9954ca6981e93c164b765601/autotune_configs.json (0 new, 0 from previous config)
(StageEngineCoreProc_stage1_replica0 pid=1528780) ␍Capturing CUDA graphs (mixed prefill-decode, PIECEWISE): 0%| | 0/4 [00:00<?, ?it/s]␍Capturing CUDA graphs (mixed prefill-decode, PIECEWISE): 100%|██████████| 4/4 [00:00<00:00, 81.10it/s]
(StageEngineCoreProc_stage1_replica0 pid=1528780) ␍Capturing CUDA graphs (decode, FULL): 0%| | 0/3 [00:00<?, ?it/s]␍Capturing CUDA graphs (decode, FULL): 100%|██████████| 3/3 [00:00<00:00, 208.63it/s]
(StageEngineCoreProc_stage1_replica0 pid=1528780) /home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/transformers/modeling_rope_utils.py:1036: FutureWarning: `rope_config_validation` is deprecated and has been removed. Its functionality has been moved to RotaryEmbeddingConfigMixin.validate_rope method. PreTrainedConfig inherits this class, so please call self.validate_rope() instead. Also, make sure to use the new rope_parameters syntax. You can call self.standardize_rope_params() in the meantime.
(StageEngineCoreProc_stage1_replica0 pid=1528780) warnings.warn(
(StageEngineCoreProc_stage1_replica0 pid=1528780) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage1_replica0 pid=1528780) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage1_replica0 pid=1528780) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage1_replica0 pid=1528780) [transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'interleaved', 'mrope_section'}
(StageEngineCoreProc_stage1_replica0 pid=1528780) [transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'interleaved', 'mrope_section'}
[transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
[transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
[transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'mrope_section', 'interleaved'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'mrope_section', 'interleaved'}
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) [transformers] `layer_type_validation` is deprecated and will be removed in v5.20. Use `PreTrainedConfig.validate_layer_type` instead
(StageEngineCoreProc_stage0_replica0 pid=1528777) Exception ignored in audit hook:
(StageEngineCoreProc_stage0_replica0 pid=1528777) Traceback (most recent call last):
(StageEngineCoreProc_stage0_replica0 pid=1528777) File "/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/filelock/_api.py", line 1785, in _audit_fork_safety
(StageEngineCoreProc_stage0_replica0 pid=1528777) def _audit_fork_safety( # pragma: no cover - CPython disables tracing while Python audit hooks run
(StageEngineCoreProc_stage0_replica0 pid=1528777)
(StageEngineCoreProc_stage0_replica0 pid=1528777) File "/home/zhout/project/edge_infer/vllm-omni-edge/vllm_omni/engine/stage_engine_core_proc.py", line 230, in signal_handler
(StageEngineCoreProc_stage0_replica0 pid=1528777) raise SystemExit(_signal_exit_code(signum))
(StageEngineCoreProc_stage0_replica0 pid=1528777) SystemExit: 143
[rank0]:[W922 18:31:36.966060849 ProcessGroupNCCL.cpp:1624] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
te.py:1775] world_size=1 rank=0 local_rank=0 distributed_init_method=file:///tmp/vllm_dist_21f6ed8d01a14418bedf5295d27c4cba backend=nccl
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:04 [parallel_state.py:2119] rank 0 in world size 1 is assigned as DP rank 0, PP rank 0, PCP rank 0, TP rank 0, EP rank N/A, EPLB rank N/A
(StageEngineCoreProc_stage1_replica0 pid=1528780) WARNING 09-22 18:17:05 [gpu_generation_worker.py:103] OMNI GPUGenerationWorker forces v1 model runner for omni hooks.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:05 [topk_topp_sampler.py:46] FlashInfer top-p/top-k sampling disabled via VLLM_USE_FLASHINFER_SAMPLER=0.
(StageEngineCoreProc_stage0_replica0 pid=1528777) WARNING 09-22 18:17:05 [gpu_ar_worker.py:120] OMNI GPUARWorker forces v1 model runner for omni hooks.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:05 [topk_topp_sampler.py:46] FlashInfer top-p/top-k sampling disabled via VLLM_USE_FLASHINFER_SAMPLER=0.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:05 [factory.py:46] Created connector: SharedMemoryConnector
(StageEngineCoreProc_stage0_replica0 pid=1528777) WARNING 09-22 18:17:05 [base.py:173] [LLM Worker 0] Sleep Mode DISABLED.
(StageEngineCoreProc_stage0_replica0 pid=1528777) WARNING 09-22 18:17:05 [base.py:173] [LLM Worker 0] Sleep Mode DISABLED.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:05 [gpu_model_runner.py:5379] Starting to load model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5...
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:05 [factory.py:46] Created connector: SharedMemoryConnector
(StageEngineCoreProc_stage1_replica0 pid=1528780) WARNING 09-22 18:17:05 [base.py:173] [LLM Worker 0] Sleep Mode DISABLED.
(StageEngineCoreProc_stage1_replica0 pid=1528780) WARNING 09-22 18:17:05 [base.py:173] [LLM Worker 0] Sleep Mode DISABLED.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:05 [gpu_model_runner.py:5379] Starting to load model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5...
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:05 [configuration_qwen3_tts_tokenizer_v2.py:156] encoder_config is None. Initializing encoder with default values
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:05 [configuration_qwen3_tts_tokenizer_v2.py:159] decoder_config is None. Initializing decoder with default values
(StageEngineCoreProc_stage1_replica0 pid=1528780) WARNING 09-22 18:17:06 [vllm.py:2952] `torch.compile` is turned on, but the model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5 does not support it. Please open an issue on GitHub if you want it to be supported.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:06 [weight_utils.py:863] Filesystem type for checkpoints: EXT4. Checkpoint size: 1.69 GiB. Available RAM: 25.92 GiB.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:06 [weight_utils.py:886] Auto-prefetch is disabled because the filesystem (EXT4) is not a recognized network FS (NFS/Lustre). If you want to force prefetching, start vLLM with --safetensors-load-strategy=prefetch.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:06 [cuda.py:492] Using FLASH_ATTN attention backend out of potential backends: ['FLASH_ATTN', 'FLASHINFER', 'TRITON_ATTN', 'FLEX_ATTENTION'].
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:06 [flash_attn.py:897] Using FlashAttention version 2
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:07 [weight_utils.py:863] Filesystem type for checkpoints: EXT4. Checkpoint size: 0.64 GiB. Available RAM: 25.89 GiB.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:07 [configuration_qwen3_tts_tokenizer_v2.py:156] encoder_config is None. Initializing encoder with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:07 [configuration_qwen3_tts_tokenizer_v2.py:159] decoder_config is None. Initializing decoder with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:07 [speaker_cache.py:239] Speaker cache ready (max_bytes=536870912)
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:07 [weight_utils.py:863] Filesystem type for checkpoints: EXT4. Checkpoint size: 1.69 GiB. Available RAM: 25.81 GiB.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:07 [weight_utils.py:886] Auto-prefetch is disabled because the filesystem (EXT4) is not a recognized network FS (NFS/Lustre). If you want to force prefetching, start vLLM with --safetensors-load-strategy=prefetch.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:07 [modeling_qwen3_tts_tokenizer_v2.py:865] Precomputed exp caches for 29 SnakeBeta activations
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:08 [weight_utils.py:863] Filesystem type for checkpoints: EXT4. Checkpoint size: 0.64 GiB. Available RAM: 25.49 GiB.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:08 [weight_utils.py:863] Filesystem type for checkpoints: EXT4. Checkpoint size: 0.64 GiB. Available RAM: 25.42 GiB.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:09 [qwen3_tts_talker.py:1192] Loaded 604 weights for Qwen3TTSTalkerForConditionalGeneration
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:09 [default_loader.py:430] Loading weights took 1.57 seconds
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:09 [segmented_graph_wrapper.py:326] Captured ICL prefix CUDA Graph for batch=1
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:09 [segmented_graph_wrapper.py:331] Captured xvec prefix CUDA Graph for batch=1
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:09 [segmented_graph_wrapper.py:335] Starting CUDA Graph warmup for 6 shapes: batch_sizes=[1] seq_lens=[6, 14, 30, 55, 80, 97]
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:09 [segmented_graph_wrapper.py:346] Captured combined suffix CUDA Graph for batch=1 size=6
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:09 [segmented_graph_wrapper.py:346] Captured combined suffix CUDA Graph for batch=1 size=14
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:10 [segmented_graph_wrapper.py:346] Captured combined suffix CUDA Graph for batch=1 size=30
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:10 [gpu_model_runner.py:5471] Model loading took 1.94 GiB memory and 3.415367 seconds
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:10 [segmented_graph_wrapper.py:346] Captured combined suffix CUDA Graph for batch=1 size=55
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:10 [segmented_graph_wrapper.py:346] Captured combined suffix CUDA Graph for batch=1 size=80
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:10 [segmented_graph_wrapper.py:346] Captured combined suffix CUDA Graph for batch=1 size=97
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:10 [utils.py:306] Using LBNHC KV cache layout.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:10 [segmented_graph_wrapper.py:361] Captured xvec suffix CUDA Graph for batch=1 size=6
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:10 [segmented_graph_wrapper.py:361] Captured xvec suffix CUDA Graph for batch=1 size=14
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:10 [segmented_graph_wrapper.py:361] Captured xvec suffix CUDA Graph for batch=1 size=30
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:11 [segmented_graph_wrapper.py:361] Captured xvec suffix CUDA Graph for batch=1 size=55
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:11 [segmented_graph_wrapper.py:361] Captured xvec suffix CUDA Graph for batch=1 size=80
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:11 [segmented_graph_wrapper.py:361] Captured xvec suffix CUDA Graph for batch=1 size=97
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:11 [modeling_qwen3_tts_tokenizer_v2.py:909] CUDA Graph enabled for decoder: batch_sizes=[1] seq_lens=[6, 14, 30, 55, 80, 97]
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:11 [qwen3_tts_code2wav.py:206] Code2Wav decoder CUDA Graph enabled
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:11 [default_loader.py:430] Loading weights took 5.29 seconds
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:12 [gpu_model_runner.py:5471] Model loading took 0.54 GiB memory and 5.493188 seconds
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:13 [configuration_qwen3_tts.py:483] talker_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:13 [configuration_qwen3_tts.py:486] speaker_encoder_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:13 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:13 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:13 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:13 [cuda.py:492] Using FLASH_ATTN attention backend out of potential backends: ['FLASH_ATTN', 'FLASHINFER', 'TRITON_ATTN', 'FLEX_ATTENTION'].
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:13 [utils.py:306] Using LBNHC KV cache layout.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:14 [caching.py:343] reconstructed serializable fn from standalone compile artifacts. num_artifacts=4 num_submods=29
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:14 [decorators.py:313] Directly load AOT compilation from path /home/zhout/.cache/vllm/torch_compile_cache/torch_aot_compile/7db261aff95b5f1c2d680f8b909683b7f9c1cb10a8835d2989f18e3dfbe67f7b/rank_0_0/model
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:14 [monitor.py:53] torch.compile took 0.24 s in total
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:14 [monitor.py:81] Initial profiling/warmup run took 0.01 s
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:15 [base.py:148] Available KV cache memory: 3.95 GiB (device-level profiling)
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:15 [kv_cache_utils.py:2032] GPU KV cache size: 36,928 tokens, Maximum concurrency for 4,096 tokens per request: 9.02x
(StageEngineCoreProc_stage0_replica0 pid=1528777) WARNING 09-22 18:17:15 [base.py:173] [LLM Worker 0] Sleep Mode DISABLED.
(StageEngineCoreProc_stage1_replica0 pid=1528780) WARNING 09-22 18:17:15 [base.py:173] [LLM Worker 0] Sleep Mode DISABLED.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:15 [kernel_warmup.py:124] JIT kernel warmup starting.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:15 [kernel_warmup.py:124] JIT kernel warmup starting.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:15 [kernel_warmup.py:134] JIT kernel warmup finished in 0.01s.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:15 [kernel_warmup.py:134] JIT kernel warmup finished in 0.01s.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:15 [configuration_qwen3_tts.py:483] talker_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:15 [configuration_qwen3_tts.py:486] speaker_encoder_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:15 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:15 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:15 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:15 [configuration_qwen3_tts.py:483] talker_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:15 [configuration_qwen3_tts.py:486] speaker_encoder_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:15 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:15 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:15 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:15 [kernel_warmup.py:309] Using FlashInfer autotune cache file: /home/zhout/.cache/vllm/flashinfer_autotune_cache/0.6.18/120f/950d410991c69fa2fad5df4e9799f92ecddcf5c5874e9f613a037097bbc1efcc/autotune_configs.json
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:16 [kernel_warmup.py:266] Running FlashInfer autotune with 512 tokens.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:16 [kernel_warmup.py:309] Using FlashInfer autotune cache file: /home/zhout/.cache/vllm/flashinfer_autotune_cache/0.6.18/120f/50f3f22d277815e34018a894a95ec6f31c44909c9954ca6981e93c164b765601/autotune_configs.json
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:16 [kernel_warmup.py:266] Running FlashInfer autotune with 65536 tokens.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:16 [gpu_model_runner.py:6955] Rank 0: Torch profiler disabled for CUDA graph capture
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:16 [qwen3_tts_code2wav.py:431] Code2Wav codec: frames=4096 q=16 uniq=1 range=[0,0] batch=1
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:21 [gpu_model_runner.py:7001] Graph capturing finished in 5 secs, took 0.05 GiB
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:21 [gpu_ar_model_runner.py:595] Capturing talker_mtp graphs for sizes [8, 4, 2, 1]
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:33 [qwen3_code_predictor.py:1066] code_predictor: warmup done for buckets [1, 2, 4]
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:33 [qwen3_code_predictor.py:929] code_predictor: torch.compile (dynamic=False, no epilogue fusion)
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:40 [gpu_ar_model_runner.py:632] Captured talker_mtp graphs for 4 sizes
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:40 [gpu_worker.py:860] Free memory on device (22.58/23.89 GiB) on startup. Desired GPU memory utilization is (0.25, 5.97 GiB). Actual usage is 2.11 GiB for consumed memory (weights + non-torch), 0.01 GiB for peak activation, and 0.05 GiB for CUDAGraph memory. Replace gpu_memory_utilization config with `--kv-cache-memory=3921297408` (3.65 GiB) to fit into requested memory, or `--kv-cache-memory=21750611968` (20.26 GiB) to fully utilize gpu memory. Current kv cache memory in use is 3.95 GiB.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:41 [jit_monitor.py:85] Kernel JIT monitor activated; monitored JIT compilations during inference will use mode=warn.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:42 [torch_utils.py:277] Reducing Torch threads from 12 to 1 for serving. Set OMP_NUM_THREADS in the external environment to override.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:42 [core.py:361] init engine (profile, create kv cache, warmup model) took 31.71 s (compilation: 0.24 s)
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:42 [configuration_qwen3_tts.py:486] speaker_encoder_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:42 [configuration_qwen3_tts.py:483] talker_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:42 [configuration_qwen3_tts.py:486] speaker_encoder_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:42 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:42 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) WARNING 09-22 18:17:42 [scheduler.py:213] Using custom scheduler class vllm_omni.core.sched.omni_ar_scheduler.OmniARAsyncScheduler. This scheduler interface is not public and compatibility may not be maintained. If you have subclassed Scheduler instead of AsyncScheduler, you will see degraded performance due to async scheduling being disabled.
(StageEngineCoreProc_stage0_replica0 pid=1528777) WARNING 09-22 18:17:42 [omni_scheduler_mixin.py:118] OMNI scheduler forces v1 model runner for omni hooks.
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:42 [factory.py:46] Created connector: SharedMemoryConnector
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:17:42 [kernel.py:369] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native'])
INFO 09-22 18:17:42 [stage_runtime.py:943] [StageRuntime] Stage 0 engine startup completed
INFO 09-22 18:17:42 [stage_engine_core_client.py:159] [StageEngineCoreClient] stage-0 [rep-0] initializing EngineCore
INFO 09-22 18:17:42 [stage_engine_core_client.py:215] [StageEngineCoreClient] stage-0 [rep-0] EngineCore running
INFO 09-22 18:17:42 [stage_runtime.py:958] [StageRuntime] Stage 0 initialized
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:17:45 [gpu_model_runner.py:6955] Rank 0: Torch profiler disabled for CUDA graph capture
(StageEngineCoreProc_stage1_replica0 pid=1528780) WARNING 09-22 18:30:48 [qwen3_tts_code2wav.py:365] Code2Wav input_ids length 8 not divisible by num_quantizers 16; skipping malformed request and suppressing repeats for this length.
(StageEngineCoreProc_stage1_replica0 pid=1528780) WARNING 09-22 18:30:48 [qwen3_tts_code2wav.py:365] Code2Wav input_ids length 4 not divisible by num_quantizers 16; skipping malformed request and suppressing repeats for this length.
(StageEngineCoreProc_stage1_replica0 pid=1528780) WARNING 09-22 18:30:48 [qwen3_tts_code2wav.py:365] Code2Wav input_ids length 2 not divisible by num_quantizers 16; skipping malformed request and suppressing repeats for this length.
(StageEngineCoreProc_stage1_replica0 pid=1528780) WARNING 09-22 18:30:48 [qwen3_tts_code2wav.py:365] Code2Wav input_ids length 1 not divisible by num_quantizers 16; skipping malformed request and suppressing repeats for this length.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:30:48 [gpu_model_runner.py:7001] Graph capturing finished in 783 secs, took 0.00 GiB
(StageEngineCoreProc_stage1_replica0 pid=1528780) WARNING 09-22 18:30:48 [gpu_generation_model_runner.py:558] Dummy sampler run is not implemented for generation model
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:30:49 [jit_monitor.py:85] Kernel JIT monitor activated; monitored JIT compilations during inference will use mode=warn.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:30:49 [torch_utils.py:277] Reducing Torch threads from 12 to 1 for serving. Set OMP_NUM_THREADS in the external environment to override.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:30:49 [core.py:368] init engine (profile, create kv cache, warmup model) took 816.90 s
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:30:49 [configuration_qwen3_tts.py:486] speaker_encoder_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:30:49 [configuration_qwen3_tts.py:483] talker_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:30:49 [configuration_qwen3_tts.py:486] speaker_encoder_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:30:49 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:30:49 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage1_replica0 pid=1528780) WARNING 09-22 18:30:49 [scheduler.py:213] Using custom scheduler class vllm_omni.core.sched.omni_generation_scheduler.OmniGenerationScheduler. This scheduler interface is not public and compatibility may not be maintained. If you have subclassed Scheduler instead of AsyncScheduler, you will see degraded performance due to async scheduling being disabled.
(StageEngineCoreProc_stage1_replica0 pid=1528780) WARNING 09-22 18:30:49 [core.py:155] Disabling chunked prefill for model without KVCache
(StageEngineCoreProc_stage1_replica0 pid=1528780) WARNING 09-22 18:30:49 [omni_scheduler_mixin.py:118] OMNI scheduler forces v1 model runner for omni hooks.
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:30:49 [factory.py:46] Created connector: SharedMemoryConnector
(StageEngineCoreProc_stage1_replica0 pid=1528780) INFO 09-22 18:30:49 [kernel.py:369] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native'])
INFO 09-22 18:30:49 [stage_runtime.py:943] [StageRuntime] Stage 1 engine startup completed
INFO 09-22 18:30:49 [stage_engine_core_client.py:159] [StageEngineCoreClient] stage-1 [rep-0] initializing EngineCore
INFO 09-22 18:30:50 [stage_engine_core_client.py:215] [StageEngineCoreClient] stage-1 [rep-0] EngineCore running
INFO 09-22 18:30:50 [stage_runtime.py:958] [StageRuntime] Stage 1 initialized
INFO 09-22 18:30:50 [configuration_qwen3_tts.py:486] speaker_encoder_config is None. Initializing talker model with default values
INFO 09-22 18:30:50 [configuration_qwen3_tts.py:483] talker_config is None. Initializing talker model with default values
INFO 09-22 18:30:50 [configuration_qwen3_tts.py:486] speaker_encoder_config is None. Initializing talker model with default values
INFO 09-22 18:30:50 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
INFO 09-22 18:30:50 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
INFO 09-22 18:30:51 [orchestrator.py:604] [Orchestrator] Starting event loop
INFO 09-22 18:30:51 [async_omni_engine.py:323] [AsyncOmniEngine] Orchestrator ready with 2 stages
INFO 09-22 18:30:51 [omni_base.py:235] [AsyncOmni] AsyncOmniEngine initialized in 842.48 seconds
INFO 09-22 18:30:51 [omni_base.py:255] [AsyncOmni] Initialized with 2 stages for model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5
WARNING 09-22 18:30:51 [input_processor.py:315] Passing raw prompts to InputProcessor is deprecated and will be removed in the future. You should instead pass the outputs of Renderer.render_cmpl() or Renderer.render_chat().
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:30:54 [configuration_qwen3_tts.py:486] speaker_encoder_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:30:54 [configuration_qwen3_tts.py:483] talker_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:30:54 [configuration_qwen3_tts.py:486] speaker_encoder_config is None. Initializing talker model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:30:54 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) INFO 09-22 18:30:54 [configuration_qwen3_tts.py:437] code_predictor_config is None. Initializing code_predictor model with default values
(StageEngineCoreProc_stage0_replica0 pid=1528777) WARNING 09-22 18:30:54 [sampling_utils.py:57] min_tokens: dropped stop token ids [151645] that exceed the logits vocabulary (3072); the model head cannot emit them.
@@ -0,0 +1,21 @@
{
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 VLLM_OMNI_STEP_STATS_DIR=/home/zhout/project/edge_infer/analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl-attribution-step-stats VLLM_OMNI_STEP_STATS_SYNC=0 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/lib/wsl/lib timeout 900 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_local_tts.py --model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5 --out ../analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl-attribution --length-band medium --concurrency 1 --repeats 20 --sustained-seconds 0"
],
"cwd": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge",
"host": "Windows-11-10.0.26200-SP0",
"scope": "Windows RAM includes WSL; GPU counters are whole-device, not model-exclusive",
"sample_interval_s": 1,
"start_unix": 1790072196.1287558,
"status": "exited",
"power_scheme": "\u7535\u6e90\u65b9\u6848 GUID: 27fa6203-3987-4dcc-918d-748559d549ec (Performance)",
"pid": 61848,
"returncode": 124,
"end_unix": 1790073097.1795352
}
@@ -0,0 +1,835 @@
{"unix": 1790072196.1597521, "monotonic": 526928.343, "host_memory": {"total": 67773509632, "available": 34683334656, "percent": 48.8, "used": 33090174976, "free": 34683334656}, "host_cpu_percent": 23.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2972, 24463, 54, 13.44, 457, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072197.2114987, "monotonic": 526929.39, "host_memory": {"total": 67773509632, "available": 33784541184, "percent": 50.2, "used": 33988968448, "free": 33784541184}, "host_cpu_percent": 16.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2977, 24463, 54, 13.49, 382, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072198.2646382, "monotonic": 526930.453, "host_memory": {"total": 67773509632, "available": 33520001024, "percent": 50.5, "used": 34253508608, "free": 33520001024}, "host_cpu_percent": 20.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2976, 24463, 54, 13.42, 390, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072199.3167553, "monotonic": 526931.5, "host_memory": {"total": 67773509632, "available": 33230049280, "percent": 51.0, "used": 34543460352, "free": 33230049280}, "host_cpu_percent": 7.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2975, 24463, 54, 13.57, 427, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072200.3825953, "monotonic": 526932.562, "host_memory": {"total": 67773509632, "available": 33133318144, "percent": 51.1, "used": 34640191488, "free": 33133318144}, "host_cpu_percent": 9.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2974, 24463, 54, 13.12, 375, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072201.444768, "monotonic": 526933.625, "host_memory": {"total": 67773509632, "available": 33090048000, "percent": 51.2, "used": 34683461632, "free": 33090048000}, "host_cpu_percent": 7.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2974, 24463, 54, 13.53, 375, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072202.504753, "monotonic": 526934.687, "host_memory": {"total": 67773509632, "available": 33066135552, "percent": 51.2, "used": 34707374080, "free": 33066135552}, "host_cpu_percent": 8.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2961, 24463, 54, 14.30, 427, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072203.5591023, "monotonic": 526935.734, "host_memory": {"total": 67773509632, "available": 32996093952, "percent": 51.3, "used": 34777415680, "free": 32996093952}, "host_cpu_percent": 6.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2961, 24463, 54, 14.05, 412, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072204.6170392, "monotonic": 526936.796, "host_memory": {"total": 67773509632, "available": 32824381440, "percent": 51.6, "used": 34949128192, "free": 32824381440}, "host_cpu_percent": 23.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2961, 24463, 54, 12.99, 360, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072205.6734185, "monotonic": 526937.859, "host_memory": {"total": 67773509632, "available": 32694259712, "percent": 51.8, "used": 35079249920, "free": 32694259712}, "host_cpu_percent": 7.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2961, 24463, 54, 13.44, 360, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072206.7517004, "monotonic": 526938.937, "host_memory": {"total": 67773509632, "available": 32431198208, "percent": 52.1, "used": 35342311424, "free": 32431198208}, "host_cpu_percent": 19.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2961, 24463, 54, 18.80, 412, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072207.8264582, "monotonic": 526940.015, "host_memory": {"total": 67773509632, "available": 31773462528, "percent": 53.1, "used": 36000047104, "free": 31773462528}, "host_cpu_percent": 13.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2961, 24463, 54, 13.39, 375, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072208.9172459, "monotonic": 526941.093, "host_memory": {"total": 67773509632, "available": 31420399616, "percent": 53.6, "used": 36353110016, "free": 31420399616}, "host_cpu_percent": 30.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2961, 24463, 54, 13.27, 360, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072209.9861407, "monotonic": 526942.171, "host_memory": {"total": 67773509632, "available": 31249874944, "percent": 53.9, "used": 36523634688, "free": 31249874944}, "host_cpu_percent": 15.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2961, 24463, 54, 13.12, 405, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072211.0462272, "monotonic": 526943.234, "host_memory": {"total": 67773509632, "available": 31244431360, "percent": 53.9, "used": 36529078272, "free": 31244431360}, "host_cpu_percent": 3.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2960, 24463, 54, 13.23, 367, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072212.1052177, "monotonic": 526944.281, "host_memory": {"total": 67773509632, "available": 31283499008, "percent": 53.8, "used": 36490010624, "free": 31283499008}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2960, 24463, 54, 13.40, 367, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072213.1652603, "monotonic": 526945.343, "host_memory": {"total": 67773509632, "available": 31284428800, "percent": 53.8, "used": 36489080832, "free": 31284428800}, "host_cpu_percent": 6.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2960, 24463, 54, 13.48, 352, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072214.2167037, "monotonic": 526946.406, "host_memory": {"total": 67773509632, "available": 30943137792, "percent": 54.3, "used": 36830371840, "free": 30943137792}, "host_cpu_percent": 25.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2960, 24463, 54, 13.10, 435, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072215.2808838, "monotonic": 526947.468, "host_memory": {"total": 67773509632, "available": 30703824896, "percent": 54.7, "used": 37069684736, "free": 30703824896}, "host_cpu_percent": 15.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2960, 24463, 54, 13.70, 360, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072216.3417192, "monotonic": 526948.531, "host_memory": {"total": 67773509632, "available": 30567866368, "percent": 54.9, "used": 37205643264, "free": 30567866368}, "host_cpu_percent": 15.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2956, 24463, 54, 13.79, 322, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072217.4065514, "monotonic": 526949.593, "host_memory": {"total": 67773509632, "available": 30546153472, "percent": 54.9, "used": 37227356160, "free": 30546153472}, "host_cpu_percent": 20.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2956, 24463, 54, 13.42, 405, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072218.4715154, "monotonic": 526950.656, "host_memory": {"total": 67773509632, "available": 30537752576, "percent": 54.9, "used": 37235757056, "free": 30537752576}, "host_cpu_percent": 13.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2956, 24463, 54, 13.34, 360, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072219.5337348, "monotonic": 526951.718, "host_memory": {"total": 67773509632, "available": 30510600192, "percent": 55.0, "used": 37262909440, "free": 30510600192}, "host_cpu_percent": 14.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2956, 24463, 54, 13.79, 367, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072220.5931048, "monotonic": 526952.781, "host_memory": {"total": 67773509632, "available": 30370541568, "percent": 55.2, "used": 37402968064, "free": 30370541568}, "host_cpu_percent": 37.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2956, 24463, 54, 12.81, 367, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072221.6763663, "monotonic": 526953.859, "host_memory": {"total": 67773509632, "available": 30222434304, "percent": 55.4, "used": 37551075328, "free": 30222434304}, "host_cpu_percent": 35.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2956, 24463, 54, 13.97, 375, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072222.7425694, "monotonic": 526954.921, "host_memory": {"total": 67773509632, "available": 30092832768, "percent": 55.6, "used": 37680676864, "free": 30092832768}, "host_cpu_percent": 42.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2956, 24463, 54, 13.59, 382, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072223.82223, "monotonic": 526956.0, "host_memory": {"total": 67773509632, "available": 28985978880, "percent": 57.2, "used": 38787530752, "free": 28985978880}, "host_cpu_percent": 50.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2956, 24463, 54, 14.02, 360, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072224.9034069, "monotonic": 526957.078, "host_memory": {"total": 67773509632, "available": 28660736000, "percent": 57.7, "used": 39112773632, "free": 28660736000}, "host_cpu_percent": 46.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 2972, 24463, 55, 13.92, 390, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072225.979118, "monotonic": 526958.156, "host_memory": {"total": 67773509632, "available": 28851867648, "percent": 57.4, "used": 38921641984, "free": 28851867648}, "host_cpu_percent": 28.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3966, 24463, 55, 17.97, 840, 810, 9, P5", "gpu_returncode": 0}
{"unix": 1790072227.0588605, "monotonic": 526959.234, "host_memory": {"total": 67773509632, "available": 27801739264, "percent": 59.0, "used": 39971770368, "free": 27801739264}, "host_cpu_percent": 33.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4850, 24463, 55, 21.95, 1672, 810, 20, P5", "gpu_returncode": 0}
{"unix": 1790072228.1548786, "monotonic": 526960.343, "host_memory": {"total": 67773509632, "available": 26710269952, "percent": 60.6, "used": 41063239680, "free": 26710269952}, "host_cpu_percent": 55.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 6562, 24463, 56, 32.27, 1897, 810, 69, P5", "gpu_returncode": 0}
{"unix": 1790072229.216337, "monotonic": 526961.406, "host_memory": {"total": 67773509632, "available": 25050124288, "percent": 63.0, "used": 42723385344, "free": 25050124288}, "host_cpu_percent": 35.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 7231, 24463, 56, 30.80, 2010, 810, 39, P5", "gpu_returncode": 0}
{"unix": 1790072230.2836795, "monotonic": 526962.468, "host_memory": {"total": 67773509632, "available": 24788385792, "percent": 63.4, "used": 42985123840, "free": 24788385792}, "host_cpu_percent": 20.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 8839, 24463, 56, 33.25, 1807, 810, 54, P5", "gpu_returncode": 0}
{"unix": 1790072231.3577068, "monotonic": 526963.546, "host_memory": {"total": 67773509632, "available": 24700473344, "percent": 63.6, "used": 43073036288, "free": 24700473344}, "host_cpu_percent": 19.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 8943, 24463, 57, 35.79, 1215, 810, 99, P5", "gpu_returncode": 0}
{"unix": 1790072232.4198978, "monotonic": 526964.609, "host_memory": {"total": 67773509632, "available": 24700985344, "percent": 63.6, "used": 43072524288, "free": 24700985344}, "host_cpu_percent": 13.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 8941, 24463, 56, 19.53, 1710, 810, 1, P5", "gpu_returncode": 0}
{"unix": 1790072233.4779887, "monotonic": 526965.656, "host_memory": {"total": 67773509632, "available": 24649289728, "percent": 63.6, "used": 43124219904, "free": 24649289728}, "host_cpu_percent": 23.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 8941, 24463, 56, 18.51, 472, 810, 1, P5", "gpu_returncode": 0}
{"unix": 1790072234.5396953, "monotonic": 526966.718, "host_memory": {"total": 67773509632, "available": 24346193920, "percent": 64.1, "used": 43427315712, "free": 24346193920}, "host_cpu_percent": 18.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 8947, 24463, 56, 14.56, 420, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790072235.6046357, "monotonic": 526967.781, "host_memory": {"total": 67773509632, "available": 24278433792, "percent": 64.2, "used": 43495075840, "free": 24278433792}, "host_cpu_percent": 18.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 12646, 24463, 56, 22.60, 667, 405, 97, P8", "gpu_returncode": 0}
{"unix": 1790072236.7281733, "monotonic": 526968.906, "host_memory": {"total": 67773509632, "available": 23995572224, "percent": 64.6, "used": 43777937408, "free": 23995572224}, "host_cpu_percent": 22.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 20362, 24463, 57, 28.31, 1350, 810, 99, P5", "gpu_returncode": 0}
{"unix": 1790072237.8441617, "monotonic": 526970.031, "host_memory": {"total": 67773509632, "available": 23326228480, "percent": 65.6, "used": 44447281152, "free": 23326228480}, "host_cpu_percent": 20.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23728, 24463, 57, 33.56, 382, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072238.9488993, "monotonic": 526971.125, "host_memory": {"total": 67773509632, "available": 21295595520, "percent": 68.6, "used": 46477914112, "free": 21295595520}, "host_cpu_percent": 19.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23779, 24463, 57, 31.34, 720, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072240.0859065, "monotonic": 526972.265, "host_memory": {"total": 67773509632, "available": 19677417472, "percent": 71.0, "used": 48096092160, "free": 19677417472}, "host_cpu_percent": 18.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23773, 24463, 57, 32.89, 1777, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072241.228053, "monotonic": 526973.406, "host_memory": {"total": 67773509632, "available": 19336462336, "percent": 71.5, "used": 48437047296, "free": 19336462336}, "host_cpu_percent": 20.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23788, 24463, 56, 22.44, 232, 810, 0, P5", "gpu_returncode": 0}
{"unix": 1790072243.0099294, "monotonic": 526975.187, "host_memory": {"total": 67773509632, "available": 17582604288, "percent": 74.1, "used": 50190905344, "free": 17582604288}, "host_cpu_percent": 22.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23792, 24463, 57, 35.64, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072244.1776993, "monotonic": 526976.359, "host_memory": {"total": 67773509632, "available": 17011261440, "percent": 74.9, "used": 50762248192, "free": 17011261440}, "host_cpu_percent": 19.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23792, 24463, 57, 29.81, 1372, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072246.2250655, "monotonic": 526978.406, "host_memory": {"total": 67773509632, "available": 14795898880, "percent": 78.2, "used": 52977610752, "free": 14795898880}, "host_cpu_percent": 35.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23788, 24463, 57, 22.19, 225, 810, 0, P5", "gpu_returncode": 0}
{"unix": 1790072247.3358612, "monotonic": 526979.515, "host_memory": {"total": 67773509632, "available": 14864375808, "percent": 78.1, "used": 52909133824, "free": 14864375808}, "host_cpu_percent": 35.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23788, 24463, 57, 21.12, 225, 810, 86, P5", "gpu_returncode": 0}
{"unix": 1790072249.3039842, "monotonic": 526981.484, "host_memory": {"total": 67773509632, "available": 13770895360, "percent": 79.7, "used": 54002614272, "free": 13770895360}, "host_cpu_percent": 32.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23760, 24463, 58, 32.83, 1335, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072250.3888772, "monotonic": 526982.578, "host_memory": {"total": 67773509632, "available": 13817135104, "percent": 79.6, "used": 53956374528, "free": 13817135104}, "host_cpu_percent": 28.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23760, 24463, 58, 32.47, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072253.1436923, "monotonic": 526985.328, "host_memory": {"total": 67773509632, "available": 13215555584, "percent": 80.5, "used": 54557954048, "free": 13215555584}, "host_cpu_percent": 30.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23812, 24463, 58, 21.70, 232, 810, 0, P5", "gpu_returncode": 0}
{"unix": 1790072254.2371082, "monotonic": 526986.421, "host_memory": {"total": 67773509632, "available": 13257674752, "percent": 80.4, "used": 54515834880, "free": 13257674752}, "host_cpu_percent": 35.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23812, 24463, 58, 20.99, 225, 810, 91, P5", "gpu_returncode": 0}
{"unix": 1790072256.8813224, "monotonic": 526989.062, "host_memory": {"total": 67773509632, "available": 12903337984, "percent": 81.0, "used": 54870171648, "free": 12903337984}, "host_cpu_percent": 22.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23849, 24463, 58, 32.58, 682, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072257.9462504, "monotonic": 526990.125, "host_memory": {"total": 67773509632, "available": 12710977536, "percent": 81.2, "used": 55062532096, "free": 12710977536}, "host_cpu_percent": 19.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23913, 24463, 59, 39.56, 2107, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072260.8906915, "monotonic": 526993.078, "host_memory": {"total": 67773509632, "available": 12547821568, "percent": 81.5, "used": 55225688064, "free": 12547821568}, "host_cpu_percent": 15.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23859, 24463, 58, 32.94, 1147, 810, 74, P5", "gpu_returncode": 0}
{"unix": 1790072261.9783127, "monotonic": 526994.156, "host_memory": {"total": 67773509632, "available": 12595453952, "percent": 81.4, "used": 55178055680, "free": 12595453952}, "host_cpu_percent": 16.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23859, 24463, 58, 21.19, 225, 810, 90, P5", "gpu_returncode": 0}
{"unix": 1790072264.4347117, "monotonic": 526996.609, "host_memory": {"total": 67773509632, "available": 11508477952, "percent": 83.0, "used": 56265031680, "free": 11508477952}, "host_cpu_percent": 13.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23897, 24463, 59, 37.60, 1627, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072265.6453362, "monotonic": 526997.828, "host_memory": {"total": 67773509632, "available": 8716263424, "percent": 87.1, "used": 59057246208, "free": 8716263424}, "host_cpu_percent": 21.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23899, 24463, 58, 26.90, 457, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072266.7781858, "monotonic": 526998.953, "host_memory": {"total": 67773509632, "available": 6334320640, "percent": 90.7, "used": 61439188992, "free": 6334320640}, "host_cpu_percent": 42.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23899, 24463, 58, 30.38, 952, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072267.909613, "monotonic": 527000.093, "host_memory": {"total": 67773509632, "available": 4503212032, "percent": 93.4, "used": 63270297600, "free": 4503212032}, "host_cpu_percent": 35.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23899, 24463, 59, 32.44, 1200, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072268.997835, "monotonic": 527001.187, "host_memory": {"total": 67773509632, "available": 2799538176, "percent": 95.9, "used": 64973971456, "free": 2799538176}, "host_cpu_percent": 29.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23890, 24463, 59, 32.95, 1545, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072270.692952, "monotonic": 527002.875, "host_memory": {"total": 67773509632, "available": 1006768128, "percent": 98.5, "used": 66766741504, "free": 1006768128}, "host_cpu_percent": 23.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23890, 24463, 59, 32.70, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072271.77311, "monotonic": 527003.953, "host_memory": {"total": 67773509632, "available": 1533898752, "percent": 97.7, "used": 66239610880, "free": 1533898752}, "host_cpu_percent": 35.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 59, 32.04, 1590, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072272.833458, "monotonic": 527005.015, "host_memory": {"total": 67773509632, "available": 1815531520, "percent": 97.3, "used": 65957978112, "free": 1815531520}, "host_cpu_percent": 17.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 59, 30.75, 1620, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072273.9024534, "monotonic": 527006.078, "host_memory": {"total": 67773509632, "available": 2156773376, "percent": 96.8, "used": 65616736256, "free": 2156773376}, "host_cpu_percent": 13.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 59, 32.42, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072274.9797385, "monotonic": 527007.156, "host_memory": {"total": 67773509632, "available": 3476508672, "percent": 94.9, "used": 64297000960, "free": 3476508672}, "host_cpu_percent": 16.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 59, 32.44, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072276.0397787, "monotonic": 527008.218, "host_memory": {"total": 67773509632, "available": 3797008384, "percent": 94.4, "used": 63976501248, "free": 3797008384}, "host_cpu_percent": 16.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 60, 32.46, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072277.0961647, "monotonic": 527009.281, "host_memory": {"total": 67773509632, "available": 4186669056, "percent": 93.8, "used": 63586840576, "free": 4186669056}, "host_cpu_percent": 19.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 60, 33.17, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072278.1640131, "monotonic": 527010.343, "host_memory": {"total": 67773509632, "available": 4594434048, "percent": 93.2, "used": 63179075584, "free": 4594434048}, "host_cpu_percent": 19.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 60, 33.26, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072279.2173517, "monotonic": 527011.406, "host_memory": {"total": 67773509632, "available": 4947111936, "percent": 92.7, "used": 62826397696, "free": 4947111936}, "host_cpu_percent": 14.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 60, 32.60, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072280.2804182, "monotonic": 527012.468, "host_memory": {"total": 67773509632, "available": 5335101440, "percent": 92.1, "used": 62438408192, "free": 5335101440}, "host_cpu_percent": 13.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 60, 32.58, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072281.3391235, "monotonic": 527013.515, "host_memory": {"total": 67773509632, "available": 5704888320, "percent": 91.6, "used": 62068621312, "free": 5704888320}, "host_cpu_percent": 19.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 60, 35.59, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072282.3976343, "monotonic": 527014.578, "host_memory": {"total": 67773509632, "available": 6087462912, "percent": 91.0, "used": 61686046720, "free": 6087462912}, "host_cpu_percent": 17.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 60, 32.71, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072283.460045, "monotonic": 527015.64, "host_memory": {"total": 67773509632, "available": 6377316352, "percent": 90.6, "used": 61396193280, "free": 6377316352}, "host_cpu_percent": 10.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 60, 32.95, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072284.5128806, "monotonic": 527016.687, "host_memory": {"total": 67773509632, "available": 6676623360, "percent": 90.1, "used": 61096886272, "free": 6676623360}, "host_cpu_percent": 11.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 60, 33.10, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072285.5746408, "monotonic": 527017.75, "host_memory": {"total": 67773509632, "available": 6912528384, "percent": 89.8, "used": 60860981248, "free": 6912528384}, "host_cpu_percent": 14.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 60, 32.78, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072286.6348178, "monotonic": 527018.812, "host_memory": {"total": 67773509632, "available": 6916550656, "percent": 89.8, "used": 60856958976, "free": 6916550656}, "host_cpu_percent": 14.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23900, 24463, 60, 32.49, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072287.707679, "monotonic": 527019.89, "host_memory": {"total": 67773509632, "available": 6855557120, "percent": 89.9, "used": 60917952512, "free": 6855557120}, "host_cpu_percent": 16.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23913, 24463, 60, 32.51, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072288.872995, "monotonic": 527021.062, "host_memory": {"total": 67773509632, "available": 6763204608, "percent": 90.0, "used": 61010305024, "free": 6763204608}, "host_cpu_percent": 14.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23881, 24463, 60, 33.05, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072289.932544, "monotonic": 527022.109, "host_memory": {"total": 67773509632, "available": 6750011392, "percent": 90.0, "used": 61023498240, "free": 6750011392}, "host_cpu_percent": 9.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23881, 24463, 60, 32.99, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072290.9971323, "monotonic": 527023.171, "host_memory": {"total": 67773509632, "available": 6755266560, "percent": 90.0, "used": 61018243072, "free": 6755266560}, "host_cpu_percent": 12.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23881, 24463, 60, 33.05, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072292.0548067, "monotonic": 527024.234, "host_memory": {"total": 67773509632, "available": 6759284736, "percent": 90.0, "used": 61014224896, "free": 6759284736}, "host_cpu_percent": 9.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23881, 24463, 60, 32.96, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072293.112639, "monotonic": 527025.296, "host_memory": {"total": 67773509632, "available": 6756392960, "percent": 90.0, "used": 61017116672, "free": 6756392960}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23881, 24463, 60, 33.27, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072294.173177, "monotonic": 527026.359, "host_memory": {"total": 67773509632, "available": 6797496320, "percent": 90.0, "used": 60976013312, "free": 6797496320}, "host_cpu_percent": 11.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23872, 24463, 60, 33.28, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072295.2294998, "monotonic": 527027.406, "host_memory": {"total": 67773509632, "available": 6807904256, "percent": 90.0, "used": 60965605376, "free": 6807904256}, "host_cpu_percent": 12.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23872, 24463, 59, 33.03, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072296.2869744, "monotonic": 527028.468, "host_memory": {"total": 67773509632, "available": 6802853888, "percent": 90.0, "used": 60970655744, "free": 6802853888}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23872, 24463, 59, 32.96, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072297.3424115, "monotonic": 527029.531, "host_memory": {"total": 67773509632, "available": 6822944768, "percent": 89.9, "used": 60950564864, "free": 6822944768}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23872, 24463, 59, 33.05, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072298.402055, "monotonic": 527030.578, "host_memory": {"total": 67773509632, "available": 6810857472, "percent": 90.0, "used": 60962652160, "free": 6810857472}, "host_cpu_percent": 12.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23872, 24463, 59, 32.99, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072299.4662867, "monotonic": 527031.656, "host_memory": {"total": 67773509632, "available": 6816477184, "percent": 89.9, "used": 60957032448, "free": 6816477184}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23872, 24463, 59, 33.09, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072300.5246935, "monotonic": 527032.703, "host_memory": {"total": 67773509632, "available": 6815903744, "percent": 89.9, "used": 60957605888, "free": 6815903744}, "host_cpu_percent": 11.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23872, 24463, 59, 33.18, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072301.5885851, "monotonic": 527033.765, "host_memory": {"total": 67773509632, "available": 6809305088, "percent": 90.0, "used": 60964204544, "free": 6809305088}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23872, 24463, 59, 32.70, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072302.6593735, "monotonic": 527034.843, "host_memory": {"total": 67773509632, "available": 6816624640, "percent": 89.9, "used": 60956884992, "free": 6816624640}, "host_cpu_percent": 9.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23872, 24463, 59, 32.57, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072303.7122958, "monotonic": 527035.89, "host_memory": {"total": 67773509632, "available": 6808682496, "percent": 90.0, "used": 60964827136, "free": 6808682496}, "host_cpu_percent": 19.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23872, 24463, 59, 32.47, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072304.7746172, "monotonic": 527036.953, "host_memory": {"total": 67773509632, "available": 6809288704, "percent": 90.0, "used": 60964220928, "free": 6809288704}, "host_cpu_percent": 12.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23872, 24463, 59, 32.91, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072305.8328648, "monotonic": 527038.015, "host_memory": {"total": 67773509632, "available": 6807130112, "percent": 90.0, "used": 60966379520, "free": 6807130112}, "host_cpu_percent": 8.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23872, 24463, 59, 32.79, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072306.8925714, "monotonic": 527039.078, "host_memory": {"total": 67773509632, "available": 6810820608, "percent": 90.0, "used": 60962689024, "free": 6810820608}, "host_cpu_percent": 12.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23872, 24463, 59, 32.55, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072307.9514213, "monotonic": 527040.14, "host_memory": {"total": 67773509632, "available": 6801555456, "percent": 90.0, "used": 60971954176, "free": 6801555456}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23913, 24463, 59, 32.66, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072309.0256097, "monotonic": 527041.203, "host_memory": {"total": 67773509632, "available": 6803083264, "percent": 90.0, "used": 60970426368, "free": 6803083264}, "host_cpu_percent": 13.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23918, 24463, 59, 32.92, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072310.0810535, "monotonic": 527042.265, "host_memory": {"total": 67773509632, "available": 6803435520, "percent": 90.0, "used": 60970074112, "free": 6803435520}, "host_cpu_percent": 9.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23918, 24463, 59, 32.62, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072311.1401637, "monotonic": 527043.328, "host_memory": {"total": 67773509632, "available": 6800007168, "percent": 90.0, "used": 60973502464, "free": 6800007168}, "host_cpu_percent": 9.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23918, 24463, 59, 33.06, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072312.2007868, "monotonic": 527044.39, "host_memory": {"total": 67773509632, "available": 6792650752, "percent": 90.0, "used": 60980858880, "free": 6792650752}, "host_cpu_percent": 14.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23918, 24463, 59, 33.12, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072313.2598605, "monotonic": 527045.437, "host_memory": {"total": 67773509632, "available": 6791319552, "percent": 90.0, "used": 60982190080, "free": 6791319552}, "host_cpu_percent": 17.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23918, 24463, 59, 33.07, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072314.3189278, "monotonic": 527046.5, "host_memory": {"total": 67773509632, "available": 6781952000, "percent": 90.0, "used": 60991557632, "free": 6781952000}, "host_cpu_percent": 13.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23918, 24463, 59, 32.76, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072315.3851767, "monotonic": 527047.562, "host_memory": {"total": 67773509632, "available": 6770008064, "percent": 90.0, "used": 61003501568, "free": 6770008064}, "host_cpu_percent": 13.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23918, 24463, 59, 33.08, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072316.4433963, "monotonic": 527048.625, "host_memory": {"total": 67773509632, "available": 6744535040, "percent": 90.0, "used": 61028974592, "free": 6744535040}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.05, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072317.5008512, "monotonic": 527049.687, "host_memory": {"total": 67773509632, "available": 6768840704, "percent": 90.0, "used": 61004668928, "free": 6768840704}, "host_cpu_percent": 9.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.95, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072318.5657501, "monotonic": 527050.75, "host_memory": {"total": 67773509632, "available": 6759841792, "percent": 90.0, "used": 61013667840, "free": 6759841792}, "host_cpu_percent": 9.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.10, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072319.621451, "monotonic": 527051.796, "host_memory": {"total": 67773509632, "available": 6772551680, "percent": 90.0, "used": 61000957952, "free": 6772551680}, "host_cpu_percent": 15.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.75, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072320.6853967, "monotonic": 527052.875, "host_memory": {"total": 67773509632, "available": 6787715072, "percent": 90.0, "used": 60985794560, "free": 6787715072}, "host_cpu_percent": 11.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.90, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072321.7398894, "monotonic": 527053.921, "host_memory": {"total": 67773509632, "available": 6791356416, "percent": 90.0, "used": 60982153216, "free": 6791356416}, "host_cpu_percent": 17.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.06, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072322.8027205, "monotonic": 527054.984, "host_memory": {"total": 67773509632, "available": 6790098944, "percent": 90.0, "used": 60983410688, "free": 6790098944}, "host_cpu_percent": 10.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.96, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072323.8649588, "monotonic": 527056.046, "host_memory": {"total": 67773509632, "available": 6792491008, "percent": 90.0, "used": 60981018624, "free": 6792491008}, "host_cpu_percent": 10.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.67, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072324.928799, "monotonic": 527057.109, "host_memory": {"total": 67773509632, "available": 6793818112, "percent": 90.0, "used": 60979691520, "free": 6793818112}, "host_cpu_percent": 15.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.96, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072325.990824, "monotonic": 527058.171, "host_memory": {"total": 67773509632, "available": 6791180288, "percent": 90.0, "used": 60982329344, "free": 6791180288}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.78, 1575, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072327.0494254, "monotonic": 527059.234, "host_memory": {"total": 67773509632, "available": 6792937472, "percent": 90.0, "used": 60980572160, "free": 6792937472}, "host_cpu_percent": 9.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.93, 1582, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072328.1126719, "monotonic": 527060.296, "host_memory": {"total": 67773509632, "available": 6795231232, "percent": 90.0, "used": 60978278400, "free": 6795231232}, "host_cpu_percent": 10.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.96, 1515, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072329.170643, "monotonic": 527061.359, "host_memory": {"total": 67773509632, "available": 6793019392, "percent": 90.0, "used": 60980490240, "free": 6793019392}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.78, 1485, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072330.2324383, "monotonic": 527062.421, "host_memory": {"total": 67773509632, "available": 6791974912, "percent": 90.0, "used": 60981534720, "free": 6791974912}, "host_cpu_percent": 12.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.98, 1530, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072331.2919059, "monotonic": 527063.468, "host_memory": {"total": 67773509632, "available": 6806163456, "percent": 90.0, "used": 60967346176, "free": 6806163456}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 31.40, 1507, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072332.3567991, "monotonic": 527064.546, "host_memory": {"total": 67773509632, "available": 6799167488, "percent": 90.0, "used": 60974342144, "free": 6799167488}, "host_cpu_percent": 9.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.95, 1515, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072333.4224164, "monotonic": 527065.609, "host_memory": {"total": 67773509632, "available": 6807306240, "percent": 90.0, "used": 60966203392, "free": 6807306240}, "host_cpu_percent": 13.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.82, 1552, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072334.477224, "monotonic": 527066.656, "host_memory": {"total": 67773509632, "available": 6805106688, "percent": 90.0, "used": 60968402944, "free": 6805106688}, "host_cpu_percent": 20.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.25, 1582, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072335.5378776, "monotonic": 527067.718, "host_memory": {"total": 67773509632, "available": 6801813504, "percent": 90.0, "used": 60971696128, "free": 6801813504}, "host_cpu_percent": 9.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.78, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072336.59801, "monotonic": 527068.781, "host_memory": {"total": 67773509632, "available": 6799745024, "percent": 90.0, "used": 60973764608, "free": 6799745024}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.82, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072337.6546588, "monotonic": 527069.843, "host_memory": {"total": 67773509632, "available": 6801309696, "percent": 90.0, "used": 60972199936, "free": 6801309696}, "host_cpu_percent": 12.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.14, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072338.7155588, "monotonic": 527070.89, "host_memory": {"total": 67773509632, "available": 6801678336, "percent": 90.0, "used": 60971831296, "free": 6801678336}, "host_cpu_percent": 9.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.46, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072339.7775667, "monotonic": 527071.953, "host_memory": {"total": 67773509632, "available": 6761422848, "percent": 90.0, "used": 61012086784, "free": 6761422848}, "host_cpu_percent": 12.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.10, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072340.8375127, "monotonic": 527073.015, "host_memory": {"total": 67773509632, "available": 6838112256, "percent": 89.9, "used": 60935397376, "free": 6838112256}, "host_cpu_percent": 24.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.11, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072341.8959234, "monotonic": 527074.078, "host_memory": {"total": 67773509632, "available": 6917734400, "percent": 89.8, "used": 60855775232, "free": 6917734400}, "host_cpu_percent": 20.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.19, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072342.9578457, "monotonic": 527075.14, "host_memory": {"total": 67773509632, "available": 6909763584, "percent": 89.8, "used": 60863746048, "free": 6909763584}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.21, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072344.021777, "monotonic": 527076.203, "host_memory": {"total": 67773509632, "available": 6925959168, "percent": 89.8, "used": 60847550464, "free": 6925959168}, "host_cpu_percent": 9.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.72, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072345.0801458, "monotonic": 527077.265, "host_memory": {"total": 67773509632, "available": 6936694784, "percent": 89.8, "used": 60836814848, "free": 6936694784}, "host_cpu_percent": 9.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.01, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072346.1451478, "monotonic": 527078.328, "host_memory": {"total": 67773509632, "available": 6928801792, "percent": 89.8, "used": 60844707840, "free": 6928801792}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.19, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072347.201747, "monotonic": 527079.39, "host_memory": {"total": 67773509632, "available": 6929846272, "percent": 89.8, "used": 60843663360, "free": 6929846272}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.15, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072348.263786, "monotonic": 527080.453, "host_memory": {"total": 67773509632, "available": 6931628032, "percent": 89.8, "used": 60841881600, "free": 6931628032}, "host_cpu_percent": 9.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 33.03, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072349.322337, "monotonic": 527081.5, "host_memory": {"total": 67773509632, "available": 6932545536, "percent": 89.8, "used": 60840964096, "free": 6932545536}, "host_cpu_percent": 20.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 33.00, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072350.3789465, "monotonic": 527082.562, "host_memory": {"total": 67773509632, "available": 6931570688, "percent": 89.8, "used": 60841938944, "free": 6931570688}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 33.22, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072351.4404097, "monotonic": 527083.625, "host_memory": {"total": 67773509632, "available": 6925107200, "percent": 89.8, "used": 60848402432, "free": 6925107200}, "host_cpu_percent": 10.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 32.88, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072352.5019488, "monotonic": 527084.687, "host_memory": {"total": 67773509632, "available": 6924521472, "percent": 89.8, "used": 60848988160, "free": 6924521472}, "host_cpu_percent": 14.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 32.90, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072353.5579042, "monotonic": 527085.734, "host_memory": {"total": 67773509632, "available": 6926901248, "percent": 89.8, "used": 60846608384, "free": 6926901248}, "host_cpu_percent": 11.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23924, 24463, 59, 33.02, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072354.6085413, "monotonic": 527086.796, "host_memory": {"total": 67773509632, "available": 6932668416, "percent": 89.8, "used": 60840841216, "free": 6932668416}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.04, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072355.670421, "monotonic": 527087.859, "host_memory": {"total": 67773509632, "available": 6932836352, "percent": 89.8, "used": 60840673280, "free": 6932836352}, "host_cpu_percent": 9.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.84, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072356.7310584, "monotonic": 527088.906, "host_memory": {"total": 67773509632, "available": 6928789504, "percent": 89.8, "used": 60844720128, "free": 6928789504}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.97, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072357.7964535, "monotonic": 527089.984, "host_memory": {"total": 67773509632, "available": 6913630208, "percent": 89.8, "used": 60859879424, "free": 6913630208}, "host_cpu_percent": 10.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.60, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072358.8559227, "monotonic": 527091.031, "host_memory": {"total": 67773509632, "available": 6911156224, "percent": 89.8, "used": 60862353408, "free": 6911156224}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.95, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072359.9199648, "monotonic": 527092.109, "host_memory": {"total": 67773509632, "available": 6926438400, "percent": 89.8, "used": 60847071232, "free": 6926438400}, "host_cpu_percent": 10.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.95, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072360.981423, "monotonic": 527093.156, "host_memory": {"total": 67773509632, "available": 6930079744, "percent": 89.8, "used": 60843429888, "free": 6930079744}, "host_cpu_percent": 18.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.89, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072362.0387762, "monotonic": 527094.218, "host_memory": {"total": 67773509632, "available": 6938521600, "percent": 89.8, "used": 60834988032, "free": 6938521600}, "host_cpu_percent": 11.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.78, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072363.100012, "monotonic": 527095.281, "host_memory": {"total": 67773509632, "available": 6932815872, "percent": 89.8, "used": 60840693760, "free": 6932815872}, "host_cpu_percent": 9.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.01, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072364.1651187, "monotonic": 527096.343, "host_memory": {"total": 67773509632, "available": 6933815296, "percent": 89.8, "used": 60839694336, "free": 6933815296}, "host_cpu_percent": 13.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.83, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072365.2249417, "monotonic": 527097.406, "host_memory": {"total": 67773509632, "available": 6940651520, "percent": 89.8, "used": 60832858112, "free": 6940651520}, "host_cpu_percent": 8.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.04, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072366.2857707, "monotonic": 527098.468, "host_memory": {"total": 67773509632, "available": 6941859840, "percent": 89.8, "used": 60831649792, "free": 6941859840}, "host_cpu_percent": 10.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.96, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072367.35282, "monotonic": 527099.531, "host_memory": {"total": 67773509632, "available": 6943391744, "percent": 89.8, "used": 60830117888, "free": 6943391744}, "host_cpu_percent": 13.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.99, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072368.4209867, "monotonic": 527100.609, "host_memory": {"total": 67773509632, "available": 6937784320, "percent": 89.8, "used": 60835725312, "free": 6937784320}, "host_cpu_percent": 12.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.79, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072369.4818711, "monotonic": 527101.671, "host_memory": {"total": 67773509632, "available": 6933725184, "percent": 89.8, "used": 60839784448, "free": 6933725184}, "host_cpu_percent": 21.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.91, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072370.5394309, "monotonic": 527102.718, "host_memory": {"total": 67773509632, "available": 6933463040, "percent": 89.8, "used": 60840046592, "free": 6933463040}, "host_cpu_percent": 14.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.94, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072371.6018167, "monotonic": 527103.781, "host_memory": {"total": 67773509632, "available": 6946729984, "percent": 89.8, "used": 60826779648, "free": 6946729984}, "host_cpu_percent": 15.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.97, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072372.6570807, "monotonic": 527104.843, "host_memory": {"total": 67773509632, "available": 6939865088, "percent": 89.8, "used": 60833644544, "free": 6939865088}, "host_cpu_percent": 11.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.89, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072373.7149277, "monotonic": 527105.89, "host_memory": {"total": 67773509632, "available": 6937059328, "percent": 89.8, "used": 60836450304, "free": 6937059328}, "host_cpu_percent": 9.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.07, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072374.7762866, "monotonic": 527106.953, "host_memory": {"total": 67773509632, "available": 6921519104, "percent": 89.8, "used": 60851990528, "free": 6921519104}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.12, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072375.8394675, "monotonic": 527108.015, "host_memory": {"total": 67773509632, "available": 6927515648, "percent": 89.8, "used": 60845993984, "free": 6927515648}, "host_cpu_percent": 16.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.04, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072376.9022248, "monotonic": 527109.078, "host_memory": {"total": 67773509632, "available": 6928179200, "percent": 89.8, "used": 60845330432, "free": 6928179200}, "host_cpu_percent": 14.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.01, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072377.958241, "monotonic": 527110.14, "host_memory": {"total": 67773509632, "available": 6923923456, "percent": 89.8, "used": 60849586176, "free": 6923923456}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.01, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072379.0230832, "monotonic": 527111.203, "host_memory": {"total": 67773509632, "available": 6887538688, "percent": 89.8, "used": 60885970944, "free": 6887538688}, "host_cpu_percent": 15.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.66, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072380.0912433, "monotonic": 527112.281, "host_memory": {"total": 67773509632, "available": 6920261632, "percent": 89.8, "used": 60853248000, "free": 6920261632}, "host_cpu_percent": 11.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.05, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072381.1545732, "monotonic": 527113.343, "host_memory": {"total": 67773509632, "available": 6920183808, "percent": 89.8, "used": 60853325824, "free": 6920183808}, "host_cpu_percent": 14.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.05, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072382.2114604, "monotonic": 527114.39, "host_memory": {"total": 67773509632, "available": 6921097216, "percent": 89.8, "used": 60852412416, "free": 6921097216}, "host_cpu_percent": 20.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.22, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072383.2706304, "monotonic": 527115.453, "host_memory": {"total": 67773509632, "available": 6917783552, "percent": 89.8, "used": 60855726080, "free": 6917783552}, "host_cpu_percent": 9.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.16, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072384.3319836, "monotonic": 527116.515, "host_memory": {"total": 67773509632, "available": 6905954304, "percent": 89.8, "used": 60867555328, "free": 6905954304}, "host_cpu_percent": 11.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.31, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072385.3931067, "monotonic": 527117.578, "host_memory": {"total": 67773509632, "available": 6871904256, "percent": 89.9, "used": 60901605376, "free": 6871904256}, "host_cpu_percent": 13.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.25, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072386.460038, "monotonic": 527118.64, "host_memory": {"total": 67773509632, "available": 6885289984, "percent": 89.8, "used": 60888219648, "free": 6885289984}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 34.60, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072387.5237017, "monotonic": 527119.703, "host_memory": {"total": 67773509632, "available": 6883639296, "percent": 89.8, "used": 60889870336, "free": 6883639296}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.02, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072388.5816984, "monotonic": 527120.765, "host_memory": {"total": 67773509632, "available": 6884610048, "percent": 89.8, "used": 60888899584, "free": 6884610048}, "host_cpu_percent": 9.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.97, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072389.6452484, "monotonic": 527121.828, "host_memory": {"total": 67773509632, "available": 6883172352, "percent": 89.8, "used": 60890337280, "free": 6883172352}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.89, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072390.6952972, "monotonic": 527122.875, "host_memory": {"total": 67773509632, "available": 6850772992, "percent": 89.9, "used": 60922736640, "free": 6850772992}, "host_cpu_percent": 26.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.69, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072391.7560859, "monotonic": 527123.937, "host_memory": {"total": 67773509632, "available": 6871040000, "percent": 89.9, "used": 60902469632, "free": 6871040000}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.95, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072392.8131194, "monotonic": 527125.0, "host_memory": {"total": 67773509632, "available": 6876012544, "percent": 89.9, "used": 60897497088, "free": 6876012544}, "host_cpu_percent": 14.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.89, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072393.8833194, "monotonic": 527126.062, "host_memory": {"total": 67773509632, "available": 6888026112, "percent": 89.8, "used": 60885483520, "free": 6888026112}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.72, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072394.9375138, "monotonic": 527127.125, "host_memory": {"total": 67773509632, "available": 6885646336, "percent": 89.8, "used": 60887863296, "free": 6885646336}, "host_cpu_percent": 9.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.35, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072396.002335, "monotonic": 527128.187, "host_memory": {"total": 67773509632, "available": 6883684352, "percent": 89.8, "used": 60889825280, "free": 6883684352}, "host_cpu_percent": 10.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.81, 1582, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072397.0734138, "monotonic": 527129.25, "host_memory": {"total": 67773509632, "available": 6888615936, "percent": 89.8, "used": 60884893696, "free": 6888615936}, "host_cpu_percent": 13.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 34.53, 1597, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072398.1261854, "monotonic": 527130.312, "host_memory": {"total": 67773509632, "available": 6884220928, "percent": 89.8, "used": 60889288704, "free": 6884220928}, "host_cpu_percent": 15.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.71, 1590, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072399.1862788, "monotonic": 527131.375, "host_memory": {"total": 67773509632, "available": 6889758720, "percent": 89.8, "used": 60883750912, "free": 6889758720}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.93, 1492, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072400.2627852, "monotonic": 527132.437, "host_memory": {"total": 67773509632, "available": 6872166400, "percent": 89.9, "used": 60901343232, "free": 6872166400}, "host_cpu_percent": 14.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.34, 1530, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072401.316968, "monotonic": 527133.5, "host_memory": {"total": 67773509632, "available": 6903840768, "percent": 89.8, "used": 60869668864, "free": 6903840768}, "host_cpu_percent": 12.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.89, 1492, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072402.3793006, "monotonic": 527134.562, "host_memory": {"total": 67773509632, "available": 6898286592, "percent": 89.8, "used": 60875223040, "free": 6898286592}, "host_cpu_percent": 14.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.84, 1500, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072403.4511774, "monotonic": 527135.64, "host_memory": {"total": 67773509632, "available": 6904991744, "percent": 89.8, "used": 60868517888, "free": 6904991744}, "host_cpu_percent": 11.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.87, 1560, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072404.51292, "monotonic": 527136.687, "host_memory": {"total": 67773509632, "available": 6905118720, "percent": 89.8, "used": 60868390912, "free": 6905118720}, "host_cpu_percent": 14.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.00, 1597, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072405.5887983, "monotonic": 527137.765, "host_memory": {"total": 67773509632, "available": 6900752384, "percent": 89.8, "used": 60872757248, "free": 6900752384}, "host_cpu_percent": 14.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 34.86, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072406.6530933, "monotonic": 527138.828, "host_memory": {"total": 67773509632, "available": 6897958912, "percent": 89.8, "used": 60875550720, "free": 6897958912}, "host_cpu_percent": 14.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.97, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072407.7099879, "monotonic": 527139.89, "host_memory": {"total": 67773509632, "available": 6911066112, "percent": 89.8, "used": 60862443520, "free": 6911066112}, "host_cpu_percent": 11.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.93, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072408.772501, "monotonic": 527140.953, "host_memory": {"total": 67773509632, "available": 6895259648, "percent": 89.8, "used": 60878249984, "free": 6895259648}, "host_cpu_percent": 10.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 32.91, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072409.833847, "monotonic": 527142.015, "host_memory": {"total": 67773509632, "available": 6891044864, "percent": 89.8, "used": 60882464768, "free": 6891044864}, "host_cpu_percent": 9.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 32.88, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072410.8941393, "monotonic": 527143.078, "host_memory": {"total": 67773509632, "available": 6890090496, "percent": 89.8, "used": 60883419136, "free": 6890090496}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 33.38, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072411.9493308, "monotonic": 527144.125, "host_memory": {"total": 67773509632, "available": 6882746368, "percent": 89.8, "used": 60890763264, "free": 6882746368}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 33.48, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072413.0088882, "monotonic": 527145.187, "host_memory": {"total": 67773509632, "available": 6880346112, "percent": 89.8, "used": 60893163520, "free": 6880346112}, "host_cpu_percent": 36.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 33.40, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072414.0696712, "monotonic": 527146.25, "host_memory": {"total": 67773509632, "available": 6881447936, "percent": 89.8, "used": 60892061696, "free": 6881447936}, "host_cpu_percent": 16.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 33.39, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072415.1314862, "monotonic": 527147.312, "host_memory": {"total": 67773509632, "available": 6875009024, "percent": 89.9, "used": 60898500608, "free": 6875009024}, "host_cpu_percent": 13.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 33.02, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072416.1889515, "monotonic": 527148.375, "host_memory": {"total": 67773509632, "available": 6934593536, "percent": 89.8, "used": 60838916096, "free": 6934593536}, "host_cpu_percent": 10.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23918, 24463, 59, 33.03, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072417.253103, "monotonic": 527149.437, "host_memory": {"total": 67773509632, "available": 7115542528, "percent": 89.5, "used": 60657967104, "free": 7115542528}, "host_cpu_percent": 12.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23918, 24463, 59, 32.93, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072418.3174162, "monotonic": 527150.5, "host_memory": {"total": 67773509632, "available": 7452200960, "percent": 89.0, "used": 60321308672, "free": 7452200960}, "host_cpu_percent": 15.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23918, 24463, 59, 32.88, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072419.376298, "monotonic": 527151.562, "host_memory": {"total": 67773509632, "available": 7576195072, "percent": 88.8, "used": 60197314560, "free": 7576195072}, "host_cpu_percent": 18.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23918, 24463, 59, 34.23, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072420.4352717, "monotonic": 527152.625, "host_memory": {"total": 67773509632, "available": 7701262336, "percent": 88.6, "used": 60072247296, "free": 7701262336}, "host_cpu_percent": 20.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.89, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072421.5171356, "monotonic": 527153.703, "host_memory": {"total": 67773509632, "available": 7932637184, "percent": 88.3, "used": 59840872448, "free": 7932637184}, "host_cpu_percent": 19.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.61, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072422.5725214, "monotonic": 527154.75, "host_memory": {"total": 67773509632, "available": 8050298880, "percent": 88.1, "used": 59723210752, "free": 8050298880}, "host_cpu_percent": 23.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.88, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072423.6332135, "monotonic": 527155.812, "host_memory": {"total": 67773509632, "available": 8056983552, "percent": 88.1, "used": 59716526080, "free": 8056983552}, "host_cpu_percent": 20.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.84, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072424.690666, "monotonic": 527156.875, "host_memory": {"total": 67773509632, "available": 8062644224, "percent": 88.1, "used": 59710865408, "free": 8062644224}, "host_cpu_percent": 17.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 33.08, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072425.7549162, "monotonic": 527157.937, "host_memory": {"total": 67773509632, "available": 8080609280, "percent": 88.1, "used": 59692900352, "free": 8080609280}, "host_cpu_percent": 15.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 33.04, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072426.8151894, "monotonic": 527159.0, "host_memory": {"total": 67773509632, "available": 8090726400, "percent": 88.1, "used": 59682783232, "free": 8090726400}, "host_cpu_percent": 20.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 32.85, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072427.873803, "monotonic": 527160.062, "host_memory": {"total": 67773509632, "available": 8101146624, "percent": 88.0, "used": 59672363008, "free": 8101146624}, "host_cpu_percent": 20.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 33.12, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072428.9337237, "monotonic": 527161.109, "host_memory": {"total": 67773509632, "available": 8092540928, "percent": 88.1, "used": 59680968704, "free": 8092540928}, "host_cpu_percent": 18.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 32.96, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072429.9900665, "monotonic": 527162.171, "host_memory": {"total": 67773509632, "available": 8101146624, "percent": 88.0, "used": 59672363008, "free": 8101146624}, "host_cpu_percent": 20.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 33.00, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072431.0572844, "monotonic": 527163.234, "host_memory": {"total": 67773509632, "available": 8111857664, "percent": 88.0, "used": 59661651968, "free": 8111857664}, "host_cpu_percent": 17.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 33.00, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072432.11571, "monotonic": 527164.296, "host_memory": {"total": 67773509632, "available": 8378466304, "percent": 87.6, "used": 59395043328, "free": 8378466304}, "host_cpu_percent": 19.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 32.97, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072433.180984, "monotonic": 527165.359, "host_memory": {"total": 67773509632, "available": 8559091712, "percent": 87.4, "used": 59214417920, "free": 8559091712}, "host_cpu_percent": 15.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 33.63, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072434.2331958, "monotonic": 527166.421, "host_memory": {"total": 67773509632, "available": 8643309568, "percent": 87.2, "used": 59130200064, "free": 8643309568}, "host_cpu_percent": 17.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 33.41, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072435.298608, "monotonic": 527167.484, "host_memory": {"total": 67773509632, "available": 8737820672, "percent": 87.1, "used": 59035688960, "free": 8737820672}, "host_cpu_percent": 14.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 33.27, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072436.3643742, "monotonic": 527168.546, "host_memory": {"total": 67773509632, "available": 8826347520, "percent": 87.0, "used": 58947162112, "free": 8826347520}, "host_cpu_percent": 14.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 33.19, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072437.421401, "monotonic": 527169.609, "host_memory": {"total": 67773509632, "available": 8927326208, "percent": 86.8, "used": 58846183424, "free": 8927326208}, "host_cpu_percent": 16.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 33.26, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072438.4819043, "monotonic": 527170.671, "host_memory": {"total": 67773509632, "available": 9012125696, "percent": 86.7, "used": 58761383936, "free": 9012125696}, "host_cpu_percent": 14.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 32.92, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072439.5471323, "monotonic": 527171.734, "host_memory": {"total": 67773509632, "available": 9079648256, "percent": 86.6, "used": 58693861376, "free": 9079648256}, "host_cpu_percent": 14.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 32.89, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072440.602676, "monotonic": 527172.781, "host_memory": {"total": 67773509632, "available": 9151819776, "percent": 86.5, "used": 58621689856, "free": 9151819776}, "host_cpu_percent": 15.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 32.94, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072441.665317, "monotonic": 527173.843, "host_memory": {"total": 67773509632, "available": 9244381184, "percent": 86.4, "used": 58529128448, "free": 9244381184}, "host_cpu_percent": 14.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 32.83, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072442.716805, "monotonic": 527174.906, "host_memory": {"total": 67773509632, "available": 9328926720, "percent": 86.2, "used": 58444582912, "free": 9328926720}, "host_cpu_percent": 14.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 32.59, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072443.7801795, "monotonic": 527175.968, "host_memory": {"total": 67773509632, "available": 9388298240, "percent": 86.1, "used": 58385211392, "free": 9388298240}, "host_cpu_percent": 14.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 32.71, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072444.8378348, "monotonic": 527177.015, "host_memory": {"total": 67773509632, "available": 9414164480, "percent": 86.1, "used": 58359345152, "free": 9414164480}, "host_cpu_percent": 13.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 32.92, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072445.8894687, "monotonic": 527178.078, "host_memory": {"total": 67773509632, "available": 9501343744, "percent": 86.0, "used": 58272165888, "free": 9501343744}, "host_cpu_percent": 13.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 32.82, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072446.9523554, "monotonic": 527179.14, "host_memory": {"total": 67773509632, "available": 9602617344, "percent": 85.8, "used": 58170892288, "free": 9602617344}, "host_cpu_percent": 13.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 32.96, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072448.0091155, "monotonic": 527180.187, "host_memory": {"total": 67773509632, "available": 9683480576, "percent": 85.7, "used": 58090029056, "free": 9683480576}, "host_cpu_percent": 17.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.96, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072449.0711193, "monotonic": 527181.25, "host_memory": {"total": 67773509632, "available": 9762377728, "percent": 85.6, "used": 58011131904, "free": 9762377728}, "host_cpu_percent": 17.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.77, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072450.1335952, "monotonic": 527182.312, "host_memory": {"total": 67773509632, "available": 9762091008, "percent": 85.6, "used": 58011418624, "free": 9762091008}, "host_cpu_percent": 10.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.79, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072451.1916625, "monotonic": 527183.375, "host_memory": {"total": 67773509632, "available": 9769824256, "percent": 85.6, "used": 58003685376, "free": 9769824256}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.19, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072452.261201, "monotonic": 527184.437, "host_memory": {"total": 67773509632, "available": 9765097472, "percent": 85.6, "used": 58008412160, "free": 9765097472}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.86, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072453.3207557, "monotonic": 527185.5, "host_memory": {"total": 67773509632, "available": 9726644224, "percent": 85.6, "used": 58046865408, "free": 9726644224}, "host_cpu_percent": 15.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.03, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072454.3778746, "monotonic": 527186.562, "host_memory": {"total": 67773509632, "available": 9729081344, "percent": 85.6, "used": 58044428288, "free": 9729081344}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.57, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072455.4383662, "monotonic": 527187.625, "host_memory": {"total": 67773509632, "available": 9740476416, "percent": 85.6, "used": 58033033216, "free": 9740476416}, "host_cpu_percent": 12.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.85, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072456.4899755, "monotonic": 527188.671, "host_memory": {"total": 67773509632, "available": 9737330688, "percent": 85.6, "used": 58036178944, "free": 9737330688}, "host_cpu_percent": 11.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.84, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072457.5466094, "monotonic": 527189.734, "host_memory": {"total": 67773509632, "available": 9730318336, "percent": 85.6, "used": 58043191296, "free": 9730318336}, "host_cpu_percent": 13.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.84, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072458.6102836, "monotonic": 527190.796, "host_memory": {"total": 67773509632, "available": 9734209536, "percent": 85.6, "used": 58039300096, "free": 9734209536}, "host_cpu_percent": 8.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.53, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072459.668648, "monotonic": 527191.843, "host_memory": {"total": 67773509632, "available": 9737777152, "percent": 85.6, "used": 58035732480, "free": 9737777152}, "host_cpu_percent": 9.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.89, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072460.7275975, "monotonic": 527192.906, "host_memory": {"total": 67773509632, "available": 9702432768, "percent": 85.7, "used": 58071076864, "free": 9702432768}, "host_cpu_percent": 22.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.91, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072461.7851799, "monotonic": 527193.968, "host_memory": {"total": 67773509632, "available": 9697173504, "percent": 85.7, "used": 58076336128, "free": 9697173504}, "host_cpu_percent": 11.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.29, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072462.8532786, "monotonic": 527195.031, "host_memory": {"total": 67773509632, "available": 9679589376, "percent": 85.7, "used": 58093920256, "free": 9679589376}, "host_cpu_percent": 14.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.85, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072463.9232707, "monotonic": 527196.109, "host_memory": {"total": 67773509632, "available": 9675141120, "percent": 85.7, "used": 58098368512, "free": 9675141120}, "host_cpu_percent": 9.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.93, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072464.9895477, "monotonic": 527197.171, "host_memory": {"total": 67773509632, "available": 9668071424, "percent": 85.7, "used": 58105438208, "free": 9668071424}, "host_cpu_percent": 10.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.74, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072466.0504663, "monotonic": 527198.234, "host_memory": {"total": 67773509632, "available": 9688264704, "percent": 85.7, "used": 58085244928, "free": 9688264704}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.05, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072467.1103816, "monotonic": 527199.296, "host_memory": {"total": 67773509632, "available": 9679949824, "percent": 85.7, "used": 58093559808, "free": 9679949824}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.15, 1582, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072468.1724432, "monotonic": 527200.359, "host_memory": {"total": 67773509632, "available": 9685504000, "percent": 85.7, "used": 58088005632, "free": 9685504000}, "host_cpu_percent": 17.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.08, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072469.2264855, "monotonic": 527201.406, "host_memory": {"total": 67773509632, "available": 9685499904, "percent": 85.7, "used": 58088009728, "free": 9685499904}, "host_cpu_percent": 11.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 32.96, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072470.2792315, "monotonic": 527202.468, "host_memory": {"total": 67773509632, "available": 9681158144, "percent": 85.7, "used": 58092351488, "free": 9681158144}, "host_cpu_percent": 15.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 32.86, 1522, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072471.3534815, "monotonic": 527203.531, "host_memory": {"total": 67773509632, "available": 9691017216, "percent": 85.7, "used": 58082492416, "free": 9691017216}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 35.72, 1575, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072472.4050107, "monotonic": 527204.593, "host_memory": {"total": 67773509632, "available": 9690177536, "percent": 85.7, "used": 58083332096, "free": 9690177536}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 32.25, 1515, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072473.4711006, "monotonic": 527205.656, "host_memory": {"total": 67773509632, "available": 9659850752, "percent": 85.7, "used": 58113658880, "free": 9659850752}, "host_cpu_percent": 12.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 33.56, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072474.5293696, "monotonic": 527206.718, "host_memory": {"total": 67773509632, "available": 9664180224, "percent": 85.7, "used": 58109329408, "free": 9664180224}, "host_cpu_percent": 11.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 33.49, 1590, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072475.587866, "monotonic": 527207.765, "host_memory": {"total": 67773509632, "available": 9661931520, "percent": 85.7, "used": 58111578112, "free": 9661931520}, "host_cpu_percent": 13.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23928, 24463, 59, 33.06, 1590, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072476.6496992, "monotonic": 527208.828, "host_memory": {"total": 67773509632, "available": 9664512000, "percent": 85.7, "used": 58108997632, "free": 9664512000}, "host_cpu_percent": 24.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.47, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072477.7124388, "monotonic": 527209.89, "host_memory": {"total": 67773509632, "available": 9617133568, "percent": 85.8, "used": 58156376064, "free": 9617133568}, "host_cpu_percent": 17.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.72, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072478.781478, "monotonic": 527210.968, "host_memory": {"total": 67773509632, "available": 9631674368, "percent": 85.8, "used": 58141835264, "free": 9631674368}, "host_cpu_percent": 13.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.76, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072479.8365772, "monotonic": 527212.015, "host_memory": {"total": 67773509632, "available": 9629016064, "percent": 85.8, "used": 58144493568, "free": 9629016064}, "host_cpu_percent": 16.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.81, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072480.900786, "monotonic": 527213.078, "host_memory": {"total": 67773509632, "available": 9608806400, "percent": 85.8, "used": 58164703232, "free": 9608806400}, "host_cpu_percent": 24.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.65, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072481.961476, "monotonic": 527214.14, "host_memory": {"total": 67773509632, "available": 9598222336, "percent": 85.8, "used": 58175287296, "free": 9598222336}, "host_cpu_percent": 16.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.75, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072483.031248, "monotonic": 527215.218, "host_memory": {"total": 67773509632, "available": 9601351680, "percent": 85.8, "used": 58172157952, "free": 9601351680}, "host_cpu_percent": 11.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.97, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072484.09485, "monotonic": 527216.281, "host_memory": {"total": 67773509632, "available": 9587757056, "percent": 85.9, "used": 58185752576, "free": 9587757056}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.68, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072485.1562421, "monotonic": 527217.343, "host_memory": {"total": 67773509632, "available": 9588301824, "percent": 85.9, "used": 58185207808, "free": 9588301824}, "host_cpu_percent": 11.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.85, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072486.2202256, "monotonic": 527218.406, "host_memory": {"total": 67773509632, "available": 9584836608, "percent": 85.9, "used": 58188673024, "free": 9584836608}, "host_cpu_percent": 22.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.20, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072487.2884016, "monotonic": 527219.468, "host_memory": {"total": 67773509632, "available": 9566208000, "percent": 85.9, "used": 58207301632, "free": 9566208000}, "host_cpu_percent": 22.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.95, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072488.3539298, "monotonic": 527220.531, "host_memory": {"total": 67773509632, "available": 9565769728, "percent": 85.9, "used": 58207739904, "free": 9565769728}, "host_cpu_percent": 13.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.33, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072489.4090552, "monotonic": 527221.593, "host_memory": {"total": 67773509632, "available": 9569460224, "percent": 85.9, "used": 58204049408, "free": 9569460224}, "host_cpu_percent": 12.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.00, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072490.4716678, "monotonic": 527222.656, "host_memory": {"total": 67773509632, "available": 9594994688, "percent": 85.8, "used": 58178514944, "free": 9594994688}, "host_cpu_percent": 13.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.92, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072491.5364103, "monotonic": 527223.718, "host_memory": {"total": 67773509632, "available": 9600782336, "percent": 85.8, "used": 58172727296, "free": 9600782336}, "host_cpu_percent": 14.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.04, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072492.5902982, "monotonic": 527224.765, "host_memory": {"total": 67773509632, "available": 9578438656, "percent": 85.9, "used": 58195070976, "free": 9578438656}, "host_cpu_percent": 14.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.59, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072493.6574523, "monotonic": 527225.843, "host_memory": {"total": 67773509632, "available": 9434238976, "percent": 86.1, "used": 58339270656, "free": 9434238976}, "host_cpu_percent": 22.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.29, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072494.7277706, "monotonic": 527226.906, "host_memory": {"total": 67773509632, "available": 9169190912, "percent": 86.5, "used": 58604318720, "free": 9169190912}, "host_cpu_percent": 19.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.88, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072495.794513, "monotonic": 527227.984, "host_memory": {"total": 67773509632, "available": 9050099712, "percent": 86.6, "used": 58723409920, "free": 9050099712}, "host_cpu_percent": 21.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.37, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072496.8529065, "monotonic": 527229.031, "host_memory": {"total": 67773509632, "available": 8941412352, "percent": 86.8, "used": 58832097280, "free": 8941412352}, "host_cpu_percent": 26.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.99, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072497.9120693, "monotonic": 527230.093, "host_memory": {"total": 67773509632, "available": 8894148608, "percent": 86.9, "used": 58879361024, "free": 8894148608}, "host_cpu_percent": 14.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.09, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072498.9726884, "monotonic": 527231.156, "host_memory": {"total": 67773509632, "available": 8980480000, "percent": 86.7, "used": 58793029632, "free": 8980480000}, "host_cpu_percent": 10.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.01, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072500.032667, "monotonic": 527232.218, "host_memory": {"total": 67773509632, "available": 9073262592, "percent": 86.6, "used": 58700247040, "free": 9073262592}, "host_cpu_percent": 11.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.94, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072501.0975463, "monotonic": 527233.281, "host_memory": {"total": 67773509632, "available": 9134661632, "percent": 86.5, "used": 58638848000, "free": 9134661632}, "host_cpu_percent": 16.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.70, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072502.161398, "monotonic": 527234.343, "host_memory": {"total": 67773509632, "available": 9132785664, "percent": 86.5, "used": 58640723968, "free": 9132785664}, "host_cpu_percent": 15.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.90, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072503.2271664, "monotonic": 527235.406, "host_memory": {"total": 67773509632, "available": 9154801664, "percent": 86.5, "used": 58618707968, "free": 9154801664}, "host_cpu_percent": 28.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 33.65, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072504.2984083, "monotonic": 527236.484, "host_memory": {"total": 67773509632, "available": 8929693696, "percent": 86.8, "used": 58843815936, "free": 8929693696}, "host_cpu_percent": 36.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 59, 32.98, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072505.3821962, "monotonic": 527237.562, "host_memory": {"total": 67773509632, "available": 8765779968, "percent": 87.1, "used": 59007729664, "free": 8765779968}, "host_cpu_percent": 58.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23914, 24463, 60, 32.96, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072506.5448854, "monotonic": 527238.734, "host_memory": {"total": 67773509632, "available": 8961986560, "percent": 86.8, "used": 58811523072, "free": 8961986560}, "host_cpu_percent": 46.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.97, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072507.624816, "monotonic": 527239.812, "host_memory": {"total": 67773509632, "available": 8837046272, "percent": 87.0, "used": 58936463360, "free": 8837046272}, "host_cpu_percent": 60.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.97, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072508.701488, "monotonic": 527240.89, "host_memory": {"total": 67773509632, "available": 8730714112, "percent": 87.1, "used": 59042795520, "free": 8730714112}, "host_cpu_percent": 31.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.92, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072509.772104, "monotonic": 527241.953, "host_memory": {"total": 67773509632, "available": 8720928768, "percent": 87.1, "used": 59052580864, "free": 8720928768}, "host_cpu_percent": 24.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.92, 1575, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072510.8464484, "monotonic": 527243.031, "host_memory": {"total": 67773509632, "available": 8758214656, "percent": 87.1, "used": 59015294976, "free": 8758214656}, "host_cpu_percent": 16.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.92, 1560, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072511.908275, "monotonic": 527244.093, "host_memory": {"total": 67773509632, "available": 8783253504, "percent": 87.0, "used": 58990256128, "free": 8783253504}, "host_cpu_percent": 13.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.12, 1507, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072512.9699872, "monotonic": 527245.156, "host_memory": {"total": 67773509632, "available": 8871587840, "percent": 86.9, "used": 58901921792, "free": 8871587840}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.69, 1575, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072514.0344863, "monotonic": 527246.218, "host_memory": {"total": 67773509632, "available": 8876597248, "percent": 86.9, "used": 58896912384, "free": 8876597248}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.44, 1575, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072515.0960064, "monotonic": 527247.281, "host_memory": {"total": 67773509632, "available": 8876879872, "percent": 86.9, "used": 58896629760, "free": 8876879872}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.42, 1582, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072516.153829, "monotonic": 527248.343, "host_memory": {"total": 67773509632, "available": 8890343424, "percent": 86.9, "used": 58883166208, "free": 8890343424}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 33.01, 1545, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072517.2209024, "monotonic": 527249.406, "host_memory": {"total": 67773509632, "available": 8886525952, "percent": 86.9, "used": 58886983680, "free": 8886525952}, "host_cpu_percent": 16.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.86, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072518.281238, "monotonic": 527250.468, "host_memory": {"total": 67773509632, "available": 8904491008, "percent": 86.9, "used": 58869018624, "free": 8904491008}, "host_cpu_percent": 13.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.87, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072519.3423128, "monotonic": 527251.531, "host_memory": {"total": 67773509632, "available": 8905023488, "percent": 86.9, "used": 58868486144, "free": 8905023488}, "host_cpu_percent": 9.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.81, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072520.4040399, "monotonic": 527252.593, "host_memory": {"total": 67773509632, "available": 8901111808, "percent": 86.9, "used": 58872397824, "free": 8901111808}, "host_cpu_percent": 10.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.88, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072521.4691987, "monotonic": 527253.656, "host_memory": {"total": 67773509632, "available": 8889430016, "percent": 86.9, "used": 58884079616, "free": 8889430016}, "host_cpu_percent": 10.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 33.12, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072522.5279586, "monotonic": 527254.703, "host_memory": {"total": 67773509632, "available": 8892112896, "percent": 86.9, "used": 58881396736, "free": 8892112896}, "host_cpu_percent": 13.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.98, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072523.589772, "monotonic": 527255.765, "host_memory": {"total": 67773509632, "available": 8879960064, "percent": 86.9, "used": 58893549568, "free": 8879960064}, "host_cpu_percent": 12.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.85, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072524.6552675, "monotonic": 527256.843, "host_memory": {"total": 67773509632, "available": 8886218752, "percent": 86.9, "used": 58887290880, "free": 8886218752}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 34.66, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072525.7237198, "monotonic": 527257.906, "host_memory": {"total": 67773509632, "available": 8899473408, "percent": 86.9, "used": 58874036224, "free": 8899473408}, "host_cpu_percent": 14.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 33.07, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072526.798261, "monotonic": 527258.984, "host_memory": {"total": 67773509632, "available": 8925515776, "percent": 86.8, "used": 58847993856, "free": 8925515776}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 33.08, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072527.8590415, "monotonic": 527260.046, "host_memory": {"total": 67773509632, "available": 8919220224, "percent": 86.8, "used": 58854289408, "free": 8919220224}, "host_cpu_percent": 30.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.49, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072528.9294155, "monotonic": 527261.109, "host_memory": {"total": 67773509632, "available": 8786059264, "percent": 87.0, "used": 58987450368, "free": 8786059264}, "host_cpu_percent": 21.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23942, 24463, 60, 33.06, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072530.0051134, "monotonic": 527262.187, "host_memory": {"total": 67773509632, "available": 8803364864, "percent": 87.0, "used": 58970144768, "free": 8803364864}, "host_cpu_percent": 14.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23942, 24463, 60, 32.29, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072531.0659788, "monotonic": 527263.25, "host_memory": {"total": 67773509632, "available": 8757010432, "percent": 87.1, "used": 59016499200, "free": 8757010432}, "host_cpu_percent": 20.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23942, 24463, 60, 33.10, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072532.1336262, "monotonic": 527264.312, "host_memory": {"total": 67773509632, "available": 8769699840, "percent": 87.1, "used": 59003809792, "free": 8769699840}, "host_cpu_percent": 12.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23942, 24463, 60, 33.26, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072533.1933842, "monotonic": 527265.375, "host_memory": {"total": 67773509632, "available": 8778481664, "percent": 87.0, "used": 58995027968, "free": 8778481664}, "host_cpu_percent": 11.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23942, 24463, 60, 33.73, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072534.2530649, "monotonic": 527266.437, "host_memory": {"total": 67773509632, "available": 8840249344, "percent": 87.0, "used": 58933260288, "free": 8840249344}, "host_cpu_percent": 13.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23942, 24463, 60, 32.55, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072535.3109264, "monotonic": 527267.5, "host_memory": {"total": 67773509632, "available": 8849874944, "percent": 86.9, "used": 58923634688, "free": 8849874944}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23938, 24463, 60, 32.84, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072536.3910024, "monotonic": 527268.578, "host_memory": {"total": 67773509632, "available": 8864915456, "percent": 86.9, "used": 58908594176, "free": 8864915456}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.84, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072537.4582448, "monotonic": 527269.64, "host_memory": {"total": 67773509632, "available": 8859193344, "percent": 86.9, "used": 58914316288, "free": 8859193344}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.77, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072538.5350046, "monotonic": 527270.718, "host_memory": {"total": 67773509632, "available": 8858492928, "percent": 86.9, "used": 58915016704, "free": 8858492928}, "host_cpu_percent": 15.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 33.00, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072539.610793, "monotonic": 527271.796, "host_memory": {"total": 67773509632, "available": 8862810112, "percent": 86.9, "used": 58910699520, "free": 8862810112}, "host_cpu_percent": 22.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.73, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072540.6662717, "monotonic": 527272.843, "host_memory": {"total": 67773509632, "available": 8883875840, "percent": 86.9, "used": 58889633792, "free": 8883875840}, "host_cpu_percent": 14.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 33.15, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072541.7343214, "monotonic": 527273.921, "host_memory": {"total": 67773509632, "available": 8883523584, "percent": 86.9, "used": 58889986048, "free": 8883523584}, "host_cpu_percent": 15.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.52, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072542.7898262, "monotonic": 527274.968, "host_memory": {"total": 67773509632, "available": 8896888832, "percent": 86.9, "used": 58876620800, "free": 8896888832}, "host_cpu_percent": 9.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 33.47, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072543.8463595, "monotonic": 527276.031, "host_memory": {"total": 67773509632, "available": 8856612864, "percent": 86.9, "used": 58916896768, "free": 8856612864}, "host_cpu_percent": 18.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 33.29, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072544.9347441, "monotonic": 527277.109, "host_memory": {"total": 67773509632, "available": 8816549888, "percent": 87.0, "used": 58956959744, "free": 8816549888}, "host_cpu_percent": 25.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.82, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072546.019624, "monotonic": 527278.203, "host_memory": {"total": 67773509632, "available": 8772227072, "percent": 87.1, "used": 59001282560, "free": 8772227072}, "host_cpu_percent": 12.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 33.92, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072547.0924416, "monotonic": 527279.281, "host_memory": {"total": 67773509632, "available": 8764059648, "percent": 87.1, "used": 59009449984, "free": 8764059648}, "host_cpu_percent": 14.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.92, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072548.1549442, "monotonic": 527280.343, "host_memory": {"total": 67773509632, "available": 8790331392, "percent": 87.0, "used": 58983178240, "free": 8790331392}, "host_cpu_percent": 14.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.86, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072549.2205615, "monotonic": 527281.406, "host_memory": {"total": 67773509632, "available": 8784801792, "percent": 87.0, "used": 58988707840, "free": 8784801792}, "host_cpu_percent": 13.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 34.22, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072550.2803357, "monotonic": 527282.468, "host_memory": {"total": 67773509632, "available": 8865046528, "percent": 86.9, "used": 58908463104, "free": 8865046528}, "host_cpu_percent": 8.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.91, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072551.357003, "monotonic": 527283.546, "host_memory": {"total": 67773509632, "available": 8871817216, "percent": 86.9, "used": 58901692416, "free": 8871817216}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.95, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072552.4165683, "monotonic": 527284.593, "host_memory": {"total": 67773509632, "available": 8874065920, "percent": 86.9, "used": 58899443712, "free": 8874065920}, "host_cpu_percent": 14.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 32.72, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072553.465762, "monotonic": 527285.64, "host_memory": {"total": 67773509632, "available": 8865669120, "percent": 86.9, "used": 58907840512, "free": 8865669120}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 33.42, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072554.5300918, "monotonic": 527286.718, "host_memory": {"total": 67773509632, "available": 8863858688, "percent": 86.9, "used": 58909650944, "free": 8863858688}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 60, 33.08, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072555.5960646, "monotonic": 527287.781, "host_memory": {"total": 67773509632, "available": 8864018432, "percent": 86.9, "used": 58909491200, "free": 8864018432}, "host_cpu_percent": 9.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 32.84, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072556.6676564, "monotonic": 527288.843, "host_memory": {"total": 67773509632, "available": 8862834688, "percent": 86.9, "used": 58910674944, "free": 8862834688}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 33.04, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072557.7339048, "monotonic": 527289.921, "host_memory": {"total": 67773509632, "available": 8856498176, "percent": 86.9, "used": 58917011456, "free": 8856498176}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 32.96, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072558.799766, "monotonic": 527290.984, "host_memory": {"total": 67773509632, "available": 8837279744, "percent": 87.0, "used": 58936229888, "free": 8837279744}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 33.00, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072559.8765917, "monotonic": 527292.062, "host_memory": {"total": 67773509632, "available": 8871772160, "percent": 86.9, "used": 58901737472, "free": 8871772160}, "host_cpu_percent": 25.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 32.99, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072560.935506, "monotonic": 527293.125, "host_memory": {"total": 67773509632, "available": 8882171904, "percent": 86.9, "used": 58891337728, "free": 8882171904}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 33.41, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072562.0125198, "monotonic": 527294.187, "host_memory": {"total": 67773509632, "available": 8854257664, "percent": 86.9, "used": 58919251968, "free": 8854257664}, "host_cpu_percent": 15.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 33.16, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072563.0772786, "monotonic": 527295.265, "host_memory": {"total": 67773509632, "available": 8872357888, "percent": 86.9, "used": 58901151744, "free": 8872357888}, "host_cpu_percent": 11.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 32.63, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072564.1460128, "monotonic": 527296.328, "host_memory": {"total": 67773509632, "available": 8882159616, "percent": 86.9, "used": 58891350016, "free": 8882159616}, "host_cpu_percent": 11.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 32.96, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072565.2084045, "monotonic": 527297.39, "host_memory": {"total": 67773509632, "available": 8886128640, "percent": 86.9, "used": 58887380992, "free": 8886128640}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 32.93, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072566.2714756, "monotonic": 527298.453, "host_memory": {"total": 67773509632, "available": 8894455808, "percent": 86.9, "used": 58879053824, "free": 8894455808}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 33.01, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072567.3284633, "monotonic": 527299.515, "host_memory": {"total": 67773509632, "available": 8871043072, "percent": 86.9, "used": 58902466560, "free": 8871043072}, "host_cpu_percent": 16.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 33.03, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072568.3897893, "monotonic": 527300.578, "host_memory": {"total": 67773509632, "available": 8882810880, "percent": 86.9, "used": 58890698752, "free": 8882810880}, "host_cpu_percent": 12.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 33.04, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072569.4540646, "monotonic": 527301.64, "host_memory": {"total": 67773509632, "available": 8963035136, "percent": 86.8, "used": 58810474496, "free": 8963035136}, "host_cpu_percent": 14.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 33.09, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072570.531007, "monotonic": 527302.718, "host_memory": {"total": 67773509632, "available": 8958619648, "percent": 86.8, "used": 58814889984, "free": 8958619648}, "host_cpu_percent": 18.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 33.01, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072571.5997078, "monotonic": 527303.781, "host_memory": {"total": 67773509632, "available": 8956641280, "percent": 86.8, "used": 58816868352, "free": 8956641280}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23929, 24463, 59, 32.93, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072572.6704497, "monotonic": 527304.859, "host_memory": {"total": 67773509632, "available": 9026498560, "percent": 86.7, "used": 58747011072, "free": 9026498560}, "host_cpu_percent": 15.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23950, 24463, 59, 33.34, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072573.7369275, "monotonic": 527305.921, "host_memory": {"total": 67773509632, "available": 9107165184, "percent": 86.6, "used": 58666344448, "free": 9107165184}, "host_cpu_percent": 14.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23950, 24463, 59, 32.79, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072574.7994394, "monotonic": 527306.984, "host_memory": {"total": 67773509632, "available": 9082867712, "percent": 86.6, "used": 58690641920, "free": 9082867712}, "host_cpu_percent": 12.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23950, 24463, 59, 32.95, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072575.8658066, "monotonic": 527308.046, "host_memory": {"total": 67773509632, "available": 9078878208, "percent": 86.6, "used": 58694631424, "free": 9078878208}, "host_cpu_percent": 12.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23950, 24463, 59, 32.98, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072576.9428437, "monotonic": 527309.125, "host_memory": {"total": 67773509632, "available": 8994893824, "percent": 86.7, "used": 58778615808, "free": 8994893824}, "host_cpu_percent": 24.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23950, 24463, 59, 32.89, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072578.0115583, "monotonic": 527310.187, "host_memory": {"total": 67773509632, "available": 9046523904, "percent": 86.7, "used": 58726985728, "free": 9046523904}, "host_cpu_percent": 16.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23945, 24463, 59, 32.95, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072579.0775287, "monotonic": 527311.265, "host_memory": {"total": 67773509632, "available": 9056583680, "percent": 86.6, "used": 58716925952, "free": 9056583680}, "host_cpu_percent": 13.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23945, 24463, 59, 33.14, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072580.13792, "monotonic": 527312.312, "host_memory": {"total": 67773509632, "available": 9050062848, "percent": 86.6, "used": 58723446784, "free": 9050062848}, "host_cpu_percent": 16.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23945, 24463, 59, 33.05, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072581.2009816, "monotonic": 527313.39, "host_memory": {"total": 67773509632, "available": 9052319744, "percent": 86.6, "used": 58721189888, "free": 9052319744}, "host_cpu_percent": 18.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23945, 24463, 59, 32.71, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072582.2611868, "monotonic": 527314.437, "host_memory": {"total": 67773509632, "available": 9063690240, "percent": 86.6, "used": 58709819392, "free": 9063690240}, "host_cpu_percent": 27.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23945, 24463, 59, 32.80, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072583.3387978, "monotonic": 527315.515, "host_memory": {"total": 67773509632, "available": 9047560192, "percent": 86.7, "used": 58725949440, "free": 9047560192}, "host_cpu_percent": 12.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23945, 24463, 59, 32.65, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072584.393891, "monotonic": 527316.578, "host_memory": {"total": 67773509632, "available": 9069629440, "percent": 86.6, "used": 58703880192, "free": 9069629440}, "host_cpu_percent": 12.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23945, 24463, 59, 32.69, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072585.4583108, "monotonic": 527317.64, "host_memory": {"total": 67773509632, "available": 9082777600, "percent": 86.6, "used": 58690732032, "free": 9082777600}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23945, 24463, 59, 33.28, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072586.5220072, "monotonic": 527318.703, "host_memory": {"total": 67773509632, "available": 9120559104, "percent": 86.5, "used": 58652950528, "free": 9120559104}, "host_cpu_percent": 14.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23945, 24463, 59, 32.39, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072587.5789723, "monotonic": 527319.765, "host_memory": {"total": 67773509632, "available": 9128280064, "percent": 86.5, "used": 58645229568, "free": 9128280064}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23945, 24463, 59, 33.24, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072588.6475348, "monotonic": 527320.828, "host_memory": {"total": 67773509632, "available": 9134723072, "percent": 86.5, "used": 58638786560, "free": 9134723072}, "host_cpu_percent": 9.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23945, 24463, 59, 32.93, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072589.7110748, "monotonic": 527321.89, "host_memory": {"total": 67773509632, "available": 9131610112, "percent": 86.5, "used": 58641899520, "free": 9131610112}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23957, 24463, 59, 32.90, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072590.7673206, "monotonic": 527322.953, "host_memory": {"total": 67773509632, "available": 9136685056, "percent": 86.5, "used": 58636824576, "free": 9136685056}, "host_cpu_percent": 14.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23957, 24463, 59, 33.07, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072591.8313596, "monotonic": 527324.015, "host_memory": {"total": 67773509632, "available": 9123278848, "percent": 86.5, "used": 58650230784, "free": 9123278848}, "host_cpu_percent": 11.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23957, 24463, 59, 33.33, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072592.8911953, "monotonic": 527325.078, "host_memory": {"total": 67773509632, "available": 9139560448, "percent": 86.5, "used": 58633949184, "free": 9139560448}, "host_cpu_percent": 11.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23957, 24463, 59, 32.99, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072593.951846, "monotonic": 527326.14, "host_memory": {"total": 67773509632, "available": 9161076736, "percent": 86.5, "used": 58612432896, "free": 9161076736}, "host_cpu_percent": 11.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23957, 24463, 59, 32.97, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072595.027583, "monotonic": 527327.203, "host_memory": {"total": 67773509632, "available": 9162436608, "percent": 86.5, "used": 58611073024, "free": 9162436608}, "host_cpu_percent": 16.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23953, 24463, 59, 33.21, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072596.1034942, "monotonic": 527328.281, "host_memory": {"total": 67773509632, "available": 9160232960, "percent": 86.5, "used": 58613276672, "free": 9160232960}, "host_cpu_percent": 11.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23953, 24463, 59, 33.01, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072597.1651146, "monotonic": 527329.343, "host_memory": {"total": 67773509632, "available": 9171574784, "percent": 86.5, "used": 58601934848, "free": 9171574784}, "host_cpu_percent": 21.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23953, 24463, 59, 32.98, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072598.2294085, "monotonic": 527330.406, "host_memory": {"total": 67773509632, "available": 9165873152, "percent": 86.5, "used": 58607636480, "free": 9165873152}, "host_cpu_percent": 14.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 33.02, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072599.291018, "monotonic": 527331.468, "host_memory": {"total": 67773509632, "available": 9167532032, "percent": 86.5, "used": 58605977600, "free": 9167532032}, "host_cpu_percent": 18.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 32.91, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072600.356238, "monotonic": 527332.531, "host_memory": {"total": 67773509632, "available": 9164247040, "percent": 86.5, "used": 58609262592, "free": 9164247040}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 32.93, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072601.4250565, "monotonic": 527333.609, "host_memory": {"total": 67773509632, "available": 9156960256, "percent": 86.5, "used": 58616549376, "free": 9156960256}, "host_cpu_percent": 16.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 32.98, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072602.4951108, "monotonic": 527334.671, "host_memory": {"total": 67773509632, "available": 9151455232, "percent": 86.5, "used": 58622054400, "free": 9151455232}, "host_cpu_percent": 13.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 33.02, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072603.5669248, "monotonic": 527335.75, "host_memory": {"total": 67773509632, "available": 9154072576, "percent": 86.5, "used": 58619437056, "free": 9154072576}, "host_cpu_percent": 12.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 33.15, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072604.6331537, "monotonic": 527336.812, "host_memory": {"total": 67773509632, "available": 9156251648, "percent": 86.5, "used": 58617257984, "free": 9156251648}, "host_cpu_percent": 10.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 32.19, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072605.6920726, "monotonic": 527337.875, "host_memory": {"total": 67773509632, "available": 9153564672, "percent": 86.5, "used": 58619944960, "free": 9153564672}, "host_cpu_percent": 11.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 33.00, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072606.7498913, "monotonic": 527338.937, "host_memory": {"total": 67773509632, "available": 9121046528, "percent": 86.5, "used": 58652463104, "free": 9121046528}, "host_cpu_percent": 13.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 33.14, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072607.8097441, "monotonic": 527339.984, "host_memory": {"total": 67773509632, "available": 9118425088, "percent": 86.5, "used": 58655084544, "free": 9118425088}, "host_cpu_percent": 16.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 32.83, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072608.8740904, "monotonic": 527341.062, "host_memory": {"total": 67773509632, "available": 9147473920, "percent": 86.5, "used": 58626035712, "free": 9147473920}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 33.05, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072609.94059, "monotonic": 527342.125, "host_memory": {"total": 67773509632, "available": 9140289536, "percent": 86.5, "used": 58633220096, "free": 9140289536}, "host_cpu_percent": 10.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23951, 24463, 59, 32.89, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072611.0116806, "monotonic": 527343.187, "host_memory": {"total": 67773509632, "available": 9130799104, "percent": 86.5, "used": 58642710528, "free": 9130799104}, "host_cpu_percent": 20.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23951, 24463, 59, 33.04, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072612.0774183, "monotonic": 527344.265, "host_memory": {"total": 67773509632, "available": 9124868096, "percent": 86.5, "used": 58648641536, "free": 9124868096}, "host_cpu_percent": 31.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23951, 24463, 59, 33.07, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072613.1344392, "monotonic": 527345.312, "host_memory": {"total": 67773509632, "available": 9140514816, "percent": 86.5, "used": 58632994816, "free": 9140514816}, "host_cpu_percent": 13.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23951, 24463, 59, 33.84, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072614.192, "monotonic": 527346.375, "host_memory": {"total": 67773509632, "available": 9127796736, "percent": 86.5, "used": 58645712896, "free": 9127796736}, "host_cpu_percent": 11.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23951, 24463, 59, 33.99, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072615.2586577, "monotonic": 527347.437, "host_memory": {"total": 67773509632, "available": 9109778432, "percent": 86.6, "used": 58663731200, "free": 9109778432}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23951, 24463, 59, 32.95, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072616.3094337, "monotonic": 527348.484, "host_memory": {"total": 67773509632, "available": 9054842880, "percent": 86.6, "used": 58718666752, "free": 9054842880}, "host_cpu_percent": 13.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 33.71, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072617.372738, "monotonic": 527349.562, "host_memory": {"total": 67773509632, "available": 9055948800, "percent": 86.6, "used": 58717560832, "free": 9055948800}, "host_cpu_percent": 15.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 33.27, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072618.4308753, "monotonic": 527350.609, "host_memory": {"total": 67773509632, "available": 9043853312, "percent": 86.7, "used": 58729656320, "free": 9043853312}, "host_cpu_percent": 18.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 32.30, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072619.50259, "monotonic": 527351.687, "host_memory": {"total": 67773509632, "available": 9064390656, "percent": 86.6, "used": 58709118976, "free": 9064390656}, "host_cpu_percent": 9.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 33.04, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072620.5618315, "monotonic": 527352.75, "host_memory": {"total": 67773509632, "available": 9064112128, "percent": 86.6, "used": 58709397504, "free": 9064112128}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 32.90, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072621.6236682, "monotonic": 527353.812, "host_memory": {"total": 67773509632, "available": 9058590720, "percent": 86.6, "used": 58714918912, "free": 9058590720}, "host_cpu_percent": 16.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23944, 24463, 59, 33.01, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072622.6772175, "monotonic": 527354.859, "host_memory": {"total": 67773509632, "available": 9057230848, "percent": 86.6, "used": 58716278784, "free": 9057230848}, "host_cpu_percent": 15.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23945, 24463, 59, 32.48, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072623.754047, "monotonic": 527355.937, "host_memory": {"total": 67773509632, "available": 9066520576, "percent": 86.6, "used": 58706989056, "free": 9066520576}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23945, 24463, 58, 32.91, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072624.8187275, "monotonic": 527357.0, "host_memory": {"total": 67773509632, "available": 9053237248, "percent": 86.6, "used": 58720272384, "free": 9053237248}, "host_cpu_percent": 10.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.99, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072625.8782985, "monotonic": 527358.062, "host_memory": {"total": 67773509632, "available": 9046200320, "percent": 86.7, "used": 58727309312, "free": 9046200320}, "host_cpu_percent": 12.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.81, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072626.9467762, "monotonic": 527359.125, "host_memory": {"total": 67773509632, "available": 9063010304, "percent": 86.6, "used": 58710499328, "free": 9063010304}, "host_cpu_percent": 11.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.72, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072628.0050464, "monotonic": 527360.187, "host_memory": {"total": 67773509632, "available": 9059573760, "percent": 86.6, "used": 58713935872, "free": 9059573760}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.92, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072629.063286, "monotonic": 527361.25, "host_memory": {"total": 67773509632, "available": 9058402304, "percent": 86.6, "used": 58715107328, "free": 9058402304}, "host_cpu_percent": 10.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.98, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072630.1298175, "monotonic": 527362.312, "host_memory": {"total": 67773509632, "available": 9072119808, "percent": 86.6, "used": 58701389824, "free": 9072119808}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.07, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072631.1880503, "monotonic": 527363.375, "host_memory": {"total": 67773509632, "available": 9066348544, "percent": 86.6, "used": 58707161088, "free": 9066348544}, "host_cpu_percent": 9.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.93, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072632.2496195, "monotonic": 527364.437, "host_memory": {"total": 67773509632, "available": 9064497152, "percent": 86.6, "used": 58709012480, "free": 9064497152}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.82, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072633.3105738, "monotonic": 527365.5, "host_memory": {"total": 67773509632, "available": 9063919616, "percent": 86.6, "used": 58709590016, "free": 9063919616}, "host_cpu_percent": 18.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 34.30, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072634.381629, "monotonic": 527366.562, "host_memory": {"total": 67773509632, "available": 9054265344, "percent": 86.6, "used": 58719244288, "free": 9054265344}, "host_cpu_percent": 24.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.17, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072635.4547129, "monotonic": 527367.64, "host_memory": {"total": 67773509632, "available": 9053179904, "percent": 86.6, "used": 58720329728, "free": 9053179904}, "host_cpu_percent": 19.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.24, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072636.5116186, "monotonic": 527368.687, "host_memory": {"total": 67773509632, "available": 9056927744, "percent": 86.6, "used": 58716581888, "free": 9056927744}, "host_cpu_percent": 19.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.10, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072637.5929272, "monotonic": 527369.781, "host_memory": {"total": 67773509632, "available": 9050763264, "percent": 86.6, "used": 58722746368, "free": 9050763264}, "host_cpu_percent": 15.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.00, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072638.660713, "monotonic": 527370.843, "host_memory": {"total": 67773509632, "available": 9058070528, "percent": 86.6, "used": 58715439104, "free": 9058070528}, "host_cpu_percent": 9.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.02, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072639.7233317, "monotonic": 527371.906, "host_memory": {"total": 67773509632, "available": 9058705408, "percent": 86.6, "used": 58714804224, "free": 9058705408}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072640.7919226, "monotonic": 527372.968, "host_memory": {"total": 67773509632, "available": 9039671296, "percent": 86.7, "used": 58733838336, "free": 9039671296}, "host_cpu_percent": 12.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.65, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072641.8525348, "monotonic": 527374.031, "host_memory": {"total": 67773509632, "available": 9031135232, "percent": 86.7, "used": 58742374400, "free": 9031135232}, "host_cpu_percent": 17.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.79, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072642.9331903, "monotonic": 527375.109, "host_memory": {"total": 67773509632, "available": 9041948672, "percent": 86.7, "used": 58731560960, "free": 9041948672}, "host_cpu_percent": 15.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.77, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072644.005829, "monotonic": 527376.187, "host_memory": {"total": 67773509632, "available": 9023913984, "percent": 86.7, "used": 58749595648, "free": 9023913984}, "host_cpu_percent": 28.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072645.0740438, "monotonic": 527377.25, "host_memory": {"total": 67773509632, "available": 9041965056, "percent": 86.7, "used": 58731544576, "free": 9041965056}, "host_cpu_percent": 22.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.03, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072646.1489072, "monotonic": 527378.328, "host_memory": {"total": 67773509632, "available": 9051082752, "percent": 86.6, "used": 58722426880, "free": 9051082752}, "host_cpu_percent": 12.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.01, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072647.2090697, "monotonic": 527379.39, "host_memory": {"total": 67773509632, "available": 9062449152, "percent": 86.6, "used": 58711060480, "free": 9062449152}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.85, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072648.265255, "monotonic": 527380.453, "host_memory": {"total": 67773509632, "available": 9057865728, "percent": 86.6, "used": 58715643904, "free": 9057865728}, "host_cpu_percent": 13.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.96, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072649.3272543, "monotonic": 527381.515, "host_memory": {"total": 67773509632, "available": 9056743424, "percent": 86.6, "used": 58716766208, "free": 9056743424}, "host_cpu_percent": 14.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 33.04, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072650.3914247, "monotonic": 527382.578, "host_memory": {"total": 67773509632, "available": 9150672896, "percent": 86.5, "used": 58622836736, "free": 9150672896}, "host_cpu_percent": 14.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.91, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072651.4531107, "monotonic": 527383.64, "host_memory": {"total": 67773509632, "available": 9173856256, "percent": 86.5, "used": 58599653376, "free": 9173856256}, "host_cpu_percent": 9.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 33.14, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072652.5131736, "monotonic": 527384.703, "host_memory": {"total": 67773509632, "available": 9185751040, "percent": 86.4, "used": 58587758592, "free": 9185751040}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.83, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072653.5778182, "monotonic": 527385.765, "host_memory": {"total": 67773509632, "available": 9193361408, "percent": 86.4, "used": 58580148224, "free": 9193361408}, "host_cpu_percent": 15.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23963, 24463, 58, 32.53, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072654.6501637, "monotonic": 527386.828, "host_memory": {"total": 67773509632, "available": 9186656256, "percent": 86.4, "used": 58586853376, "free": 9186656256}, "host_cpu_percent": 17.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23963, 24463, 58, 32.96, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072655.7087271, "monotonic": 527387.89, "host_memory": {"total": 67773509632, "available": 9184890880, "percent": 86.4, "used": 58588618752, "free": 9184890880}, "host_cpu_percent": 9.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23963, 24463, 58, 32.98, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072656.772827, "monotonic": 527388.953, "host_memory": {"total": 67773509632, "available": 9169801216, "percent": 86.5, "used": 58603708416, "free": 9169801216}, "host_cpu_percent": 10.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.95, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072657.8337004, "monotonic": 527390.015, "host_memory": {"total": 67773509632, "available": 9166499840, "percent": 86.5, "used": 58607009792, "free": 9166499840}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.69, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072658.8971126, "monotonic": 527391.078, "host_memory": {"total": 67773509632, "available": 9167974400, "percent": 86.5, "used": 58605535232, "free": 9167974400}, "host_cpu_percent": 8.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.97, 1597, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072659.9578025, "monotonic": 527392.14, "host_memory": {"total": 67773509632, "available": 9170051072, "percent": 86.5, "used": 58603458560, "free": 9170051072}, "host_cpu_percent": 9.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.96, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072661.0154886, "monotonic": 527393.203, "host_memory": {"total": 67773509632, "available": 9171922944, "percent": 86.5, "used": 58601586688, "free": 9171922944}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.17, 1590, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072662.0760324, "monotonic": 527394.265, "host_memory": {"total": 67773509632, "available": 9170780160, "percent": 86.5, "used": 58602729472, "free": 9170780160}, "host_cpu_percent": 11.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.17, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072663.1349463, "monotonic": 527395.312, "host_memory": {"total": 67773509632, "available": 9188519936, "percent": 86.4, "used": 58584989696, "free": 9188519936}, "host_cpu_percent": 11.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.49, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072664.1988096, "monotonic": 527396.375, "host_memory": {"total": 67773509632, "available": 9184747520, "percent": 86.4, "used": 58588762112, "free": 9184747520}, "host_cpu_percent": 13.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.71, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072665.2619364, "monotonic": 527397.437, "host_memory": {"total": 67773509632, "available": 9181634560, "percent": 86.5, "used": 58591875072, "free": 9181634560}, "host_cpu_percent": 17.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.70, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072666.317929, "monotonic": 527398.5, "host_memory": {"total": 67773509632, "available": 9177608192, "percent": 86.5, "used": 58595901440, "free": 9177608192}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.97, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072667.3795516, "monotonic": 527399.562, "host_memory": {"total": 67773509632, "available": 9173893120, "percent": 86.5, "used": 58599616512, "free": 9173893120}, "host_cpu_percent": 14.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.92, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072668.4363763, "monotonic": 527400.625, "host_memory": {"total": 67773509632, "available": 9168646144, "percent": 86.5, "used": 58604863488, "free": 9168646144}, "host_cpu_percent": 9.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.96, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072669.4967198, "monotonic": 527401.671, "host_memory": {"total": 67773509632, "available": 9167278080, "percent": 86.5, "used": 58606231552, "free": 9167278080}, "host_cpu_percent": 10.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.04, 1635, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072670.5562122, "monotonic": 527402.734, "host_memory": {"total": 67773509632, "available": 9150681088, "percent": 86.5, "used": 58622828544, "free": 9150681088}, "host_cpu_percent": 14.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.94, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072671.6176908, "monotonic": 527403.796, "host_memory": {"total": 67773509632, "available": 9164750848, "percent": 86.5, "used": 58608758784, "free": 9164750848}, "host_cpu_percent": 20.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.18, 1635, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072672.6796196, "monotonic": 527404.859, "host_memory": {"total": 67773509632, "available": 9165774848, "percent": 86.5, "used": 58607734784, "free": 9165774848}, "host_cpu_percent": 14.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.86, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072673.7403245, "monotonic": 527405.921, "host_memory": {"total": 67773509632, "available": 9172287488, "percent": 86.5, "used": 58601222144, "free": 9172287488}, "host_cpu_percent": 11.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.16, 1627, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072674.8024852, "monotonic": 527406.984, "host_memory": {"total": 67773509632, "available": 9158639616, "percent": 86.5, "used": 58614870016, "free": 9158639616}, "host_cpu_percent": 13.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.12, 1597, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072675.8654835, "monotonic": 527408.046, "host_memory": {"total": 67773509632, "available": 9162596352, "percent": 86.5, "used": 58610913280, "free": 9162596352}, "host_cpu_percent": 11.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.95, 1620, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072676.92629, "monotonic": 527409.109, "host_memory": {"total": 67773509632, "available": 9192919040, "percent": 86.4, "used": 58580590592, "free": 9192919040}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.98, 1612, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072677.9903312, "monotonic": 527410.171, "host_memory": {"total": 67773509632, "available": 9189826560, "percent": 86.4, "used": 58583683072, "free": 9189826560}, "host_cpu_percent": 9.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.96, 1620, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072679.0505495, "monotonic": 527411.234, "host_memory": {"total": 67773509632, "available": 9188732928, "percent": 86.4, "used": 58584776704, "free": 9188732928}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.41, 1597, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072680.1095536, "monotonic": 527412.296, "host_memory": {"total": 67773509632, "available": 9186979840, "percent": 86.4, "used": 58586529792, "free": 9186979840}, "host_cpu_percent": 8.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.26, 1597, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072681.1616366, "monotonic": 527413.343, "host_memory": {"total": 67773509632, "available": 9203445760, "percent": 86.4, "used": 58570063872, "free": 9203445760}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.92, 1597, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072682.2235827, "monotonic": 527414.406, "host_memory": {"total": 67773509632, "available": 9205346304, "percent": 86.4, "used": 58568163328, "free": 9205346304}, "host_cpu_percent": 11.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.88, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072683.29024, "monotonic": 527415.468, "host_memory": {"total": 67773509632, "available": 9199570944, "percent": 86.4, "used": 58573938688, "free": 9199570944}, "host_cpu_percent": 10.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.45, 1635, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072684.3541198, "monotonic": 527416.531, "host_memory": {"total": 67773509632, "available": 9205727232, "percent": 86.4, "used": 58567782400, "free": 9205727232}, "host_cpu_percent": 10.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.01, 1620, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072685.411058, "monotonic": 527417.593, "host_memory": {"total": 67773509632, "available": 9211871232, "percent": 86.4, "used": 58561638400, "free": 9211871232}, "host_cpu_percent": 14.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.92, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072686.472899, "monotonic": 527418.656, "host_memory": {"total": 67773509632, "available": 9214615552, "percent": 86.4, "used": 58558894080, "free": 9214615552}, "host_cpu_percent": 14.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 34.71, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072687.5358853, "monotonic": 527419.718, "host_memory": {"total": 67773509632, "available": 9221992448, "percent": 86.4, "used": 58551517184, "free": 9221992448}, "host_cpu_percent": 12.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.94, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072688.589881, "monotonic": 527420.765, "host_memory": {"total": 67773509632, "available": 9227448320, "percent": 86.4, "used": 58546061312, "free": 9227448320}, "host_cpu_percent": 9.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.86, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072689.6548846, "monotonic": 527421.843, "host_memory": {"total": 67773509632, "available": 9219665920, "percent": 86.4, "used": 58553843712, "free": 9219665920}, "host_cpu_percent": 9.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072690.7189946, "monotonic": 527422.906, "host_memory": {"total": 67773509632, "available": 9221767168, "percent": 86.4, "used": 58551742464, "free": 9221767168}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.94, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072691.7797637, "monotonic": 527423.968, "host_memory": {"total": 67773509632, "available": 9209626624, "percent": 86.4, "used": 58563883008, "free": 9209626624}, "host_cpu_percent": 9.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.19, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072692.8394618, "monotonic": 527425.015, "host_memory": {"total": 67773509632, "available": 9208057856, "percent": 86.4, "used": 58565451776, "free": 9208057856}, "host_cpu_percent": 12.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.00, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072693.9054499, "monotonic": 527426.093, "host_memory": {"total": 67773509632, "available": 9211310080, "percent": 86.4, "used": 58562199552, "free": 9211310080}, "host_cpu_percent": 12.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.92, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072694.9656541, "monotonic": 527427.14, "host_memory": {"total": 67773509632, "available": 9215287296, "percent": 86.4, "used": 58558222336, "free": 9215287296}, "host_cpu_percent": 12.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1710, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072696.0334554, "monotonic": 527428.218, "host_memory": {"total": 67773509632, "available": 9208377344, "percent": 86.4, "used": 58565132288, "free": 9208377344}, "host_cpu_percent": 18.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.88, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072697.1068206, "monotonic": 527429.296, "host_memory": {"total": 67773509632, "available": 9207877632, "percent": 86.4, "used": 58565632000, "free": 9207877632}, "host_cpu_percent": 24.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.95, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072698.1673791, "monotonic": 527430.343, "host_memory": {"total": 67773509632, "available": 9208791040, "percent": 86.4, "used": 58564718592, "free": 9208791040}, "host_cpu_percent": 21.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.84, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072699.2293143, "monotonic": 527431.406, "host_memory": {"total": 67773509632, "available": 9213206528, "percent": 86.4, "used": 58560303104, "free": 9213206528}, "host_cpu_percent": 17.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.69, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072700.2895007, "monotonic": 527432.468, "host_memory": {"total": 67773509632, "available": 9216151552, "percent": 86.4, "used": 58557358080, "free": 9216151552}, "host_cpu_percent": 12.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.31, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072701.3530257, "monotonic": 527433.531, "host_memory": {"total": 67773509632, "available": 9242386432, "percent": 86.4, "used": 58531123200, "free": 9242386432}, "host_cpu_percent": 14.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.55, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072702.4110193, "monotonic": 527434.593, "host_memory": {"total": 67773509632, "available": 9219997696, "percent": 86.4, "used": 58553511936, "free": 9219997696}, "host_cpu_percent": 15.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072703.4753335, "monotonic": 527435.656, "host_memory": {"total": 67773509632, "available": 9221079040, "percent": 86.4, "used": 58552430592, "free": 9221079040}, "host_cpu_percent": 15.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.65, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072704.535351, "monotonic": 527436.718, "host_memory": {"total": 67773509632, "available": 9357819904, "percent": 86.2, "used": 58415689728, "free": 9357819904}, "host_cpu_percent": 13.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.06, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072705.598979, "monotonic": 527437.781, "host_memory": {"total": 67773509632, "available": 9366458368, "percent": 86.2, "used": 58407051264, "free": 9366458368}, "host_cpu_percent": 11.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072706.6779327, "monotonic": 527438.859, "host_memory": {"total": 67773509632, "available": 9376870400, "percent": 86.2, "used": 58396639232, "free": 9376870400}, "host_cpu_percent": 11.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.84, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072707.7343147, "monotonic": 527439.921, "host_memory": {"total": 67773509632, "available": 9388892160, "percent": 86.1, "used": 58384617472, "free": 9388892160}, "host_cpu_percent": 9.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.93, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072708.7947152, "monotonic": 527440.984, "host_memory": {"total": 67773509632, "available": 9380229120, "percent": 86.2, "used": 58393280512, "free": 9380229120}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.94, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072709.8634393, "monotonic": 527442.046, "host_memory": {"total": 67773509632, "available": 9386455040, "percent": 86.2, "used": 58387054592, "free": 9386455040}, "host_cpu_percent": 19.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 33.08, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072710.928275, "monotonic": 527443.109, "host_memory": {"total": 67773509632, "available": 9388371968, "percent": 86.1, "used": 58385137664, "free": 9388371968}, "host_cpu_percent": 24.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.93, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072711.989419, "monotonic": 527444.171, "host_memory": {"total": 67773509632, "available": 9392803840, "percent": 86.1, "used": 58380705792, "free": 9392803840}, "host_cpu_percent": 15.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.94, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072713.0560787, "monotonic": 527445.234, "host_memory": {"total": 67773509632, "available": 9383903232, "percent": 86.2, "used": 58389606400, "free": 9383903232}, "host_cpu_percent": 18.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 33.31, 1710, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072714.1219614, "monotonic": 527446.296, "host_memory": {"total": 67773509632, "available": 9383526400, "percent": 86.2, "used": 58389983232, "free": 9383526400}, "host_cpu_percent": 13.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.93, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072715.2005777, "monotonic": 527447.39, "host_memory": {"total": 67773509632, "available": 9390026752, "percent": 86.1, "used": 58383482880, "free": 9390026752}, "host_cpu_percent": 10.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.94, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072716.273644, "monotonic": 527448.453, "host_memory": {"total": 67773509632, "available": 9371648000, "percent": 86.2, "used": 58401861632, "free": 9371648000}, "host_cpu_percent": 14.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.97, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072717.3299117, "monotonic": 527449.515, "host_memory": {"total": 67773509632, "available": 9378062336, "percent": 86.2, "used": 58395447296, "free": 9378062336}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.25, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072718.3995783, "monotonic": 527450.578, "host_memory": {"total": 67773509632, "available": 9393917952, "percent": 86.1, "used": 58379591680, "free": 9393917952}, "host_cpu_percent": 18.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.53, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072719.4628398, "monotonic": 527451.64, "host_memory": {"total": 67773509632, "available": 9396912128, "percent": 86.1, "used": 58376597504, "free": 9396912128}, "host_cpu_percent": 20.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.84, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072720.5287704, "monotonic": 527452.718, "host_memory": {"total": 67773509632, "available": 9398489088, "percent": 86.1, "used": 58375020544, "free": 9398489088}, "host_cpu_percent": 23.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.97, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072721.587229, "monotonic": 527453.765, "host_memory": {"total": 67773509632, "available": 9400102912, "percent": 86.1, "used": 58373406720, "free": 9400102912}, "host_cpu_percent": 14.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.89, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072722.6627877, "monotonic": 527454.843, "host_memory": {"total": 67773509632, "available": 9391665152, "percent": 86.1, "used": 58381844480, "free": 9391665152}, "host_cpu_percent": 9.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 34.36, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072723.7171323, "monotonic": 527455.906, "host_memory": {"total": 67773509632, "available": 9394143232, "percent": 86.1, "used": 58379366400, "free": 9394143232}, "host_cpu_percent": 8.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.88, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072724.7814453, "monotonic": 527456.968, "host_memory": {"total": 67773509632, "available": 9376628736, "percent": 86.2, "used": 58396880896, "free": 9376628736}, "host_cpu_percent": 10.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.90, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072725.8522148, "monotonic": 527458.031, "host_memory": {"total": 67773509632, "available": 9381830656, "percent": 86.2, "used": 58391678976, "free": 9381830656}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.97, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072726.9246473, "monotonic": 527459.109, "host_memory": {"total": 67773509632, "available": 9378525184, "percent": 86.2, "used": 58394984448, "free": 9378525184}, "host_cpu_percent": 15.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.21, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072727.998971, "monotonic": 527460.187, "host_memory": {"total": 67773509632, "available": 9384919040, "percent": 86.2, "used": 58388590592, "free": 9384919040}, "host_cpu_percent": 12.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.01, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072729.062466, "monotonic": 527461.25, "host_memory": {"total": 67773509632, "available": 9372930048, "percent": 86.2, "used": 58400579584, "free": 9372930048}, "host_cpu_percent": 9.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.67, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072730.1375196, "monotonic": 527462.312, "host_memory": {"total": 67773509632, "available": 9388109824, "percent": 86.1, "used": 58385399808, "free": 9388109824}, "host_cpu_percent": 9.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.98, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072731.2042623, "monotonic": 527463.39, "host_memory": {"total": 67773509632, "available": 9387167744, "percent": 86.1, "used": 58386341888, "free": 9387167744}, "host_cpu_percent": 9.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.90, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072732.275435, "monotonic": 527464.453, "host_memory": {"total": 67773509632, "available": 9392308224, "percent": 86.1, "used": 58381201408, "free": 9392308224}, "host_cpu_percent": 13.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.02, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072733.3554575, "monotonic": 527465.531, "host_memory": {"total": 67773509632, "available": 9378533376, "percent": 86.2, "used": 58394976256, "free": 9378533376}, "host_cpu_percent": 10.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.02, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072734.4283023, "monotonic": 527466.609, "host_memory": {"total": 67773509632, "available": 9382490112, "percent": 86.2, "used": 58391019520, "free": 9382490112}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.00, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072735.4977481, "monotonic": 527467.687, "host_memory": {"total": 67773509632, "available": 9378504704, "percent": 86.2, "used": 58395004928, "free": 9378504704}, "host_cpu_percent": 16.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.95, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072736.5544848, "monotonic": 527468.734, "host_memory": {"total": 67773509632, "available": 9375252480, "percent": 86.2, "used": 58398257152, "free": 9375252480}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.81, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072737.6233227, "monotonic": 527469.812, "host_memory": {"total": 67773509632, "available": 9367064576, "percent": 86.2, "used": 58406445056, "free": 9367064576}, "host_cpu_percent": 24.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.50, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072738.7002075, "monotonic": 527470.875, "host_memory": {"total": 67773509632, "available": 9368051712, "percent": 86.2, "used": 58405457920, "free": 9368051712}, "host_cpu_percent": 12.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.50, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072739.756894, "monotonic": 527471.937, "host_memory": {"total": 67773509632, "available": 9363951616, "percent": 86.2, "used": 58409558016, "free": 9363951616}, "host_cpu_percent": 19.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.97, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072740.8185284, "monotonic": 527473.0, "host_memory": {"total": 67773509632, "available": 9364512768, "percent": 86.2, "used": 58408996864, "free": 9364512768}, "host_cpu_percent": 10.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.99, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072741.8796258, "monotonic": 527474.062, "host_memory": {"total": 67773509632, "available": 9355632640, "percent": 86.2, "used": 58417876992, "free": 9355632640}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.92, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072742.9395013, "monotonic": 527475.125, "host_memory": {"total": 67773509632, "available": 9352351744, "percent": 86.2, "used": 58421157888, "free": 9352351744}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072744.0008323, "monotonic": 527476.187, "host_memory": {"total": 67773509632, "available": 9345744896, "percent": 86.2, "used": 58427764736, "free": 9345744896}, "host_cpu_percent": 9.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072745.0660334, "monotonic": 527477.25, "host_memory": {"total": 67773509632, "available": 9352445952, "percent": 86.2, "used": 58421063680, "free": 9352445952}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.00, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072746.1230578, "monotonic": 527478.312, "host_memory": {"total": 67773509632, "available": 9355296768, "percent": 86.2, "used": 58418212864, "free": 9355296768}, "host_cpu_percent": 11.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.90, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072747.1837456, "monotonic": 527479.359, "host_memory": {"total": 67773509632, "available": 9358086144, "percent": 86.2, "used": 58415423488, "free": 9358086144}, "host_cpu_percent": 15.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.00, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072748.2444184, "monotonic": 527480.421, "host_memory": {"total": 67773509632, "available": 9355415552, "percent": 86.2, "used": 58418094080, "free": 9355415552}, "host_cpu_percent": 13.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.82, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072749.2971609, "monotonic": 527481.484, "host_memory": {"total": 67773509632, "available": 9346691072, "percent": 86.2, "used": 58426818560, "free": 9346691072}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.90, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072750.3656824, "monotonic": 527482.546, "host_memory": {"total": 67773509632, "available": 9359859712, "percent": 86.2, "used": 58413649920, "free": 9359859712}, "host_cpu_percent": 11.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.65, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072751.439296, "monotonic": 527483.625, "host_memory": {"total": 67773509632, "available": 9358036992, "percent": 86.2, "used": 58415472640, "free": 9358036992}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.03, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072752.5017333, "monotonic": 527484.687, "host_memory": {"total": 67773509632, "available": 9354842112, "percent": 86.2, "used": 58418667520, "free": 9354842112}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.33, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072753.5675268, "monotonic": 527485.75, "host_memory": {"total": 67773509632, "available": 9360805888, "percent": 86.2, "used": 58412703744, "free": 9360805888}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.03, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072754.6377783, "monotonic": 527486.812, "host_memory": {"total": 67773509632, "available": 9361043456, "percent": 86.2, "used": 58412466176, "free": 9361043456}, "host_cpu_percent": 10.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.15, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072755.7045376, "monotonic": 527487.89, "host_memory": {"total": 67773509632, "available": 9368469504, "percent": 86.2, "used": 58405040128, "free": 9368469504}, "host_cpu_percent": 13.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.92, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072756.7620144, "monotonic": 527488.937, "host_memory": {"total": 67773509632, "available": 9366990848, "percent": 86.2, "used": 58406518784, "free": 9366990848}, "host_cpu_percent": 23.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.87, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072757.837924, "monotonic": 527490.015, "host_memory": {"total": 67773509632, "available": 9343127552, "percent": 86.2, "used": 58430382080, "free": 9343127552}, "host_cpu_percent": 16.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.98, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072758.8949678, "monotonic": 527491.078, "host_memory": {"total": 67773509632, "available": 9340248064, "percent": 86.2, "used": 58433261568, "free": 9340248064}, "host_cpu_percent": 12.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.15, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072759.9604273, "monotonic": 527492.14, "host_memory": {"total": 67773509632, "available": 9347928064, "percent": 86.2, "used": 58425581568, "free": 9347928064}, "host_cpu_percent": 11.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.90, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072761.0246508, "monotonic": 527493.203, "host_memory": {"total": 67773509632, "available": 9346924544, "percent": 86.2, "used": 58426585088, "free": 9346924544}, "host_cpu_percent": 15.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.94, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072762.1088738, "monotonic": 527494.296, "host_memory": {"total": 67773509632, "available": 9351507968, "percent": 86.2, "used": 58422001664, "free": 9351507968}, "host_cpu_percent": 19.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.29, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072763.18323, "monotonic": 527495.359, "host_memory": {"total": 67773509632, "available": 9349341184, "percent": 86.2, "used": 58424168448, "free": 9349341184}, "host_cpu_percent": 12.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.71, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072764.2420914, "monotonic": 527496.421, "host_memory": {"total": 67773509632, "available": 9345196032, "percent": 86.2, "used": 58428313600, "free": 9345196032}, "host_cpu_percent": 23.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.55, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072765.3090293, "monotonic": 527497.484, "host_memory": {"total": 67773509632, "available": 9361305600, "percent": 86.2, "used": 58412204032, "free": 9361305600}, "host_cpu_percent": 13.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072766.3679326, "monotonic": 527498.546, "host_memory": {"total": 67773509632, "available": 9358491648, "percent": 86.2, "used": 58415017984, "free": 9358491648}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.94, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072767.425744, "monotonic": 527499.609, "host_memory": {"total": 67773509632, "available": 9366319104, "percent": 86.2, "used": 58407190528, "free": 9366319104}, "host_cpu_percent": 9.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.14, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072768.4913404, "monotonic": 527500.671, "host_memory": {"total": 67773509632, "available": 9365049344, "percent": 86.2, "used": 58408460288, "free": 9365049344}, "host_cpu_percent": 14.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 34.60, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072769.5495565, "monotonic": 527501.734, "host_memory": {"total": 67773509632, "available": 9374978048, "percent": 86.2, "used": 58398531584, "free": 9374978048}, "host_cpu_percent": 11.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.88, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072770.6179771, "monotonic": 527502.796, "host_memory": {"total": 67773509632, "available": 9389899776, "percent": 86.1, "used": 58383609856, "free": 9389899776}, "host_cpu_percent": 13.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 33.26, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072771.674846, "monotonic": 527503.859, "host_memory": {"total": 67773509632, "available": 9395892224, "percent": 86.1, "used": 58377617408, "free": 9395892224}, "host_cpu_percent": 12.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.97, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072772.7363713, "monotonic": 527504.921, "host_memory": {"total": 67773509632, "available": 9392955392, "percent": 86.1, "used": 58380554240, "free": 9392955392}, "host_cpu_percent": 10.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.91, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072773.7955258, "monotonic": 527505.984, "host_memory": {"total": 67773509632, "available": 9526677504, "percent": 85.9, "used": 58246832128, "free": 9526677504}, "host_cpu_percent": 12.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23963, 24463, 58, 32.69, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072774.8698778, "monotonic": 527507.046, "host_memory": {"total": 67773509632, "available": 9528868864, "percent": 85.9, "used": 58244640768, "free": 9528868864}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23963, 24463, 58, 36.25, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072775.939908, "monotonic": 527508.125, "host_memory": {"total": 67773509632, "available": 9540595712, "percent": 85.9, "used": 58232913920, "free": 9540595712}, "host_cpu_percent": 10.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23963, 24463, 58, 32.89, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072777.0078225, "monotonic": 527509.187, "host_memory": {"total": 67773509632, "available": 9537601536, "percent": 85.9, "used": 58235908096, "free": 9537601536}, "host_cpu_percent": 11.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.01, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072778.0766523, "monotonic": 527510.265, "host_memory": {"total": 67773509632, "available": 9525420032, "percent": 85.9, "used": 58248089600, "free": 9525420032}, "host_cpu_percent": 21.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.48, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072779.1457267, "monotonic": 527511.328, "host_memory": {"total": 67773509632, "available": 9524817920, "percent": 85.9, "used": 58248691712, "free": 9524817920}, "host_cpu_percent": 14.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.18, 1710, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072780.214085, "monotonic": 527512.39, "host_memory": {"total": 67773509632, "available": 9510584320, "percent": 86.0, "used": 58262925312, "free": 9510584320}, "host_cpu_percent": 10.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.22, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072781.26968, "monotonic": 527513.453, "host_memory": {"total": 67773509632, "available": 9515511808, "percent": 86.0, "used": 58257997824, "free": 9515511808}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.97, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072782.3303833, "monotonic": 527514.515, "host_memory": {"total": 67773509632, "available": 9505206272, "percent": 86.0, "used": 58268303360, "free": 9505206272}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.94, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072783.3997853, "monotonic": 527515.578, "host_memory": {"total": 67773509632, "available": 9527353344, "percent": 85.9, "used": 58246156288, "free": 9527353344}, "host_cpu_percent": 12.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072784.4713218, "monotonic": 527516.656, "host_memory": {"total": 67773509632, "available": 9526972416, "percent": 85.9, "used": 58246537216, "free": 9526972416}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072785.5312378, "monotonic": 527517.718, "host_memory": {"total": 67773509632, "available": 9526104064, "percent": 85.9, "used": 58247405568, "free": 9526104064}, "host_cpu_percent": 9.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.69, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072786.5965283, "monotonic": 527518.781, "host_memory": {"total": 67773509632, "available": 9528655872, "percent": 85.9, "used": 58244853760, "free": 9528655872}, "host_cpu_percent": 12.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.89, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072787.6719842, "monotonic": 527519.859, "host_memory": {"total": 67773509632, "available": 9530552320, "percent": 85.9, "used": 58242957312, "free": 9530552320}, "host_cpu_percent": 14.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.44, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072788.7379735, "monotonic": 527520.921, "host_memory": {"total": 67773509632, "available": 9525235712, "percent": 85.9, "used": 58248273920, "free": 9525235712}, "host_cpu_percent": 9.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 34.31, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072789.79515, "monotonic": 527521.984, "host_memory": {"total": 67773509632, "available": 9525481472, "percent": 85.9, "used": 58248028160, "free": 9525481472}, "host_cpu_percent": 12.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.86, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072790.855977, "monotonic": 527523.031, "host_memory": {"total": 67773509632, "available": 9517842432, "percent": 86.0, "used": 58255667200, "free": 9517842432}, "host_cpu_percent": 16.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.10, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072791.9403834, "monotonic": 527524.125, "host_memory": {"total": 67773509632, "available": 9516589056, "percent": 86.0, "used": 58256920576, "free": 9516589056}, "host_cpu_percent": 16.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.01, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072793.0179868, "monotonic": 527525.203, "host_memory": {"total": 67773509632, "available": 9525276672, "percent": 85.9, "used": 58248232960, "free": 9525276672}, "host_cpu_percent": 12.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.37, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072794.0811176, "monotonic": 527526.265, "host_memory": {"total": 67773509632, "available": 9514078208, "percent": 86.0, "used": 58259431424, "free": 9514078208}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.72, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072795.1437898, "monotonic": 527527.328, "host_memory": {"total": 67773509632, "available": 9516986368, "percent": 86.0, "used": 58256523264, "free": 9516986368}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.31, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072796.2044384, "monotonic": 527528.39, "host_memory": {"total": 67773509632, "available": 9522016256, "percent": 86.0, "used": 58251493376, "free": 9522016256}, "host_cpu_percent": 11.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.89, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072797.2697, "monotonic": 527529.453, "host_memory": {"total": 67773509632, "available": 9519751168, "percent": 86.0, "used": 58253758464, "free": 9519751168}, "host_cpu_percent": 10.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.90, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072798.3270018, "monotonic": 527530.515, "host_memory": {"total": 67773509632, "available": 9518477312, "percent": 86.0, "used": 58255032320, "free": 9518477312}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.94, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072799.386745, "monotonic": 527531.562, "host_memory": {"total": 67773509632, "available": 9520209920, "percent": 86.0, "used": 58253299712, "free": 9520209920}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.25, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072800.4466035, "monotonic": 527532.625, "host_memory": {"total": 67773509632, "available": 9535111168, "percent": 85.9, "used": 58238398464, "free": 9535111168}, "host_cpu_percent": 20.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.16, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072801.5081956, "monotonic": 527533.687, "host_memory": {"total": 67773509632, "available": 9541828608, "percent": 85.9, "used": 58231681024, "free": 9541828608}, "host_cpu_percent": 12.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.37, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072802.5846643, "monotonic": 527534.765, "host_memory": {"total": 67773509632, "available": 9540128768, "percent": 85.9, "used": 58233380864, "free": 9540128768}, "host_cpu_percent": 8.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.89, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072803.6410735, "monotonic": 527535.828, "host_memory": {"total": 67773509632, "available": 9545850880, "percent": 85.9, "used": 58227658752, "free": 9545850880}, "host_cpu_percent": 8.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.48, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072804.7073867, "monotonic": 527536.89, "host_memory": {"total": 67773509632, "available": 9547816960, "percent": 85.9, "used": 58225692672, "free": 9547816960}, "host_cpu_percent": 11.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.95, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072805.7803473, "monotonic": 527537.968, "host_memory": {"total": 67773509632, "available": 9510649856, "percent": 86.0, "used": 58262859776, "free": 9510649856}, "host_cpu_percent": 12.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.01, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072806.8355513, "monotonic": 527539.015, "host_memory": {"total": 67773509632, "available": 9530011648, "percent": 85.9, "used": 58243497984, "free": 9530011648}, "host_cpu_percent": 12.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.90, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072807.8959463, "monotonic": 527540.078, "host_memory": {"total": 67773509632, "available": 9519648768, "percent": 86.0, "used": 58253860864, "free": 9519648768}, "host_cpu_percent": 11.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.03, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072808.977452, "monotonic": 527541.156, "host_memory": {"total": 67773509632, "available": 9529782272, "percent": 85.9, "used": 58243727360, "free": 9529782272}, "host_cpu_percent": 13.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072810.0334592, "monotonic": 527542.218, "host_memory": {"total": 67773509632, "available": 9537744896, "percent": 85.9, "used": 58235764736, "free": 9537744896}, "host_cpu_percent": 11.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.01, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072811.0943837, "monotonic": 527543.281, "host_memory": {"total": 67773509632, "available": 9540968448, "percent": 85.9, "used": 58232541184, "free": 9540968448}, "host_cpu_percent": 13.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.89, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072812.1568854, "monotonic": 527544.343, "host_memory": {"total": 67773509632, "available": 9536892928, "percent": 85.9, "used": 58236616704, "free": 9536892928}, "host_cpu_percent": 9.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.75, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072813.2332237, "monotonic": 527545.421, "host_memory": {"total": 67773509632, "available": 9539477504, "percent": 85.9, "used": 58234032128, "free": 9539477504}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.92, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072814.295523, "monotonic": 527546.484, "host_memory": {"total": 67773509632, "available": 9539821568, "percent": 85.9, "used": 58233688064, "free": 9539821568}, "host_cpu_percent": 9.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.92, 1635, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072815.358559, "monotonic": 527547.546, "host_memory": {"total": 67773509632, "available": 9542393856, "percent": 85.9, "used": 58231115776, "free": 9542393856}, "host_cpu_percent": 8.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.94, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072816.4216132, "monotonic": 527548.609, "host_memory": {"total": 67773509632, "available": 9537134592, "percent": 85.9, "used": 58236375040, "free": 9537134592}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.82, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072817.4887471, "monotonic": 527549.671, "host_memory": {"total": 67773509632, "available": 9534369792, "percent": 85.9, "used": 58239139840, "free": 9534369792}, "host_cpu_percent": 12.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.83, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072818.546591, "monotonic": 527550.734, "host_memory": {"total": 67773509632, "available": 9539604480, "percent": 85.9, "used": 58233905152, "free": 9539604480}, "host_cpu_percent": 10.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.59, 1597, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072819.6076925, "monotonic": 527551.796, "host_memory": {"total": 67773509632, "available": 9544245248, "percent": 85.9, "used": 58229264384, "free": 9544245248}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.62, 1582, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072820.6706617, "monotonic": 527552.859, "host_memory": {"total": 67773509632, "available": 9530302464, "percent": 85.9, "used": 58243207168, "free": 9530302464}, "host_cpu_percent": 20.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072821.7402115, "monotonic": 527553.921, "host_memory": {"total": 67773509632, "available": 9548701696, "percent": 85.9, "used": 58224807936, "free": 9548701696}, "host_cpu_percent": 15.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.23, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072822.8079286, "monotonic": 527554.984, "host_memory": {"total": 67773509632, "available": 9520029696, "percent": 86.0, "used": 58253479936, "free": 9520029696}, "host_cpu_percent": 15.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.65, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072823.8819149, "monotonic": 527556.062, "host_memory": {"total": 67773509632, "available": 9430966272, "percent": 86.1, "used": 58342543360, "free": 9430966272}, "host_cpu_percent": 15.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.68, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072824.9516118, "monotonic": 527557.14, "host_memory": {"total": 67773509632, "available": 9399169024, "percent": 86.1, "used": 58374340608, "free": 9399169024}, "host_cpu_percent": 27.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.19, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072826.009969, "monotonic": 527558.187, "host_memory": {"total": 67773509632, "available": 9445355520, "percent": 86.1, "used": 58328154112, "free": 9445355520}, "host_cpu_percent": 16.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.18, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072827.0773528, "monotonic": 527559.265, "host_memory": {"total": 67773509632, "available": 9447321600, "percent": 86.1, "used": 58326188032, "free": 9447321600}, "host_cpu_percent": 11.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.16, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072828.141991, "monotonic": 527560.328, "host_memory": {"total": 67773509632, "available": 9468944384, "percent": 86.0, "used": 58304565248, "free": 9468944384}, "host_cpu_percent": 14.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.14, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072829.2083864, "monotonic": 527561.39, "host_memory": {"total": 67773509632, "available": 9465044992, "percent": 86.0, "used": 58308464640, "free": 9465044992}, "host_cpu_percent": 12.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 34.54, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072830.2725842, "monotonic": 527562.453, "host_memory": {"total": 67773509632, "available": 9455288320, "percent": 86.0, "used": 58318221312, "free": 9455288320}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 33.09, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072831.3329577, "monotonic": 527563.515, "host_memory": {"total": 67773509632, "available": 9392197632, "percent": 86.1, "used": 58381312000, "free": 9392197632}, "host_cpu_percent": 19.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 33.08, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072832.3951128, "monotonic": 527564.578, "host_memory": {"total": 67773509632, "available": 9442217984, "percent": 86.1, "used": 58331291648, "free": 9442217984}, "host_cpu_percent": 11.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.99, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072833.4522083, "monotonic": 527565.64, "host_memory": {"total": 67773509632, "available": 9432158208, "percent": 86.1, "used": 58341351424, "free": 9432158208}, "host_cpu_percent": 11.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.99, 1597, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072834.514316, "monotonic": 527566.703, "host_memory": {"total": 67773509632, "available": 9429180416, "percent": 86.1, "used": 58344329216, "free": 9429180416}, "host_cpu_percent": 9.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23963, 24463, 58, 33.00, 1597, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072835.573711, "monotonic": 527567.75, "host_memory": {"total": 67773509632, "available": 9435594752, "percent": 86.1, "used": 58337914880, "free": 9435594752}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23963, 24463, 58, 32.96, 1612, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072836.6343248, "monotonic": 527568.812, "host_memory": {"total": 67773509632, "available": 9435967488, "percent": 86.1, "used": 58337542144, "free": 9435967488}, "host_cpu_percent": 17.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23963, 24463, 58, 33.01, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072837.6978962, "monotonic": 527569.875, "host_memory": {"total": 67773509632, "available": 9460936704, "percent": 86.0, "used": 58312572928, "free": 9460936704}, "host_cpu_percent": 17.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.02, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072838.7591076, "monotonic": 527570.937, "host_memory": {"total": 67773509632, "available": 9470656512, "percent": 86.0, "used": 58302853120, "free": 9470656512}, "host_cpu_percent": 20.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.08, 1612, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072839.82218, "monotonic": 527572.0, "host_memory": {"total": 67773509632, "available": 9495330816, "percent": 86.0, "used": 58278178816, "free": 9495330816}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.98, 1575, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072840.881191, "monotonic": 527573.062, "host_memory": {"total": 67773509632, "available": 9499283456, "percent": 86.0, "used": 58274226176, "free": 9499283456}, "host_cpu_percent": 11.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.87, 1597, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072841.942022, "monotonic": 527574.125, "host_memory": {"total": 67773509632, "available": 9506709504, "percent": 86.0, "used": 58266800128, "free": 9506709504}, "host_cpu_percent": 16.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.07, 1597, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072843.0131018, "monotonic": 527575.203, "host_memory": {"total": 67773509632, "available": 9512484864, "percent": 86.0, "used": 58261024768, "free": 9512484864}, "host_cpu_percent": 8.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.53, 1635, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072844.074372, "monotonic": 527576.25, "host_memory": {"total": 67773509632, "available": 9521291264, "percent": 86.0, "used": 58252218368, "free": 9521291264}, "host_cpu_percent": 14.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.92, 1627, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072845.1344097, "monotonic": 527577.312, "host_memory": {"total": 67773509632, "available": 9521631232, "percent": 86.0, "used": 58251878400, "free": 9521631232}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.82, 1635, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072846.2001786, "monotonic": 527578.375, "host_memory": {"total": 67773509632, "available": 9525276672, "percent": 85.9, "used": 58248232960, "free": 9525276672}, "host_cpu_percent": 17.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.98, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072847.2635057, "monotonic": 527579.453, "host_memory": {"total": 67773509632, "available": 9531105280, "percent": 85.9, "used": 58242404352, "free": 9531105280}, "host_cpu_percent": 17.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.83, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072848.3246956, "monotonic": 527580.5, "host_memory": {"total": 67773509632, "available": 9530134528, "percent": 85.9, "used": 58243375104, "free": 9530134528}, "host_cpu_percent": 19.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.14, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072849.3799827, "monotonic": 527581.562, "host_memory": {"total": 67773509632, "available": 9537921024, "percent": 85.9, "used": 58235588608, "free": 9537921024}, "host_cpu_percent": 11.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.05, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072850.4403424, "monotonic": 527582.625, "host_memory": {"total": 67773509632, "available": 9540718592, "percent": 85.9, "used": 58232791040, "free": 9540718592}, "host_cpu_percent": 14.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.92, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072851.508996, "monotonic": 527583.687, "host_memory": {"total": 67773509632, "available": 9544155136, "percent": 85.9, "used": 58229354496, "free": 9544155136}, "host_cpu_percent": 13.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.89, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072852.5712566, "monotonic": 527584.75, "host_memory": {"total": 67773509632, "available": 9539522560, "percent": 85.9, "used": 58233987072, "free": 9539522560}, "host_cpu_percent": 18.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.17, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072853.6350653, "monotonic": 527585.812, "host_memory": {"total": 67773509632, "available": 9534562304, "percent": 85.9, "used": 58238947328, "free": 9534562304}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.15, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072854.6965837, "monotonic": 527586.875, "host_memory": {"total": 67773509632, "available": 9533796352, "percent": 85.9, "used": 58239713280, "free": 9533796352}, "host_cpu_percent": 22.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072855.7605152, "monotonic": 527587.937, "host_memory": {"total": 67773509632, "available": 9542275072, "percent": 85.9, "used": 58231234560, "free": 9542275072}, "host_cpu_percent": 25.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.81, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072856.8197803, "monotonic": 527589.0, "host_memory": {"total": 67773509632, "available": 9526202368, "percent": 85.9, "used": 58247307264, "free": 9526202368}, "host_cpu_percent": 13.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.94, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072857.883443, "monotonic": 527590.062, "host_memory": {"total": 67773509632, "available": 9503997952, "percent": 86.0, "used": 58269511680, "free": 9503997952}, "host_cpu_percent": 15.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.12, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072858.9431667, "monotonic": 527591.125, "host_memory": {"total": 67773509632, "available": 9492992000, "percent": 86.0, "used": 58280517632, "free": 9492992000}, "host_cpu_percent": 10.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.15, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072860.011817, "monotonic": 527592.187, "host_memory": {"total": 67773509632, "available": 9456340992, "percent": 86.0, "used": 58317168640, "free": 9456340992}, "host_cpu_percent": 12.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.05, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072861.084669, "monotonic": 527593.265, "host_memory": {"total": 67773509632, "available": 9463291904, "percent": 86.0, "used": 58310217728, "free": 9463291904}, "host_cpu_percent": 18.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.67, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072862.1534438, "monotonic": 527594.328, "host_memory": {"total": 67773509632, "available": 9458003968, "percent": 86.0, "used": 58315505664, "free": 9458003968}, "host_cpu_percent": 10.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.76, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072863.219045, "monotonic": 527595.406, "host_memory": {"total": 67773509632, "available": 9458708480, "percent": 86.0, "used": 58314801152, "free": 9458708480}, "host_cpu_percent": 10.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.93, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072864.2799168, "monotonic": 527596.468, "host_memory": {"total": 67773509632, "available": 9468977152, "percent": 86.0, "used": 58304532480, "free": 9468977152}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.08, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072865.343204, "monotonic": 527597.531, "host_memory": {"total": 67773509632, "available": 9467428864, "percent": 86.0, "used": 58306080768, "free": 9467428864}, "host_cpu_percent": 9.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.93, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072866.4043448, "monotonic": 527598.593, "host_memory": {"total": 67773509632, "available": 9471639552, "percent": 86.0, "used": 58301870080, "free": 9471639552}, "host_cpu_percent": 10.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.86, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072867.4642744, "monotonic": 527599.64, "host_memory": {"total": 67773509632, "available": 9493532672, "percent": 86.0, "used": 58279976960, "free": 9493532672}, "host_cpu_percent": 15.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.05, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072868.5227077, "monotonic": 527600.703, "host_memory": {"total": 67773509632, "available": 9490034688, "percent": 86.0, "used": 58283474944, "free": 9490034688}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.40, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072869.5812201, "monotonic": 527601.765, "host_memory": {"total": 67773509632, "available": 9498537984, "percent": 86.0, "used": 58274971648, "free": 9498537984}, "host_cpu_percent": 8.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.93, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072870.6463027, "monotonic": 527602.828, "host_memory": {"total": 67773509632, "available": 9495932928, "percent": 86.0, "used": 58277576704, "free": 9495932928}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.98, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072871.711522, "monotonic": 527603.89, "host_memory": {"total": 67773509632, "available": 9445048320, "percent": 86.1, "used": 58328461312, "free": 9445048320}, "host_cpu_percent": 14.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23959, 24463, 58, 32.19, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072872.7727938, "monotonic": 527604.953, "host_memory": {"total": 67773509632, "available": 9455382528, "percent": 86.0, "used": 58318127104, "free": 9455382528}, "host_cpu_percent": 18.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.17, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072873.8409557, "monotonic": 527606.015, "host_memory": {"total": 67773509632, "available": 9458872320, "percent": 86.0, "used": 58314637312, "free": 9458872320}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.27, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072874.9050896, "monotonic": 527607.093, "host_memory": {"total": 67773509632, "available": 9475588096, "percent": 86.0, "used": 58297921536, "free": 9475588096}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.05, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072875.965291, "monotonic": 527608.14, "host_memory": {"total": 67773509632, "available": 9468301312, "percent": 86.0, "used": 58305208320, "free": 9468301312}, "host_cpu_percent": 8.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.90, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072877.025557, "monotonic": 527609.203, "host_memory": {"total": 67773509632, "available": 9462456320, "percent": 86.0, "used": 58311053312, "free": 9462456320}, "host_cpu_percent": 15.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.17, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072878.0954983, "monotonic": 527610.281, "host_memory": {"total": 67773509632, "available": 9460989952, "percent": 86.0, "used": 58312519680, "free": 9460989952}, "host_cpu_percent": 17.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.17, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072879.1486828, "monotonic": 527611.328, "host_memory": {"total": 67773509632, "available": 9455316992, "percent": 86.0, "used": 58318192640, "free": 9455316992}, "host_cpu_percent": 10.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.76, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072880.2110276, "monotonic": 527612.39, "host_memory": {"total": 67773509632, "available": 9465438208, "percent": 86.0, "used": 58308071424, "free": 9465438208}, "host_cpu_percent": 12.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 31.98, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072881.2717686, "monotonic": 527613.453, "host_memory": {"total": 67773509632, "available": 9458274304, "percent": 86.0, "used": 58315235328, "free": 9458274304}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.93, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072882.3309128, "monotonic": 527614.515, "host_memory": {"total": 67773509632, "available": 9467793408, "percent": 86.0, "used": 58305716224, "free": 9467793408}, "host_cpu_percent": 13.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.46, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072883.3916056, "monotonic": 527615.578, "host_memory": {"total": 67773509632, "available": 9430151168, "percent": 86.1, "used": 58343358464, "free": 9430151168}, "host_cpu_percent": 14.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072884.463671, "monotonic": 527616.64, "host_memory": {"total": 67773509632, "available": 9405181952, "percent": 86.1, "used": 58368327680, "free": 9405181952}, "host_cpu_percent": 19.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.89, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072885.5137165, "monotonic": 527617.703, "host_memory": {"total": 67773509632, "available": 9437175808, "percent": 86.1, "used": 58336333824, "free": 9437175808}, "host_cpu_percent": 16.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.27, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072886.5802486, "monotonic": 527618.765, "host_memory": {"total": 67773509632, "available": 9454227456, "percent": 86.1, "used": 58319282176, "free": 9454227456}, "host_cpu_percent": 9.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.11, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072887.6394858, "monotonic": 527619.828, "host_memory": {"total": 67773509632, "available": 9473097728, "percent": 86.0, "used": 58300411904, "free": 9473097728}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.73, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072888.6906, "monotonic": 527620.875, "host_memory": {"total": 67773509632, "available": 9496784896, "percent": 86.0, "used": 58276724736, "free": 9496784896}, "host_cpu_percent": 9.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.10, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072889.7599783, "monotonic": 527621.937, "host_memory": {"total": 67773509632, "available": 9501646848, "percent": 86.0, "used": 58271862784, "free": 9501646848}, "host_cpu_percent": 10.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 33.04, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072890.8318043, "monotonic": 527623.015, "host_memory": {"total": 67773509632, "available": 9489129472, "percent": 86.0, "used": 58284380160, "free": 9489129472}, "host_cpu_percent": 9.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.79, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072891.8963084, "monotonic": 527624.078, "host_memory": {"total": 67773509632, "available": 9487458304, "percent": 86.0, "used": 58286051328, "free": 9487458304}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.95, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072892.957407, "monotonic": 527625.14, "host_memory": {"total": 67773509632, "available": 9484505088, "percent": 86.0, "used": 58289004544, "free": 9484505088}, "host_cpu_percent": 9.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.92, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072894.0160189, "monotonic": 527626.203, "host_memory": {"total": 67773509632, "available": 9500782592, "percent": 86.0, "used": 58272727040, "free": 9500782592}, "host_cpu_percent": 13.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.78, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072895.0773773, "monotonic": 527627.265, "host_memory": {"total": 67773509632, "available": 9500737536, "percent": 86.0, "used": 58272772096, "free": 9500737536}, "host_cpu_percent": 9.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 33.01, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072896.141089, "monotonic": 527628.328, "host_memory": {"total": 67773509632, "available": 9498316800, "percent": 86.0, "used": 58275192832, "free": 9498316800}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.99, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072897.2052143, "monotonic": 527629.39, "host_memory": {"total": 67773509632, "available": 9510871040, "percent": 86.0, "used": 58262638592, "free": 9510871040}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.97, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072898.2633064, "monotonic": 527630.453, "host_memory": {"total": 67773509632, "available": 9508110336, "percent": 86.0, "used": 58265399296, "free": 9508110336}, "host_cpu_percent": 9.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.97, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072899.3223526, "monotonic": 527631.5, "host_memory": {"total": 67773509632, "available": 9498386432, "percent": 86.0, "used": 58275123200, "free": 9498386432}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.91, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072900.386789, "monotonic": 527632.562, "host_memory": {"total": 67773509632, "available": 9519693824, "percent": 86.0, "used": 58253815808, "free": 9519693824}, "host_cpu_percent": 10.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.90, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072901.4556124, "monotonic": 527633.64, "host_memory": {"total": 67773509632, "available": 9516204032, "percent": 86.0, "used": 58257305600, "free": 9516204032}, "host_cpu_percent": 12.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.95, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072902.5108147, "monotonic": 527634.687, "host_memory": {"total": 67773509632, "available": 9521451008, "percent": 86.0, "used": 58252058624, "free": 9521451008}, "host_cpu_percent": 9.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.92, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072903.5776842, "monotonic": 527635.765, "host_memory": {"total": 67773509632, "available": 9517862912, "percent": 86.0, "used": 58255646720, "free": 9517862912}, "host_cpu_percent": 9.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.95, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072904.6399271, "monotonic": 527636.828, "host_memory": {"total": 67773509632, "available": 9525055488, "percent": 85.9, "used": 58248454144, "free": 9525055488}, "host_cpu_percent": 13.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.79, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072905.6995125, "monotonic": 527637.875, "host_memory": {"total": 67773509632, "available": 9522069504, "percent": 86.0, "used": 58251440128, "free": 9522069504}, "host_cpu_percent": 10.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.94, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072906.7628963, "monotonic": 527638.937, "host_memory": {"total": 67773509632, "available": 9518841856, "percent": 86.0, "used": 58254667776, "free": 9518841856}, "host_cpu_percent": 12.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 33.77, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072907.8284476, "monotonic": 527640.015, "host_memory": {"total": 67773509632, "available": 9509376000, "percent": 86.0, "used": 58264133632, "free": 9509376000}, "host_cpu_percent": 15.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.90, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072908.9013133, "monotonic": 527641.078, "host_memory": {"total": 67773509632, "available": 9514000384, "percent": 86.0, "used": 58259509248, "free": 9514000384}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 33.02, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072909.957338, "monotonic": 527642.14, "host_memory": {"total": 67773509632, "available": 9505763328, "percent": 86.0, "used": 58267746304, "free": 9505763328}, "host_cpu_percent": 11.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.28, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072911.0210412, "monotonic": 527643.203, "host_memory": {"total": 67773509632, "available": 9500602368, "percent": 86.0, "used": 58272907264, "free": 9500602368}, "host_cpu_percent": 11.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 33.08, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072912.0844264, "monotonic": 527644.265, "host_memory": {"total": 67773509632, "available": 9502470144, "percent": 86.0, "used": 58271039488, "free": 9502470144}, "host_cpu_percent": 12.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 33.56, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072913.146747, "monotonic": 527645.328, "host_memory": {"total": 67773509632, "available": 9500381184, "percent": 86.0, "used": 58273128448, "free": 9500381184}, "host_cpu_percent": 12.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 33.20, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072914.2104728, "monotonic": 527646.39, "host_memory": {"total": 67773509632, "available": 9475948544, "percent": 86.0, "used": 58297561088, "free": 9475948544}, "host_cpu_percent": 10.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 33.10, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072915.276135, "monotonic": 527647.453, "host_memory": {"total": 67773509632, "available": 9471541248, "percent": 86.0, "used": 58301968384, "free": 9471541248}, "host_cpu_percent": 20.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.69, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072916.3363857, "monotonic": 527648.515, "host_memory": {"total": 67773509632, "available": 9431187456, "percent": 86.1, "used": 58342322176, "free": 9431187456}, "host_cpu_percent": 12.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 33.87, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072917.4021919, "monotonic": 527649.578, "host_memory": {"total": 67773509632, "available": 9420349440, "percent": 86.1, "used": 58353160192, "free": 9420349440}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.79, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072918.4649723, "monotonic": 527650.64, "host_memory": {"total": 67773509632, "available": 9429864448, "percent": 86.1, "used": 58343645184, "free": 9429864448}, "host_cpu_percent": 16.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.84, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072919.5228183, "monotonic": 527651.703, "host_memory": {"total": 67773509632, "available": 9430671360, "percent": 86.1, "used": 58342838272, "free": 9430671360}, "host_cpu_percent": 16.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.42, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072920.58227, "monotonic": 527652.765, "host_memory": {"total": 67773509632, "available": 9431891968, "percent": 86.1, "used": 58341617664, "free": 9431891968}, "host_cpu_percent": 9.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.67, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072921.6390593, "monotonic": 527653.828, "host_memory": {"total": 67773509632, "available": 9431654400, "percent": 86.1, "used": 58341855232, "free": 9431654400}, "host_cpu_percent": 8.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.98, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072922.7078881, "monotonic": 527654.89, "host_memory": {"total": 67773509632, "available": 9431048192, "percent": 86.1, "used": 58342461440, "free": 9431048192}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 33.03, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072923.76796, "monotonic": 527655.953, "host_memory": {"total": 67773509632, "available": 9422929920, "percent": 86.1, "used": 58350579712, "free": 9422929920}, "host_cpu_percent": 9.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.96, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072924.8336363, "monotonic": 527657.015, "host_memory": {"total": 67773509632, "available": 9423314944, "percent": 86.1, "used": 58350194688, "free": 9423314944}, "host_cpu_percent": 11.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.88, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072925.9006476, "monotonic": 527658.078, "host_memory": {"total": 67773509632, "available": 9430687744, "percent": 86.1, "used": 58342821888, "free": 9430687744}, "host_cpu_percent": 14.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 33.04, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072926.9738584, "monotonic": 527659.156, "host_memory": {"total": 67773509632, "available": 9436987392, "percent": 86.1, "used": 58336522240, "free": 9436987392}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.95, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072928.046297, "monotonic": 527660.234, "host_memory": {"total": 67773509632, "available": 9439047680, "percent": 86.1, "used": 58334461952, "free": 9439047680}, "host_cpu_percent": 9.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 33.03, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072929.1090152, "monotonic": 527661.296, "host_memory": {"total": 67773509632, "available": 9439653888, "percent": 86.1, "used": 58333855744, "free": 9439653888}, "host_cpu_percent": 12.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 58, 32.85, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072930.163899, "monotonic": 527662.343, "host_memory": {"total": 67773509632, "available": 9440776192, "percent": 86.1, "used": 58332733440, "free": 9440776192}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.96, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072931.234106, "monotonic": 527663.421, "host_memory": {"total": 67773509632, "available": 9437855744, "percent": 86.1, "used": 58335653888, "free": 9437855744}, "host_cpu_percent": 24.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.95, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072932.2894692, "monotonic": 527664.468, "host_memory": {"total": 67773509632, "available": 9433628672, "percent": 86.1, "used": 58339880960, "free": 9433628672}, "host_cpu_percent": 17.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.86, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072933.3523743, "monotonic": 527665.531, "host_memory": {"total": 67773509632, "available": 9428373504, "percent": 86.1, "used": 58345136128, "free": 9428373504}, "host_cpu_percent": 20.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.84, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072934.414803, "monotonic": 527666.593, "host_memory": {"total": 67773509632, "available": 9434439680, "percent": 86.1, "used": 58339069952, "free": 9434439680}, "host_cpu_percent": 10.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.55, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072935.4697301, "monotonic": 527667.656, "host_memory": {"total": 67773509632, "available": 9427513344, "percent": 86.1, "used": 58345996288, "free": 9427513344}, "host_cpu_percent": 11.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.33, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072936.5290964, "monotonic": 527668.718, "host_memory": {"total": 67773509632, "available": 9435688960, "percent": 86.1, "used": 58337820672, "free": 9435688960}, "host_cpu_percent": 13.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.97, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072937.5964892, "monotonic": 527669.781, "host_memory": {"total": 67773509632, "available": 9429037056, "percent": 86.1, "used": 58344472576, "free": 9429037056}, "host_cpu_percent": 14.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 34.36, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072938.6538198, "monotonic": 527670.843, "host_memory": {"total": 67773509632, "available": 9425858560, "percent": 86.1, "used": 58347651072, "free": 9425858560}, "host_cpu_percent": 10.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.76, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072939.7180598, "monotonic": 527671.906, "host_memory": {"total": 67773509632, "available": 8782528512, "percent": 87.0, "used": 58990981120, "free": 8782528512}, "host_cpu_percent": 27.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.35, 1702, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072940.7797058, "monotonic": 527672.968, "host_memory": {"total": 67773509632, "available": 8778129408, "percent": 87.0, "used": 58995380224, "free": 8778129408}, "host_cpu_percent": 24.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.04, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072941.84043, "monotonic": 527674.015, "host_memory": {"total": 67773509632, "available": 9009569792, "percent": 86.7, "used": 58763939840, "free": 9009569792}, "host_cpu_percent": 27.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.87, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072942.9005244, "monotonic": 527675.078, "host_memory": {"total": 67773509632, "available": 9025351680, "percent": 86.7, "used": 58748157952, "free": 9025351680}, "host_cpu_percent": 25.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.30, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072943.9696686, "monotonic": 527676.156, "host_memory": {"total": 67773509632, "available": 9084329984, "percent": 86.6, "used": 58689179648, "free": 9084329984}, "host_cpu_percent": 17.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.93, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072945.0315316, "monotonic": 527677.218, "host_memory": {"total": 67773509632, "available": 9165463552, "percent": 86.5, "used": 58608046080, "free": 9165463552}, "host_cpu_percent": 24.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.91, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072946.090762, "monotonic": 527678.265, "host_memory": {"total": 67773509632, "available": 9022062592, "percent": 86.7, "used": 58751447040, "free": 9022062592}, "host_cpu_percent": 28.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 33.02, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072947.1582701, "monotonic": 527679.343, "host_memory": {"total": 67773509632, "available": 9032892416, "percent": 86.7, "used": 58740617216, "free": 9032892416}, "host_cpu_percent": 24.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.30, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072948.221986, "monotonic": 527680.406, "host_memory": {"total": 67773509632, "available": 9048666112, "percent": 86.6, "used": 58724843520, "free": 9048666112}, "host_cpu_percent": 23.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 58, 32.50, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072949.2855127, "monotonic": 527681.468, "host_memory": {"total": 67773509632, "available": 9139400704, "percent": 86.5, "used": 58634108928, "free": 9139400704}, "host_cpu_percent": 22.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.92, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072950.3519835, "monotonic": 527682.531, "host_memory": {"total": 67773509632, "available": 9145380864, "percent": 86.5, "used": 58628128768, "free": 9145380864}, "host_cpu_percent": 18.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 58, 32.96, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072951.4131582, "monotonic": 527683.593, "host_memory": {"total": 67773509632, "available": 9152512000, "percent": 86.5, "used": 58620997632, "free": 9152512000}, "host_cpu_percent": 15.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 59, 33.00, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072952.4751801, "monotonic": 527684.656, "host_memory": {"total": 67773509632, "available": 9154342912, "percent": 86.5, "used": 58619166720, "free": 9154342912}, "host_cpu_percent": 16.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 59, 33.41, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072953.535162, "monotonic": 527685.718, "host_memory": {"total": 67773509632, "available": 9182441472, "percent": 86.5, "used": 58591068160, "free": 9182441472}, "host_cpu_percent": 19.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 59, 33.04, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072954.6000288, "monotonic": 527686.781, "host_memory": {"total": 67773509632, "available": 9204801536, "percent": 86.4, "used": 58568708096, "free": 9204801536}, "host_cpu_percent": 18.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 59, 32.97, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072955.6573515, "monotonic": 527687.843, "host_memory": {"total": 67773509632, "available": 9370673152, "percent": 86.2, "used": 58402836480, "free": 9370673152}, "host_cpu_percent": 19.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 59, 32.94, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072956.7222526, "monotonic": 527688.906, "host_memory": {"total": 67773509632, "available": 9465004032, "percent": 86.0, "used": 58308505600, "free": 9465004032}, "host_cpu_percent": 21.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 59, 32.64, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072957.7864716, "monotonic": 527689.968, "host_memory": {"total": 67773509632, "available": 9478262784, "percent": 86.0, "used": 58295246848, "free": 9478262784}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 59, 32.89, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072958.850267, "monotonic": 527691.031, "host_memory": {"total": 67773509632, "available": 9459068928, "percent": 86.0, "used": 58314440704, "free": 9459068928}, "host_cpu_percent": 18.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.46, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072959.913841, "monotonic": 527692.093, "host_memory": {"total": 67773509632, "available": 9459130368, "percent": 86.0, "used": 58314379264, "free": 9459130368}, "host_cpu_percent": 17.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.55, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072960.9805894, "monotonic": 527693.156, "host_memory": {"total": 67773509632, "available": 9447964672, "percent": 86.1, "used": 58325544960, "free": 9447964672}, "host_cpu_percent": 17.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.92, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072962.0405564, "monotonic": 527694.218, "host_memory": {"total": 67773509632, "available": 9431363584, "percent": 86.1, "used": 58342146048, "free": 9431363584}, "host_cpu_percent": 11.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.79, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072963.1017866, "monotonic": 527695.281, "host_memory": {"total": 67773509632, "available": 9446367232, "percent": 86.1, "used": 58327142400, "free": 9446367232}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.71, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072964.162376, "monotonic": 527696.343, "host_memory": {"total": 67773509632, "available": 9444765696, "percent": 86.1, "used": 58328743936, "free": 9444765696}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.74, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072965.2217922, "monotonic": 527697.406, "host_memory": {"total": 67773509632, "available": 9447100416, "percent": 86.1, "used": 58326409216, "free": 9447100416}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.24, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072966.2714243, "monotonic": 527698.453, "host_memory": {"total": 67773509632, "available": 9450213376, "percent": 86.1, "used": 58323296256, "free": 9450213376}, "host_cpu_percent": 10.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 34.79, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072967.3369513, "monotonic": 527699.515, "host_memory": {"total": 67773509632, "available": 9442844672, "percent": 86.1, "used": 58330664960, "free": 9442844672}, "host_cpu_percent": 18.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 34.92, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072968.3962119, "monotonic": 527700.578, "host_memory": {"total": 67773509632, "available": 9447010304, "percent": 86.1, "used": 58326499328, "free": 9447010304}, "host_cpu_percent": 14.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.04, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072969.4664874, "monotonic": 527701.656, "host_memory": {"total": 67773509632, "available": 9446178816, "percent": 86.1, "used": 58327330816, "free": 9446178816}, "host_cpu_percent": 10.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.32, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072970.5240014, "monotonic": 527702.703, "host_memory": {"total": 67773509632, "available": 9442476032, "percent": 86.1, "used": 58331033600, "free": 9442476032}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.96, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072971.5830066, "monotonic": 527703.765, "host_memory": {"total": 67773509632, "available": 9454092288, "percent": 86.1, "used": 58319417344, "free": 9454092288}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.98, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072972.6504269, "monotonic": 527704.828, "host_memory": {"total": 67773509632, "available": 9466503168, "percent": 86.0, "used": 58307006464, "free": 9466503168}, "host_cpu_percent": 16.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.68, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072973.7112846, "monotonic": 527705.89, "host_memory": {"total": 67773509632, "available": 9473855488, "percent": 86.0, "used": 58299654144, "free": 9473855488}, "host_cpu_percent": 10.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.22, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072974.7703764, "monotonic": 527706.953, "host_memory": {"total": 67773509632, "available": 9466433536, "percent": 86.0, "used": 58307076096, "free": 9466433536}, "host_cpu_percent": 10.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.40, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072975.828417, "monotonic": 527708.015, "host_memory": {"total": 67773509632, "available": 9463586816, "percent": 86.0, "used": 58309922816, "free": 9463586816}, "host_cpu_percent": 9.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.74, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072976.8860252, "monotonic": 527709.062, "host_memory": {"total": 67773509632, "available": 9465565184, "percent": 86.0, "used": 58307944448, "free": 9465565184}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.97, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072977.9516199, "monotonic": 527710.14, "host_memory": {"total": 67773509632, "available": 9462075392, "percent": 86.0, "used": 58311434240, "free": 9462075392}, "host_cpu_percent": 15.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.93, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072979.012022, "monotonic": 527711.187, "host_memory": {"total": 67773509632, "available": 9461772288, "percent": 86.0, "used": 58311737344, "free": 9461772288}, "host_cpu_percent": 10.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.98, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072980.0729406, "monotonic": 527712.25, "host_memory": {"total": 67773509632, "available": 9466155008, "percent": 86.0, "used": 58307354624, "free": 9466155008}, "host_cpu_percent": 9.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.91, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072981.13529, "monotonic": 527713.312, "host_memory": {"total": 67773509632, "available": 9459302400, "percent": 86.0, "used": 58314207232, "free": 9459302400}, "host_cpu_percent": 22.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.99, 1687, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072982.1974623, "monotonic": 527714.375, "host_memory": {"total": 67773509632, "available": 9461604352, "percent": 86.0, "used": 58311905280, "free": 9461604352}, "host_cpu_percent": 13.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.90, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072983.2548807, "monotonic": 527715.437, "host_memory": {"total": 67773509632, "available": 9463562240, "percent": 86.0, "used": 58309947392, "free": 9463562240}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.93, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072984.3134542, "monotonic": 527716.5, "host_memory": {"total": 67773509632, "available": 9464713216, "percent": 86.0, "used": 58308796416, "free": 9464713216}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.94, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072985.377575, "monotonic": 527717.562, "host_memory": {"total": 67773509632, "available": 9460310016, "percent": 86.0, "used": 58313199616, "free": 9460310016}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.26, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072986.4398808, "monotonic": 527718.625, "host_memory": {"total": 67773509632, "available": 9461006336, "percent": 86.0, "used": 58312503296, "free": 9461006336}, "host_cpu_percent": 9.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.97, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072987.517222, "monotonic": 527719.703, "host_memory": {"total": 67773509632, "available": 9457684480, "percent": 86.0, "used": 58315825152, "free": 9457684480}, "host_cpu_percent": 11.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.98, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072988.588258, "monotonic": 527720.765, "host_memory": {"total": 67773509632, "available": 9463197696, "percent": 86.0, "used": 58310311936, "free": 9463197696}, "host_cpu_percent": 13.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.03, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072989.645531, "monotonic": 527721.828, "host_memory": {"total": 67773509632, "available": 9464750080, "percent": 86.0, "used": 58308759552, "free": 9464750080}, "host_cpu_percent": 10.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.94, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072990.7080343, "monotonic": 527722.89, "host_memory": {"total": 67773509632, "available": 9477779456, "percent": 86.0, "used": 58295730176, "free": 9477779456}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.77, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072991.7713442, "monotonic": 527723.953, "host_memory": {"total": 67773509632, "available": 9477640192, "percent": 86.0, "used": 58295869440, "free": 9477640192}, "host_cpu_percent": 11.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.93, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072992.8409965, "monotonic": 527725.015, "host_memory": {"total": 67773509632, "available": 9475604480, "percent": 86.0, "used": 58297905152, "free": 9475604480}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.81, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072993.907897, "monotonic": 527726.093, "host_memory": {"total": 67773509632, "available": 9474637824, "percent": 86.0, "used": 58298871808, "free": 9474637824}, "host_cpu_percent": 12.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.89, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072994.968815, "monotonic": 527727.156, "host_memory": {"total": 67773509632, "available": 9489584128, "percent": 86.0, "used": 58283925504, "free": 9489584128}, "host_cpu_percent": 10.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.91, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072996.027195, "monotonic": 527728.203, "host_memory": {"total": 67773509632, "available": 9485455360, "percent": 86.0, "used": 58288054272, "free": 9485455360}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.76, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072997.0918975, "monotonic": 527729.281, "host_memory": {"total": 67773509632, "available": 9449889792, "percent": 86.1, "used": 58323619840, "free": 9449889792}, "host_cpu_percent": 29.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.36, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072998.1524725, "monotonic": 527730.328, "host_memory": {"total": 67773509632, "available": 9441767424, "percent": 86.1, "used": 58331742208, "free": 9441767424}, "host_cpu_percent": 24.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.33, 1680, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790072999.2291763, "monotonic": 527731.406, "host_memory": {"total": 67773509632, "available": 9452449792, "percent": 86.1, "used": 58321059840, "free": 9452449792}, "host_cpu_percent": 11.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 35.07, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073000.2864954, "monotonic": 527732.468, "host_memory": {"total": 67773509632, "available": 9460768768, "percent": 86.0, "used": 58312740864, "free": 9460768768}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.54, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073001.342226, "monotonic": 527733.531, "host_memory": {"total": 67773509632, "available": 9465905152, "percent": 86.0, "used": 58307604480, "free": 9465905152}, "host_cpu_percent": 9.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.97, 1620, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073002.4082956, "monotonic": 527734.593, "host_memory": {"total": 67773509632, "available": 9505587200, "percent": 86.0, "used": 58267922432, "free": 9505587200}, "host_cpu_percent": 16.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.03, 1612, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073003.4628987, "monotonic": 527735.64, "host_memory": {"total": 67773509632, "available": 9485172736, "percent": 86.0, "used": 58288336896, "free": 9485172736}, "host_cpu_percent": 11.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.76, 1627, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073004.5284019, "monotonic": 527736.703, "host_memory": {"total": 67773509632, "available": 9486471168, "percent": 86.0, "used": 58287038464, "free": 9486471168}, "host_cpu_percent": 11.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.97, 1635, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073005.5937116, "monotonic": 527737.781, "host_memory": {"total": 67773509632, "available": 9473167360, "percent": 86.0, "used": 58300342272, "free": 9473167360}, "host_cpu_percent": 12.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.04, 1620, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073006.648373, "monotonic": 527738.828, "host_memory": {"total": 67773509632, "available": 9461280768, "percent": 86.0, "used": 58312228864, "free": 9461280768}, "host_cpu_percent": 22.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.85, 1620, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073007.714278, "monotonic": 527739.89, "host_memory": {"total": 67773509632, "available": 9469476864, "percent": 86.0, "used": 58304032768, "free": 9469476864}, "host_cpu_percent": 13.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.90, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073008.774082, "monotonic": 527740.953, "host_memory": {"total": 67773509632, "available": 9470705664, "percent": 86.0, "used": 58302803968, "free": 9470705664}, "host_cpu_percent": 15.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.96, 1612, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073009.847216, "monotonic": 527742.031, "host_memory": {"total": 67773509632, "available": 9497010176, "percent": 86.0, "used": 58276499456, "free": 9497010176}, "host_cpu_percent": 11.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.12, 1620, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073010.9068918, "monotonic": 527743.093, "host_memory": {"total": 67773509632, "available": 9492041728, "percent": 86.0, "used": 58281467904, "free": 9492041728}, "host_cpu_percent": 13.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 59, 33.07, 1590, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073011.9740043, "monotonic": 527744.156, "host_memory": {"total": 67773509632, "available": 9492566016, "percent": 86.0, "used": 58280943616, "free": 9492566016}, "host_cpu_percent": 10.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 59, 32.92, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073013.0347657, "monotonic": 527745.218, "host_memory": {"total": 67773509632, "available": 9491808256, "percent": 86.0, "used": 58281701376, "free": 9491808256}, "host_cpu_percent": 10.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 59, 32.97, 1605, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073014.0999537, "monotonic": 527746.281, "host_memory": {"total": 67773509632, "available": 9490759680, "percent": 86.0, "used": 58282749952, "free": 9490759680}, "host_cpu_percent": 10.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 59, 32.72, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073015.1571357, "monotonic": 527747.343, "host_memory": {"total": 67773509632, "available": 9487036416, "percent": 86.0, "used": 58286473216, "free": 9487036416}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 59, 32.81, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073016.225206, "monotonic": 527748.406, "host_memory": {"total": 67773509632, "available": 9490804736, "percent": 86.0, "used": 58282704896, "free": 9490804736}, "host_cpu_percent": 10.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23967, 24463, 59, 32.96, 1672, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073017.2894678, "monotonic": 527749.468, "host_memory": {"total": 67773509632, "available": 9486942208, "percent": 86.0, "used": 58286567424, "free": 9486942208}, "host_cpu_percent": 19.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23958, 24463, 59, 32.75, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073018.3533068, "monotonic": 527750.531, "host_memory": {"total": 67773509632, "available": 9481830400, "percent": 86.0, "used": 58291679232, "free": 9481830400}, "host_cpu_percent": 17.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.90, 1620, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073019.4112656, "monotonic": 527751.593, "host_memory": {"total": 67773509632, "available": 9489887232, "percent": 86.0, "used": 58283622400, "free": 9489887232}, "host_cpu_percent": 13.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.93, 1627, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073020.4721506, "monotonic": 527752.656, "host_memory": {"total": 67773509632, "available": 9505431552, "percent": 86.0, "used": 58268078080, "free": 9505431552}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.08, 1612, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073021.5374937, "monotonic": 527753.718, "host_memory": {"total": 67773509632, "available": 9505546240, "percent": 86.0, "used": 58267963392, "free": 9505546240}, "host_cpu_percent": 12.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.96, 1635, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073022.598861, "monotonic": 527754.781, "host_memory": {"total": 67773509632, "available": 9512284160, "percent": 86.0, "used": 58261225472, "free": 9512284160}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.90, 1635, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073023.6576347, "monotonic": 527755.843, "host_memory": {"total": 67773509632, "available": 9507229696, "percent": 86.0, "used": 58266279936, "free": 9507229696}, "host_cpu_percent": 9.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.95, 1627, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073024.7191982, "monotonic": 527756.906, "host_memory": {"total": 67773509632, "available": 9509515264, "percent": 86.0, "used": 58263994368, "free": 9509515264}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.97, 1575, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073025.778335, "monotonic": 527757.953, "host_memory": {"total": 67773509632, "available": 9522614272, "percent": 85.9, "used": 58250895360, "free": 9522614272}, "host_cpu_percent": 20.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.99, 1575, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073026.8366337, "monotonic": 527759.015, "host_memory": {"total": 67773509632, "available": 9511137280, "percent": 86.0, "used": 58262372352, "free": 9511137280}, "host_cpu_percent": 29.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.95, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073027.9000888, "monotonic": 527760.078, "host_memory": {"total": 67773509632, "available": 9491472384, "percent": 86.0, "used": 58282037248, "free": 9491472384}, "host_cpu_percent": 16.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.72, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073028.960067, "monotonic": 527761.14, "host_memory": {"total": 67773509632, "available": 9492836352, "percent": 86.0, "used": 58280673280, "free": 9492836352}, "host_cpu_percent": 9.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.04, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073030.018964, "monotonic": 527762.203, "host_memory": {"total": 67773509632, "available": 9495072768, "percent": 86.0, "used": 58278436864, "free": 9495072768}, "host_cpu_percent": 12.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.98, 1575, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073031.0849638, "monotonic": 527763.265, "host_memory": {"total": 67773509632, "available": 9497370624, "percent": 86.0, "used": 58276139008, "free": 9497370624}, "host_cpu_percent": 11.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.89, 1575, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073032.1431699, "monotonic": 527764.328, "host_memory": {"total": 67773509632, "available": 9499901952, "percent": 86.0, "used": 58273607680, "free": 9499901952}, "host_cpu_percent": 12.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.87, 1582, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073033.203126, "monotonic": 527765.39, "host_memory": {"total": 67773509632, "available": 9495695360, "percent": 86.0, "used": 58277814272, "free": 9495695360}, "host_cpu_percent": 11.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.08, 1597, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073034.26263, "monotonic": 527766.437, "host_memory": {"total": 67773509632, "available": 9494540288, "percent": 86.0, "used": 58278969344, "free": 9494540288}, "host_cpu_percent": 9.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.96, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073035.323353, "monotonic": 527767.5, "host_memory": {"total": 67773509632, "available": 9534455808, "percent": 85.9, "used": 58239053824, "free": 9534455808}, "host_cpu_percent": 11.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.94, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073036.3852704, "monotonic": 527768.562, "host_memory": {"total": 67773509632, "available": 9534980096, "percent": 85.9, "used": 58238529536, "free": 9534980096}, "host_cpu_percent": 9.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.83, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073037.4498, "monotonic": 527769.625, "host_memory": {"total": 67773509632, "available": 9536618496, "percent": 85.9, "used": 58236891136, "free": 9536618496}, "host_cpu_percent": 12.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.91, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073038.5126622, "monotonic": 527770.687, "host_memory": {"total": 67773509632, "available": 9532239872, "percent": 85.9, "used": 58241269760, "free": 9532239872}, "host_cpu_percent": 10.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.94, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073039.5706415, "monotonic": 527771.75, "host_memory": {"total": 67773509632, "available": 9534300160, "percent": 85.9, "used": 58239209472, "free": 9534300160}, "host_cpu_percent": 14.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.93, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073040.6378036, "monotonic": 527772.812, "host_memory": {"total": 67773509632, "available": 9534525440, "percent": 85.9, "used": 58238984192, "free": 9534525440}, "host_cpu_percent": 17.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.03, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073041.6941843, "monotonic": 527773.875, "host_memory": {"total": 67773509632, "available": 9525448704, "percent": 85.9, "used": 58248060928, "free": 9525448704}, "host_cpu_percent": 22.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.75, 1665, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073042.7562306, "monotonic": 527774.937, "host_memory": {"total": 67773509632, "available": 9525977088, "percent": 85.9, "used": 58247532544, "free": 9525977088}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.96, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073043.8149362, "monotonic": 527776.0, "host_memory": {"total": 67773509632, "available": 9532882944, "percent": 85.9, "used": 58240626688, "free": 9532882944}, "host_cpu_percent": 10.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 33.22, 1657, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073044.877047, "monotonic": 527777.062, "host_memory": {"total": 67773509632, "available": 9525841920, "percent": 85.9, "used": 58247667712, "free": 9525841920}, "host_cpu_percent": 10.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.92, 1650, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073045.9381943, "monotonic": 527778.125, "host_memory": {"total": 67773509632, "available": 9527595008, "percent": 85.9, "used": 58245914624, "free": 9527595008}, "host_cpu_percent": 9.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 23954, 24463, 59, 32.98, 1642, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073046.9895844, "monotonic": 527779.171, "host_memory": {"total": 67773509632, "available": 12545437696, "percent": 81.5, "used": 55228071936, "free": 12545437696}, "host_cpu_percent": 11.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 8982, 24463, 59, 31.89, 1012, 810, 2, P5", "gpu_returncode": 0}
{"unix": 1790073048.0566692, "monotonic": 527780.234, "host_memory": {"total": 67773509632, "available": 20566605824, "percent": 69.7, "used": 47206903808, "free": 20566605824}, "host_cpu_percent": 18.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 6538, 24463, 58, 15.53, 450, 405, 3, P8", "gpu_returncode": 0}
{"unix": 1790073049.12102, "monotonic": 527781.296, "host_memory": {"total": 67773509632, "available": 20548096000, "percent": 69.7, "used": 47225413632, "free": 20548096000}, "host_cpu_percent": 14.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 6538, 24463, 58, 14.31, 397, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790073050.1816826, "monotonic": 527782.359, "host_memory": {"total": 67773509632, "available": 20427608064, "percent": 69.9, "used": 47345901568, "free": 20427608064}, "host_cpu_percent": 11.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 6538, 24463, 58, 17.66, 427, 405, 6, P8", "gpu_returncode": 0}
{"unix": 1790073051.237208, "monotonic": 527783.421, "host_memory": {"total": 67773509632, "available": 20436557824, "percent": 69.8, "used": 47336951808, "free": 20436557824}, "host_cpu_percent": 9.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 6538, 24463, 58, 13.88, 360, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790073052.2976668, "monotonic": 527784.484, "host_memory": {"total": 67773509632, "available": 19477598208, "percent": 71.3, "used": 48295911424, "free": 19477598208}, "host_cpu_percent": 18.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 7734, 24463, 58, 19.14, 435, 810, 24, P5", "gpu_returncode": 0}
{"unix": 1790073055.6642025, "monotonic": 527787.843, "host_memory": {"total": 67773509632, "available": 16807235584, "percent": 75.2, "used": 50966274048, "free": 16807235584}, "host_cpu_percent": 24.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11292, 24463, 59, 35.14, 1657, 810, 99, P5", "gpu_returncode": 0}
{"unix": 1790073056.7251148, "monotonic": 527788.906, "host_memory": {"total": 67773509632, "available": 16795701248, "percent": 75.2, "used": 50977808384, "free": 16795701248}, "host_cpu_percent": 26.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11356, 24463, 59, 38.10, 1762, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073057.7832184, "monotonic": 527789.968, "host_memory": {"total": 67773509632, "available": 16788660224, "percent": 75.2, "used": 50984849408, "free": 16788660224}, "host_cpu_percent": 22.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11356, 24463, 59, 32.60, 1695, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073058.8516436, "monotonic": 527791.031, "host_memory": {"total": 67773509632, "available": 16790876160, "percent": 75.2, "used": 50982633472, "free": 16790876160}, "host_cpu_percent": 19.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11356, 24463, 59, 33.01, 1575, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073059.9219725, "monotonic": 527792.109, "host_memory": {"total": 67773509632, "available": 16787402752, "percent": 75.2, "used": 50986106880, "free": 16787402752}, "host_cpu_percent": 16.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11356, 24463, 59, 37.58, 1170, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073060.993308, "monotonic": 527793.171, "host_memory": {"total": 67773509632, "available": 16779354112, "percent": 75.2, "used": 50994155520, "free": 16779354112}, "host_cpu_percent": 23.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11356, 24463, 60, 32.03, 1567, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073062.0605388, "monotonic": 527794.25, "host_memory": {"total": 67773509632, "available": 16792182784, "percent": 75.2, "used": 50981326848, "free": 16792182784}, "host_cpu_percent": 27.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 59, 32.19, 480, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073063.1269174, "monotonic": 527795.312, "host_memory": {"total": 67773509632, "available": 16781160448, "percent": 75.2, "used": 50992349184, "free": 16781160448}, "host_cpu_percent": 20.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 34.08, 1252, 810, 97, P5", "gpu_returncode": 0}
{"unix": 1790073064.196467, "monotonic": 527796.375, "host_memory": {"total": 67773509632, "available": 16756776960, "percent": 75.3, "used": 51016732672, "free": 16756776960}, "host_cpu_percent": 23.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 35.00, 1245, 810, 88, P5", "gpu_returncode": 0}
{"unix": 1790073065.2521548, "monotonic": 527797.437, "host_memory": {"total": 67773509632, "available": 16798359552, "percent": 75.2, "used": 50975150080, "free": 16798359552}, "host_cpu_percent": 19.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 33.07, 1282, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073066.3128324, "monotonic": 527798.5, "host_memory": {"total": 67773509632, "available": 16796217344, "percent": 75.2, "used": 50977292288, "free": 16796217344}, "host_cpu_percent": 18.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 36.09, 1252, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073067.3822408, "monotonic": 527799.562, "host_memory": {"total": 67773509632, "available": 16789254144, "percent": 75.2, "used": 50984255488, "free": 16789254144}, "host_cpu_percent": 22.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 33.53, 1072, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073068.4371066, "monotonic": 527800.625, "host_memory": {"total": 67773509632, "available": 16817254400, "percent": 75.2, "used": 50956255232, "free": 16817254400}, "host_cpu_percent": 17.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 31.94, 697, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073069.496982, "monotonic": 527801.671, "host_memory": {"total": 67773509632, "available": 16834895872, "percent": 75.2, "used": 50938613760, "free": 16834895872}, "host_cpu_percent": 18.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11519, 24463, 60, 32.15, 495, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073070.5679982, "monotonic": 527802.75, "host_memory": {"total": 67773509632, "available": 16837455872, "percent": 75.2, "used": 50936053760, "free": 16837455872}, "host_cpu_percent": 17.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11519, 24463, 60, 32.89, 472, 810, 99, P5", "gpu_returncode": 0}
{"unix": 1790073071.6297972, "monotonic": 527803.812, "host_memory": {"total": 67773509632, "available": 16826183680, "percent": 75.2, "used": 50947325952, "free": 16826183680}, "host_cpu_percent": 22.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11519, 24463, 60, 34.86, 1207, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073072.7028906, "monotonic": 527804.89, "host_memory": {"total": 67773509632, "available": 16819884032, "percent": 75.2, "used": 50953625600, "free": 16819884032}, "host_cpu_percent": 19.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11519, 24463, 60, 36.78, 645, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073073.7605267, "monotonic": 527805.937, "host_memory": {"total": 67773509632, "available": 16828915712, "percent": 75.2, "used": 50944593920, "free": 16828915712}, "host_cpu_percent": 16.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11519, 24463, 60, 32.32, 1155, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073074.8304596, "monotonic": 527807.015, "host_memory": {"total": 67773509632, "available": 16811077632, "percent": 75.2, "used": 50962432000, "free": 16811077632}, "host_cpu_percent": 15.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11515, 24463, 60, 36.73, 1170, 810, 99, P5", "gpu_returncode": 0}
{"unix": 1790073075.8934445, "monotonic": 527808.078, "host_memory": {"total": 67773509632, "available": 16806559744, "percent": 75.2, "used": 50966949888, "free": 16806559744}, "host_cpu_percent": 15.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 34.14, 922, 810, 99, P5", "gpu_returncode": 0}
{"unix": 1790073076.96209, "monotonic": 527809.14, "host_memory": {"total": 67773509632, "available": 16806060032, "percent": 75.2, "used": 50967449600, "free": 16806060032}, "host_cpu_percent": 17.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 32.68, 667, 810, 99, P5", "gpu_returncode": 0}
{"unix": 1790073078.0309515, "monotonic": 527810.218, "host_memory": {"total": 67773509632, "available": 16970207232, "percent": 75.0, "used": 50803302400, "free": 16970207232}, "host_cpu_percent": 16.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 30.46, 382, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073079.09318, "monotonic": 527811.281, "host_memory": {"total": 67773509632, "available": 16981843968, "percent": 74.9, "used": 50791665664, "free": 16981843968}, "host_cpu_percent": 17.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 31.77, 270, 810, 99, P5", "gpu_returncode": 0}
{"unix": 1790073080.1545877, "monotonic": 527812.343, "host_memory": {"total": 67773509632, "available": 17000894464, "percent": 74.9, "used": 50772615168, "free": 17000894464}, "host_cpu_percent": 16.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 36.62, 1440, 810, 94, P5", "gpu_returncode": 0}
{"unix": 1790073081.2193925, "monotonic": 527813.406, "host_memory": {"total": 67773509632, "available": 17000775680, "percent": 74.9, "used": 50772733952, "free": 17000775680}, "host_cpu_percent": 19.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 34.65, 1110, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073082.2894878, "monotonic": 527814.468, "host_memory": {"total": 67773509632, "available": 16998092800, "percent": 74.9, "used": 50775416832, "free": 16998092800}, "host_cpu_percent": 20.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 32.75, 877, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073083.3545184, "monotonic": 527815.531, "host_memory": {"total": 67773509632, "available": 16988741632, "percent": 74.9, "used": 50784768000, "free": 16988741632}, "host_cpu_percent": 16.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 30.93, 487, 810, 93, P5", "gpu_returncode": 0}
{"unix": 1790073084.407733, "monotonic": 527816.593, "host_memory": {"total": 67773509632, "available": 16987906048, "percent": 74.9, "used": 50785603584, "free": 16987906048}, "host_cpu_percent": 16.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 31.46, 345, 810, 99, P5", "gpu_returncode": 0}
{"unix": 1790073085.465151, "monotonic": 527817.64, "host_memory": {"total": 67773509632, "available": 16987856896, "percent": 74.9, "used": 50785652736, "free": 16987856896}, "host_cpu_percent": 16.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 29.78, 232, 810, 99, P5", "gpu_returncode": 0}
{"unix": 1790073086.5244863, "monotonic": 527818.703, "host_memory": {"total": 67773509632, "available": 16976936960, "percent": 75.0, "used": 50796572672, "free": 16976936960}, "host_cpu_percent": 23.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 29.69, 210, 810, 99, P5", "gpu_returncode": 0}
{"unix": 1790073087.5956213, "monotonic": 527819.781, "host_memory": {"total": 67773509632, "available": 16994263040, "percent": 74.9, "used": 50779246592, "free": 16994263040}, "host_cpu_percent": 25.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 61, 32.51, 1200, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073088.6655128, "monotonic": 527820.843, "host_memory": {"total": 67773509632, "available": 16998240256, "percent": 74.9, "used": 50775269376, "free": 16998240256}, "host_cpu_percent": 21.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 61, 34.98, 885, 810, 93, P5", "gpu_returncode": 0}
{"unix": 1790073089.7297025, "monotonic": 527821.906, "host_memory": {"total": 67773509632, "available": 16994037760, "percent": 74.9, "used": 50779471872, "free": 16994037760}, "host_cpu_percent": 16.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 32.82, 510, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073090.788255, "monotonic": 527822.968, "host_memory": {"total": 67773509632, "available": 16987996160, "percent": 74.9, "used": 50785513472, "free": 16987996160}, "host_cpu_percent": 17.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 30.81, 367, 810, 100, P5", "gpu_returncode": 0}
{"unix": 1790073091.8441916, "monotonic": 527824.031, "host_memory": {"total": 67773509632, "available": 16979169280, "percent": 74.9, "used": 50794340352, "free": 16979169280}, "host_cpu_percent": 17.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 31.23, 277, 810, 98, P5", "gpu_returncode": 0}
{"unix": 1790073092.9192905, "monotonic": 527825.109, "host_memory": {"total": 67773509632, "available": 16984084480, "percent": 74.9, "used": 50789425152, "free": 16984084480}, "host_cpu_percent": 20.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 29.30, 210, 810, 94, P5", "gpu_returncode": 0}
{"unix": 1790073093.986128, "monotonic": 527826.171, "host_memory": {"total": 67773509632, "available": 16978178048, "percent": 74.9, "used": 50795331584, "free": 16978178048}, "host_cpu_percent": 19.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 29.55, 210, 810, 99, P5", "gpu_returncode": 0}
{"unix": 1790073095.0567393, "monotonic": 527827.234, "host_memory": {"total": 67773509632, "available": 16973271040, "percent": 75.0, "used": 50800238592, "free": 16973271040}, "host_cpu_percent": 16.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 60, 33.98, 337, 810, 99, P5", "gpu_returncode": 0}
{"unix": 1790073096.122298, "monotonic": 527828.296, "host_memory": {"total": 67773509632, "available": 16974827520, "percent": 75.0, "used": 50798682112, "free": 16974827520}, "host_cpu_percent": 15.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 11506, 24463, 61, 33.08, 532, 810, 100, P5", "gpu_returncode": 0}
@@ -0,0 +1,160 @@
{
"role": "stage0",
"pid": 1528777,
"started_at": 1790072253.224225,
"dumped_at": 1790073094.2435145,
"counters": {
"predictor.substep_ms": {
"count": 120,
"sum_ms": 7114.086820045486,
"mean_ms": 59.284056833712384,
"p50_ms": 0.8641909807920456,
"p95_ms": 2.0049280137754977,
"max_ms": 6996.862919011619
},
"predictor.loop_ms": {
"count": 8,
"sum_ms": 7114.636765967589,
"mean_ms": 889.3295957459486,
"p50_ms": 15.883203013800085,
"p95_ms": 7017.380247008987,
"max_ms": 7017.380247008987
},
"sched.schedule_ms": {
"count": 325,
"sum_ms": 36.59702732693404,
"mean_ms": 0.11260623792902781,
"p50_ms": 0.10600103996694088,
"p95_ms": 0.15756901120766997,
"max_ms": 0.29125396395102143
},
"model.forward_ms": {
"count": 321,
"sum_ms": 208.49910972174257,
"mean_ms": 0.6495299368278584,
"p50_ms": 0.3144769580103457,
"p95_ms": 0.5147670162841678,
"max_ms": 70.683536992874
},
"model.sample_meta_ms": {
"count": 321,
"sum_ms": 0.11438841465860605,
"mean_ms": 0.0003563502014286793,
"p50_ms": 0.00033102696761488914,
"p95_ms": 0.0005310284905135632,
"max_ms": 0.0007519847713410854
},
"model.sample_async_ids_ms": {
"count": 321,
"sum_ms": 5.493110045790672,
"mean_ms": 0.017112492354488074,
"p50_ms": 0.016572012100368738,
"p95_ms": 0.022804015316069126,
"max_ms": 0.04093802999705076
},
"sampler.apply_penalties_ms": {
"count": 321,
"sum_ms": 265.68352698814124,
"mean_ms": 0.8276745389038668,
"p50_ms": 0.4828769597224891,
"p95_ms": 0.6523249903693795,
"max_ms": 93.48516998579726
},
"sampler.apply_logits_processors_ms": {
"count": 321,
"sum_ms": 270.7442201208323,
"mean_ms": 0.8434399380711287,
"p50_ms": 0.49439899157732725,
"p95_ms": 0.6830859929323196,
"max_ms": 93.54934201110154
},
"sampler.apply_temperature_ms": {
"count": 321,
"sum_ms": 8.218234404921532,
"mean_ms": 0.025601976339319415,
"p50_ms": 0.021701038349419832,
"p95_ms": 0.04351197276264429,
"max_ms": 0.19274099031463265
},
"sampler.topk_topp_ms": {
"count": 321,
"sum_ms": 100.41112406179309,
"mean_ms": 0.31280724006789123,
"p50_ms": 0.2993680536746979,
"p95_ms": 0.41781296022236347,
"max_ms": 0.5838240031152964
},
"sampler.sample_ms": {
"count": 321,
"sum_ms": 116.5034897858277,
"mean_ms": 0.36293922051659716,
"p50_ms": 0.3420389839448035,
"p95_ms": 0.5044480203650892,
"max_ms": 1.2833770015276968
},
"model.sampler_call_ms": {
"count": 321,
"sum_ms": 408.9381185476668,
"mean_ms": 1.2739505250706131,
"p50_ms": 0.9149680263362825,
"p95_ms": 1.2167709646746516,
"max_ms": 94.01413495652378
},
"model.sample_ms": {
"count": 321,
"sum_ms": 420.57027702685446,
"mean_ms": 1.3101877788998582,
"p50_ms": 0.9457849664613605,
"p95_ms": 1.253729045856744,
"max_ms": 94.06638395739719
},
"model.talker_mtp_ms": {
"count": 321,
"sum_ms": 1.7886252026073635,
"mean_ms": 0.005572041129617955,
"p50_ms": 0.005401030648499727,
"p95_ms": 0.006522051990032196,
"max_ms": 0.029686023481190205
},
"core.step_ms": {
"count": 326,
"sum_ms": 42604.8466093489,
"mean_ms": 130.6897135256101,
"p50_ms": 100.63512297347188,
"p95_ms": 341.00765601033345,
"max_ms": 3380.779776023701
},
"model.mtp_graph_ms": {
"count": 317,
"sum_ms": 207.45058997999877,
"mean_ms": 0.6544182649211318,
"p50_ms": 0.47454098239541054,
"p95_ms": 0.9955900022760034,
"max_ms": 4.248459008522332
},
"sched.update_from_output_ms": {
"count": 323,
"sum_ms": 43.56722842203453,
"mean_ms": 0.13488306013013787,
"p50_ms": 0.12877502012997866,
"p95_ms": 0.18921896116808057,
"max_ms": 0.31910103280097246
},
"hop.enqueue_to_put_ms": {
"count": 25,
"sum_ms": 19.593482953496277,
"mean_ms": 0.7837393181398511,
"p50_ms": 0.7369740051217377,
"p95_ms": 1.0607269941829145,
"max_ms": 1.0777040151879191
},
"hop.put_ms": {
"count": 25,
"sum_ms": 20.97717596916482,
"mean_ms": 0.8390870387665927,
"p50_ms": 0.48981100553646684,
"p95_ms": 1.1628659558482468,
"max_ms": 8.896563027519733
}
}
}
@@ -0,0 +1,56 @@
{
"role": "stage1",
"pid": 1528780,
"started_at": 1790073049.874202,
"dumped_at": 1790073096.2481904,
"counters": {
"sched.schedule_ms": {
"count": 26521,
"sum_ms": 1266.4158698171377,
"mean_ms": 0.04775143734463775,
"p50_ms": 0.03533699782565236,
"p95_ms": 0.12779299868270755,
"max_ms": 1.216873002704233
},
"core.step_ms": {
"count": 26524,
"sum_ms": 14961.606584722176,
"mean_ms": 0.5640780645725447,
"p50_ms": 0.13060797937214375,
"p95_ms": 0.5886380095034838,
"max_ms": 1493.6476459843107
},
"hop.poll_miss_ms": {
"count": 27883,
"sum_ms": 608.0980958649889,
"mean_ms": 0.021808919264963915,
"p50_ms": 0.010068994015455246,
"p95_ms": 0.04740001168102026,
"max_ms": 6.650844996329397
},
"sched.update_from_output_ms": {
"count": 26520,
"sum_ms": 186.78106227889657,
"mean_ms": 0.007043026481104697,
"p50_ms": 0.0055310083553195,
"p95_ms": 0.019346014596521854,
"max_ms": 0.16031000996008515
},
"hop.get_ms": {
"count": 26,
"sum_ms": 29.361987952142954,
"mean_ms": 1.129307228928575,
"p50_ms": 0.34868199145421386,
"p95_ms": 9.432343009393662,
"max_ms": 9.98165097553283
},
"hop.put_to_get_ms": {
"count": 26,
"sum_ms": 152.9715061187744,
"mean_ms": 5.8835194661067085,
"p50_ms": 5.380868911743164,
"p95_ms": 8.458614349365234,
"max_ms": 11.728525161743164
}
}
}
@@ -0,0 +1,269 @@
{
"status": "running",
"argv": [
"benchmarks/edge_harness/profile_local_tts.py",
"--model",
"/home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5",
"--out",
"../analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl-attribution",
"--length-band",
"medium",
"--concurrency",
"1",
"--repeats",
"20",
"--sustained-seconds",
"0"
],
"python": "/home/zhout/project/edge_infer/vllm-omni-edge/../.venvs/omni-cuda-029/bin/python",
"host_environment": {
"CUDA_HOME": "/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13"
},
"platform": "Linux-6.18.33.2-microsoft-standard-WSL2-x86_64-with-glibc2.43",
"runtime": {
"python": "3.12.13",
"platform": "Linux-6.18.33.2-microsoft-standard-WSL2-x86_64-with-glibc2.43",
"torch": "2.13.0+cu130",
"vllm": "0.29.0",
"vllm_omni": "0.29.0rc2.dev71+g00510ce38.d20260922",
"vllm_omni_file": "/home/zhout/project/edge_infer/vllm-omni-edge/vllm_omni/__init__.py",
"vllm_file": "/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/vllm/__init__.py",
"checkouts": {
"/home/zhout/project/edge_infer/vllm-omni-edge": "ab2f2a3d658db5be5ec96a950da55cb74b48e7aa-dirty",
"/home/zhout/project/edge_infer": "758b3af238b19e2c2abc668f23a767bb835a4a22-dirty"
}
},
"settings": {
"model": "/home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5",
"out": "../analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl-attribution",
"repeats": 20,
"sustained_seconds": 0.0,
"length_band": "medium",
"concurrency": 1
},
"start_unix": 1790072208.7752407,
"requests": 3,
"cache_condition": "existing disk/JIT caches; not cold disk",
"quality_gate": "finite PCM checks only; ASR/speaker/listening reference gates pending",
"playback_scope": "arrival-based simulated playback; no sound-device measurement",
"terminal_audio": "DELTA output required; terminal audio is included once in complete playback metrics and archived separately",
"prompts": {
"short": {
"prompt_token_ids": [
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0
],
"additional_information": {
"task_type": [
"CustomVoice"
],
"text": [
"Hello, this is a speech test."
],
"language": [
"English"
],
"speaker": [
"Vivian"
]
}
},
"medium": {
"prompt_token_ids": [
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0
],
"additional_information": {
"task_type": [
"CustomVoice"
],
"text": [
"The garden has trees, flowers, and a small pond. We walk along the path and listen to the birds."
],
"language": [
"English"
],
"speaker": [
"Vivian"
],
"global_request_id": [
"measured-medium-1-3-a9ae9432"
]
}
},
"long": {
"prompt_token_ids": [
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0,
0
],
"additional_information": {
"task_type": [
"CustomVoice"
],
"text": [
"Today we are testing a local speech system. It should speak clearly and keep the audio flowing smoothly. Today we are testing a local speech system. It should speak clearly and keep the audio flowing smoothly. Today we are testing a local speech system. It should speak clearly and keep the audio flowing smoothly. Today we are testing a local speech system. It should speak clearly and keep the audio flowing smoothly. "
],
"language": [
"English"
],
"speaker": [
"Vivian"
]
}
}
},
"startup_s": 842.4820281619905,
"sampling_params": [
"SamplingParams(n=1, presence_penalty=0.0, frequency_penalty=0.0, repetition_penalty=1.05, temperature=0.9, top_p=1.0, top_k=50, min_p=0.0, seed=None, stop=[], stop_token_ids=[2150], bad_words=[], thinking_token_budget=None, include_stop_str_in_output=False, ignore_eos=False, max_tokens=4096, min_tokens=2, logprobs=None, prompt_logprobs=None, skip_special_tokens=True, spaces_between_special_tokens=True, structured_outputs=None, extra_args=None)",
"SamplingParams(n=1, presence_penalty=0.0, frequency_penalty=0.0, repetition_penalty=1.0, temperature=0.0, top_p=1.0, top_k=0, min_p=0.0, seed=None, stop=[], stop_token_ids=[], bad_words=[], thinking_token_budget=None, include_stop_str_in_output=False, ignore_eos=False, max_tokens=65536, min_tokens=0, logprobs=None, prompt_logprobs=None, skip_special_tokens=True, spaces_between_special_tokens=True, structured_outputs=None, extra_args=None)"
],
"memory_after_load": {
"samples": 2504,
"interval_s": 0.25,
"note": "peaks are lower bounds: anything shorter than interval_s is missed. nvml_device_used is the whole card including other processes; tree_pss includes a share of file-backed pages. These three counters are different accountings and must not be summed.",
"nvml_device_used_peak": 25472774144,
"nvml_device_used_min": 3440640000,
"tree_rss_peak": 6974894080,
"tree_pss_peak": 5938809856,
"host_available_min": 25622679552
}
}
@@ -0,0 +1,3 @@
{"request_id": "warmup-medium-1-1", "phase": "warmup", "length_band": "medium", "submitted_unix": 1790073051.5720665, "finished_unix": 1790073069.8577769, "concurrency": 1, "sr": 24000, "chunks_all": [{"idx": 0, "t_ms": 4008.336253988091, "samples": 3840, "sr": 24000, "request_id": "warmup-medium-1-1", "terminal": false, "sha256": "aeb469aa6da8e9d4476a94dbcb92a11a6050c1c91e81318fbbb7facdc8bd9f95", "finite": true}, {"idx": 1, "t_ms": 5156.378392945044, "samples": 7680, "sr": 24000, "request_id": "warmup-medium-1-1", "terminal": false, "sha256": "e43cd0eda71cb45a6efe2b25f35b51ab6a50e2d0ee2afc426703ee96cce5d2dd", "finite": true}, {"idx": 2, "t_ms": 6873.761094990186, "samples": 15360, "sr": 24000, "request_id": "warmup-medium-1-1", "terminal": false, "sha256": "c2b27b13e53cf409c4c5e764ca250f69d0f8eb9de161096336617cdd2b8a1619", "finite": true}, {"idx": 3, "t_ms": 9774.867150990758, "samples": 30720, "sr": 24000, "request_id": "warmup-medium-1-1", "terminal": false, "sha256": "dafe35316341bd10591f9b9d0543ef1d67766f519dd698f26a7b540c05c6c9d4", "finite": true}, {"idx": 4, "t_ms": 12343.699316959828, "samples": 48000, "sr": 24000, "request_id": "warmup-medium-1-1", "terminal": false, "sha256": "6489a8816bee3716abce08105c55d2b21168c5ea0f2b7f67187d171d23e30d87", "finite": true}, {"idx": 5, "t_ms": 15159.090776985977, "samples": 48000, "sr": 24000, "request_id": "warmup-medium-1-1", "terminal": false, "sha256": "faf97cbd14cbe8b552516e470522aef5b9548dc5914139ba420afe944ed5b447", "finite": true}, {"idx": 6, "t_ms": 17899.83447897248, "samples": 48000, "sr": 24000, "request_id": "warmup-medium-1-1", "terminal": false, "sha256": "06957c9915d2006591af01fd5ebddf990fb6b8596634bbc816ee46d32101b4fc", "finite": true}, {"idx": 7, "t_ms": 18285.502880986314, "samples": 1920, "sr": 24000, "request_id": "warmup-medium-1-1", "terminal": true, "sha256": "a3b51d29890cc70ae9dfd629f94c8c3a1739c640da7aed600ef787a9c979305f", "finite": true}], "finished": true, "terminal_audio_s": 0.08, "prefix_metrics": {"ttfa_ms": 4008.336253988091, "playback_start_ms": 11499.83447897248, "stall_at_ttfa_ms": 7491.498224984389, "n_chunks": 7, "streamed_audio_s": 8.4, "tail_audio_s": 0.0, "total_wall_s": 18.28570738894632, "rtf_streamed": 2.130932676068152, "rtf_total": 2.176869927255514, "gap_ms": [1148.0421389569528, 1717.3827020451427, 2901.1060560005717, 2568.83216596907, 2815.3914600261487, 2740.743701986503]}, "ttfa_ms": 4008.336253988091, "playback_start_ms": 11499.83447897248, "stall_at_ttfa_ms": 7491.498224984389, "n_chunks": 8, "streamed_audio_s": 8.48, "tail_audio_s": 0.0, "total_wall_s": 18.28570738894632, "rtf_streamed": 2.156309302003103, "rtf_total": 2.156333418507821, "gap_ms": [1148.0421389569528, 1717.3827020451427, 2901.1060560005717, 2568.83216596907, 2815.3914600261487, 2740.743701986503, 385.66840201383457], "underruns": [[1, 988.0421389569528], [2, 1397.3827020451427], [3, 2261.1060560005717], [4, 1288.83216596907], [5, 815.3914600261487], [6, 740.7437019865029]]}
{"request_id": "measured-medium-1-2", "phase": "measured", "length_band": "medium", "submitted_unix": 1790073069.8612363, "finished_unix": 1790073081.2488308, "concurrency": 1, "sr": 24000, "chunks_all": [{"idx": 0, "t_ms": 340.1309869950637, "samples": 3840, "sr": 24000, "request_id": "measured-medium-1-2", "terminal": false, "sha256": "ebd3c0be9445000c0c97c6e5ee73f4b1337d35c3683eb00e6c0794e6bf0266c5", "finite": true}, {"idx": 1, "t_ms": 807.4336279532872, "samples": 7680, "sr": 24000, "request_id": "measured-medium-1-2", "terminal": false, "sha256": "368e8800433ca6d8530a233dc84137e867e39cc3eee5ac4ebde8a6ef9439b5ae", "finite": true}, {"idx": 2, "t_ms": 1696.4566969545558, "samples": 15360, "sr": 24000, "request_id": "measured-medium-1-2", "terminal": false, "sha256": "bebddea30509c54551bd3701dd595b2d333c1dc78e6029bc4d4357f83ad0ed70", "finite": true}, {"idx": 3, "t_ms": 3590.58236295823, "samples": 30720, "sr": 24000, "request_id": "measured-medium-1-2", "terminal": false, "sha256": "019ad9b5be5ac8f459ee809937e4f34e86a12f68e1995e02a8fb53ce681ac9c1", "finite": true}, {"idx": 4, "t_ms": 6478.935356950387, "samples": 48000, "sr": 24000, "request_id": "measured-medium-1-2", "terminal": false, "sha256": "6ce741ff7135b2dc9cf65a6ce8e6d5e3a4f6b186302303677accabe6da84e50b", "finite": true}, {"idx": 5, "t_ms": 9269.84086498851, "samples": 48000, "sr": 24000, "request_id": "measured-medium-1-2", "terminal": false, "sha256": "ca9e32d7e715af71016c9acfe64387cad4b0d67ee87070792413c811c2659424", "finite": true}, {"idx": 6, "t_ms": 11386.601840960793, "samples": 34560, "sr": 24000, "request_id": "measured-medium-1-2", "terminal": true, "sha256": "5409ac5990349fa7ac601ed0ab6921eafe7e769ecabea71147354a6c22be0bb8", "finite": true}], "finished": true, "terminal_audio_s": 1.44, "prefix_metrics": {"ttfa_ms": 340.1309869950637, "playback_start_ms": 4869.84086498851, "stall_at_ttfa_ms": 4529.709877993446, "n_chunks": 6, "streamed_audio_s": 6.4, "tail_audio_s": 0.0, "total_wall_s": 11.387590678990819, "rtf_streamed": 1.4484126351544546, "rtf_total": 1.7793110435923154, "gap_ms": [467.3026409582235, 889.0230690012686, 1894.1256660036743, 2888.3529939921573, 2790.905508038122]}, "ttfa_ms": 340.1309869950637, "playback_start_ms": 4986.601840960793, "stall_at_ttfa_ms": 4646.4708539657295, "n_chunks": 7, "streamed_audio_s": 7.84, "tail_audio_s": 0.0, "total_wall_s": 11.387590678990819, "rtf_streamed": 1.4523726837960196, "rtf_total": 1.4524988110957677, "gap_ms": [467.3026409582235, 889.0230690012686, 1894.1256660036743, 2888.3529939921573, 2790.905508038122, 2116.7609759722836], "underruns": [[1, 307.3026409582235], [2, 569.0230690012686], [3, 1254.1256660036743], [4, 1608.3529939921573], [5, 790.9055080381222], [6, 116.76097597228363]]}
{"request_id": "measured-medium-1-3", "phase": "measured", "length_band": "medium", "submitted_unix": 1790073081.2497914, "finished_unix": 1790073092.4446135, "concurrency": 1, "sr": 24000, "chunks_all": [{"idx": 0, "t_ms": 337.1591470204294, "samples": 3840, "sr": 24000, "request_id": "measured-medium-1-3", "terminal": false, "sha256": "7cea018b33f9fab1c47ce127970cc3a7cb7467a5dad1e4fb71947b9216192f4c", "finite": true}, {"idx": 1, "t_ms": 826.957251993008, "samples": 7680, "sr": 24000, "request_id": "measured-medium-1-3", "terminal": false, "sha256": "d7306b36631771f0b163615dedb3b3912c7f93777b5d7d0d798a13e22492962f", "finite": true}, {"idx": 2, "t_ms": 1805.7387190056033, "samples": 15360, "sr": 24000, "request_id": "measured-medium-1-3", "terminal": false, "sha256": "8603d1ccf053eb2d6bcdc79ad9b1b2a07302e8a43f22ca48b2a376a886b8d299", "finite": true}, {"idx": 3, "t_ms": 3705.665384011809, "samples": 30720, "sr": 24000, "request_id": "measured-medium-1-3", "terminal": false, "sha256": "51ed7fb4017895fc04b32c980053301e714d7f3d390956c10ba8203ed2fb870f", "finite": true}, {"idx": 4, "t_ms": 6533.934303035494, "samples": 48000, "sr": 24000, "request_id": "measured-medium-1-3", "terminal": false, "sha256": "359ff8c539f455add0bed7813057557949e76b8419d4b1e2d6def1e2447b5b1d", "finite": true}, {"idx": 5, "t_ms": 9492.038400028832, "samples": 48000, "sr": 24000, "request_id": "measured-medium-1-3", "terminal": false, "sha256": "0ecad2d1739fdcb383bd8261872d3e572c34ef696ee0d27715ddaefa71e92b09", "finite": true}, {"idx": 6, "t_ms": 11194.502194004599, "samples": 26880, "sr": 24000, "request_id": "measured-medium-1-3", "terminal": true, "sha256": "e0a59c2f805b168388f2cb462841faebf12d18372793c216da752560346831c8", "finite": true}], "finished": true, "terminal_audio_s": 1.12, "prefix_metrics": {"ttfa_ms": 337.1591470204294, "playback_start_ms": 5092.038400028832, "stall_at_ttfa_ms": 4754.879253008403, "n_chunks": 6, "streamed_audio_s": 6.4, "tail_audio_s": 0.0, "total_wall_s": 11.194819235999603, "rtf_streamed": 1.483131000004505, "rtf_total": 1.749190505624938, "gap_ms": [489.7981049725786, 978.7814670125954, 1899.9266650062054, 2828.268919023685, 2958.1040969933383]}, "ttfa_ms": 337.1591470204294, "playback_start_ms": 5092.038400028832, "stall_at_ttfa_ms": 4754.879253008403, "n_chunks": 7, "streamed_audio_s": 7.52, "tail_audio_s": 0.0, "total_wall_s": 11.194819235999603, "rtf_streamed": 1.488630610904867, "rtf_total": 1.4886727707446281, "gap_ms": [489.7981049725786, 978.7814670125954, 1899.9266650062054, 2828.268919023685, 2958.1040969933383, 1702.4637939757667], "underruns": [[1, 329.7981049725786], [2, 658.7814670125954], [3, 1259.9266650062054], [4, 1548.2689190236852], [5, 958.1040969933383]]}
@@ -0,0 +1,59 @@
{
"status": "verified",
"cells": 60,
"profiled_paths": 5,
"measured_baseline_requests": 900,
"trace_files": [
{
"path": "spark-cpu-wsl-trace/traces/profiler_out_0.txt",
"sha256": "04ca3c8494c773c191a7b89544c5bfd27fad017d7da3a05a3d83af6cb340cbc7"
},
{
"path": "spark-cpu-wsl-trace/traces/1790073491843072609-rank-0.1790073527497371957.pt.trace.json",
"sha256": "071c819a66987259e8d6aa420f135c674438d991a5016c1d41615a4280960de0"
},
{
"path": "spark-cuda-wsl-trace/traces/20260922-171224_e2e-diagnostic/trace_rank0.json.gz",
"sha256": "096f3cbd5f65e5d614eaabee270495a754a1cd4946e0f75c4703c844db9f741e"
},
{
"path": "spark-cuda-windows-trace/traces/20260922-171601_e2e-diagnostic/trace_rank0.json",
"sha256": "cb3db8804f8350585f09010704590d916913e08a511adb1b9b6511618e5bb82b"
},
{
"path": "tts-cuda-wsl-trace/traces/20260922-185614_e2e-stage1/trace_rank0.json",
"sha256": "b2ce835bb81df5a2d7e4e3894f7d2a6267cbd3b7a2664de4fceefd0b666d36ca"
},
{
"path": "tts-cuda-wsl-trace/traces/20260922-185614_e2e-stage0/trace_rank0.json",
"sha256": "7f7fd56ff97afc0a5d6cc2325ade11032cdd4b50dda10b7da4e081e5bc233df9"
},
{
"path": "tts-cuda-windows-trace/traces/20260922-185848_e2e-stage0/trace_rank0.json",
"sha256": "07510fee2ba52a5e2fd823738a829b2100c6125480005a7e3ae379fc629a874a"
},
{
"path": "tts-cuda-windows-trace/traces/20260922-185848_e2e-stage1/trace_rank0.json",
"sha256": "82e6e3d6ebd1a77704fb00105d6f99e3647817f292b7c0503b5939ed5141d9cc"
}
],
"counter_files": [
{
"path": "tts-cuda-wsl-attribution-step-stats/stage0_1628534.json",
"sha256": "cf3c11fd9475d555ec339ae6cdc51f9a3ca508d0ce3343a7a1c0c96e7cc13b78"
},
{
"path": "tts-cuda-wsl-attribution-step-stats/stage1_1628537.json",
"sha256": "0109a0871a4db87778f62ffad628e93c29ace126f28bb69784ec95978e8802c4"
},
{
"path": "tts-cuda-windows-attribution-step-stats\\stage0_62016.json",
"sha256": "7ff79e2d17f2d1016a7239ccf70c0a6e2df601443fd63284b17d2437cb701a39"
},
{
"path": "tts-cuda-windows-attribution-step-stats\\stage1_13708.json",
"sha256": "b098ac3e0e0caca3bb5ab7f3ed0d31c5228c02af82c836af9fcdd99bc5c153f5"
}
],
"scope": "Terminal sample coverage and source artifact integrity; not model-quality or release qualification."
}
@@ -0,0 +1,16 @@
{
"checked_at": "2026-09-22T17:51:31+08:00",
"scope": "Single read during Windows TTS sustained execution; not a CPU-only sustained-frequency trace",
"Win32_Processor": {
"Name": "AMD Ryzen AI 9 HX 370 w/ Radeon 890M",
"CurrentClockSpeed": 2000,
"MaxClockSpeed": 2000
},
"Win32_PerfFormattedData_Counters_ProcessorInformation": {
"Name": "_Total",
"ProcessorFrequency": 2000,
"PercentProcessorPerformance": 200,
"PercentofMaximumFrequency": 100
},
"qualification": "WMI nominal/aggregate counters are exposed. No calibrated effective per-core frequency mapping or sustained CPU-frequency trace was collected; do not infer CPU clocks or thermal throttling from the GPU counters."
}
@@ -0,0 +1,6 @@
{
"checked_at": "2026-09-22T14:20:41.7894572+08:00",
"scope": "CPU package temperature availability; ACPI zones are not assumed CPU package sensors",
"acpi_error": "拒绝访问 ",
"power_scheme": "电源方案 GUID: 27fa6203-3987-4dcc-918d-748559d549ec (Performance)\r\n"
}
@@ -0,0 +1,5 @@
{
"timestamp": 1790058042.2009394,
"temperature_sensor_paths": [],
"note": "Empty list means no exposed hwmon/thermal_zone temperature sensors in this WSL environment"
}
@@ -0,0 +1,27 @@
{
"status": "exited",
"pid": 19252,
"predecessor_pid": 27528,
"predecessor_created": 1790067499.6468523,
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_host_command.py",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\spark-cpu-wsl-trace-host",
"--cwd",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge",
"--",
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_CPU_KVCACHE_SPACE=2 OMP_NUM_THREADS=8 timeout 900 ../.venvs/omni-cpu/bin/python benchmarks/edge_harness/profile_trace_diagnostic.py --kind spark --model ../models/Spark-X2.5-1.7B-int8 --out ../analysis/experiments/e2e_profiling_20260922/spark-cpu-wsl-trace"
],
"start": 1790073480.1387935,
"returncode": 0,
"summarize_e2e_profiles.py": 0,
"analyze_profile_resources.py": 0,
"end": 1790073601.112772
}
@@ -0,0 +1,99 @@
{
"status": "exited",
"pid": 27376,
"predecessor_pid": 52656,
"predecessor_created": null,
"start": 1790065913.4098895,
"jobs": [
{
"name": "spark-cpu-wsl-trace",
"status": "exited",
"benchmark_status": "completed",
"reused_verified_report": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\spark-cpu-wsl-trace\\report.json"
},
{
"name": "spark-cuda-wsl-trace",
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/lib/wsl/lib timeout 1800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_trace_diagnostic.py --kind spark --model ../models/Spark-X2.5-4B --out ../analysis/experiments/e2e_profiling_20260922/spark-cuda-wsl-trace"
],
"status": "exited",
"start": 1790068263.6139073,
"returncode": 0,
"end": 1790068384.9514291,
"benchmark_status": "completed",
"error": null
},
{
"name": "spark-cuda-windows-trace",
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_trace_diagnostic.py",
"--kind",
"spark",
"--model",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Spark-X2.5-4B",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\spark-cuda-windows-trace"
],
"status": "exited",
"start": 1790068384.9575229,
"returncode": 0,
"end": 1790068648.1229272,
"benchmark_status": "completed",
"error": null
},
{
"name": "tts-cuda-wsl-trace",
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/lib/wsl/lib timeout 1800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_trace_diagnostic.py --kind tts --model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5 --out ../analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl-trace"
],
"status": "exited",
"start": 1790068648.1269243,
"returncode": 0,
"end": 1790068979.9018085,
"benchmark_status": "completed",
"error": null
},
{
"name": "tts-cuda-windows-trace",
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_trace_diagnostic.py",
"--kind",
"tts",
"--model",
"C:\\Users\\zhout\\w2\\models\\Qwen3-TTS-0.6B-85e237c",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\tts-cuda-windows-trace"
],
"status": "exited",
"start": 1790068979.908313,
"returncode": 0,
"end": 1790069182.5775964,
"benchmark_status": "completed",
"error": null
}
],
"baseline_retry": {
"name": "spark-cuda-windows",
"status": "exited",
"reason": "Missing VLLM_CUDART_SO_PATH in native launcher",
"start": 1790065913.5339177,
"returncode": 0,
"benchmark_status": "completed",
"end": 1790068263.0334463
},
"end": 1790069182.5821192
}
@@ -0,0 +1,45 @@
"""Resolve each requested requirement against terminal evidence and explicit gaps."""
import json
from pathlib import Path
import time
HERE = Path(__file__).resolve().parent
for name in ('windows-tts-retry', 'attribution', 'cpu-trace-refresh', 'tts-trace-refresh', 'attribution-retry'):
assert json.loads((HERE / (name + '-queue.json')).read_text())['status'] == 'exited', name
matrix = json.loads((HERE / 'summary/matrix.json').read_text())
assert len(matrix['cases']) == 60
runs = [c for c in matrix['cases'] if c['profiling']['status'] != 'not_run']
assert len(runs) == 5
assert all(c['profiling'].get('profile_protocol_complete') for c in runs), 'Inspect incomplete timing protocols first'
assert all(c.get('diagnostics', {}).get('trace', {}).get('status') == 'completed' for c in runs)
assert all(c.get('diagnostics', {}).get('reliability', {}).get('status') in ('completed', 'failed') for c in runs)
resources = json.loads((HERE / 'resource-summary.json').read_text())
assert resources['traces'] and all('error' not in r for r in resources['traces'])
audit = json.loads((HERE / 'requirements-audit.json').read_text())
updates = {
'S3': ('checked_with_limits', 'Exact local hardware, runtime packages, memory, OS, driver and AC/Performance conditions are recorded. Remote component targets lack full application access and complete device build/RAM/power inventories. CPU package temperature and whole-device/CPU/NPU energy are unavailable.', ['preflight-windows.json', 'preflight-wsl-cpu.json', 'resource-summary.json', 'prior-matrix/matrix.json']),
'S5': ('checked_with_blockers', 'Desktop real-model cancellation/recovery and worker-failure probes completed; inspect individual outcomes. Spark reached queue capacity and rejected stale state. Stateful mobile sessions and complete device-local controllers remain absent; TTS internal buffer saturation and universal shared-ledger release are not qualified.', ['summary/matrix.json', 'prior-evidence/README.md']),
'S6': ('completed_local_checks', 'Reusable text/TTS/host/trace/reliability runners and matrix/resource analyzers are implemented. All 60 pairs have evidence-backed dispositions; raw requests, warmup PCM, counters, traces and failed attempts are retained. Publication integrity is verified separately by the archive manifest.', ['summary/matrix.json', 'FINAL_REVIEW.md']),
'M2': ('checked_with_gaps', 'Both CUDA OS paths completed all nine measured groups and 30-minute sustained generation. Simulated playback deficits, model-specific speech/reference quality, forced normal shutdown and memory headroom remain findings. Mobile TTS and CPU compatibility remain blocked; see exact per-run counts and probe results.', ['FINAL_REVIEW.md', 'summary/matrix.json', 'resource-summary.json']),
'COVERAGE': ('completed_check', 'All 12 configurations x five models checked: five runnable current desktop paths profiled, 55 explicitly not E2E-profileable with reasons and next actions. Component and historical results are retained without promotion to complete pipelines.', ['summary/matrix.json', 'prior-matrix/matrix.json']),
'P1': ('measured_with_limits', 'Constructor startup, host-launch/import interval, first warmup and runtime-reported load/compile lines are retained separately. Existing disk/JIT caches were not purged; isolated cold compilation, cold-disk startup and exhaustive warm-restart distributions are not qualified.', ['resource-summary.json']),
'P2': ('completed_measurement', 'All five paths contain at least 20 measured requests in every short/medium/long x concurrency 1/2/4 group. Raw requests and nearest-rank p50/p95 are retained; warmup/sustained records are excluded from these percentiles.', ['summary/matrix.json']),
'P3': ('measured_with_quality_gaps', 'Text TTFT/decode/completion, effective prefill and delivery-spacing proxies; speech TTFA/RTF/chunk gaps/simulated underruns and interruption are measured. Text updates can coalesce tokens. Speech perceptual/tail/reference quality and independent text numerical parity are unqualified. Missing multimodal/VLA pipelines block modality/action/deadline measurements.', ['summary/matrix.json', 'FINAL_REVIEW.md']),
'P4': ('measured_with_accounting_gaps', 'Windows host RAM, WSL quota/process measurements and whole-GPU VRAM sampled during startup and runtime. Peaks are lower bounds; per-allocation weights/state/workspace/transfer attribution and complete native multi-pool admission remain unimplemented. WSL TTS briefly coincided with only 24.5 MB Windows RAM available; see raw sample.', ['resource-summary.json', 'tts-cuda-wsl-memory-headroom.json', 'prior-evidence/README.md']),
'P5': ('measured_with_limits', 'Actual CPU/CUDA runtime evidence, CUDA kernels/copies/runtime calls, and separate TTS stage counters retained. Stage-specific trace prefixes avoid the observed rank-0 filename collision. Counters are host timers with overlapping scopes, not pooled GPU latency. No unmeasured joint-device execution, fallback-free blanket claim or component-sum E2E speedup.', ['resource-summary.json', 'attribution-summary.json', 'summary/matrix.json']),
'P6': ('completed_measurement_with_sensor_gaps', 'All five paths completed at least 1800 seconds of medium-input concurrency-1 generation. Whole-NVIDIA-GPU clocks/power/temperature and host RAM sampled; first/last five-minute trends retained. CPU temperature and CPU/NPU/whole-device energy unavailable. GPU energy excludes telemetry gaps over five seconds and includes other processes.', ['resource-summary.json', 'cpu-sensor-availability-windows.json', 'cpu-sensor-availability-wsl.json']),
'P7': ('checked_with_limits', 'Repeated sessions, real slow consumers, cancellation/recovery, stale-state fencing, oversized text admission and owned-worker failures checked. Inspect per-probe flags/errors/cleanup. TTS full buffer saturation, destructive OOM recovery, every internal queue and exhaustive state-boundary cases are unqualified.', ['summary/matrix.json', 'FINAL_REVIEW.md']),
'P8': ('completed_diagnostics_with_limits', 'Separate three-before/three-traced/three-after diagnostics with profiler RPC times for each runnable path. Original CPU full trace and overwritten TTS traces preserved; final TTS traces use distinct stage prefixes. Tracing/export overhead is separate from baseline; stochastic speech length and sequential export idle time preclude a pure causal universal overhead ratio.', ['summary/matrix.json', 'resource-summary.json', 'trace-collision-1/tts-cuda-wsl-trace-host/command.log']),
'RELEASE': ('not_fully_qualified', 'Checks/profiles are complete for the executable current paths; full universal release gates are not met. Missing artifacts/backends/device access, quality suites, memory accounting and playback guarantees remain an explicit user repair backlog. The fork publication and archive hashes establish delivery/integrity, not model qualification.', ['FINAL_REVIEW.md', 'summary/matrix.json', 'resource-summary.json']),
}
for requirement in audit['requirements']:
if requirement['id'] in updates:
status, finding, evidence = updates[requirement['id']]
requirement.update(status=status, finding=finding, evidence=evidence)
assert 'pending' not in requirement['status'] and requirement['status'] != 'in_progress'
for source in requirement['evidence']:
assert (HERE / source).is_file(), source
audit['generated_unix'] = time.time()
audit['disposition'] = 'Implementation and unavailable qualification gates are recorded for later user repair; performance completion is separate from release qualification.'
(HERE / 'requirements-audit.json').write_text(json.dumps(audit, indent=2) + '\n')
print(f"Resolved {len(audit['requirements'])} requirement groups")
@@ -0,0 +1,105 @@
==============NVSMI LOG==============
Timestamp : Tue Sep 22 18:21:17 2026
Driver Version : 610.71 [Deprecated; will be removed in CUDA 14.0. Use KMD Version instead]
CUDA Version : 13.3 [Deprecated; will be removed in CUDA 14.0. Use CUDA UMD Version instead]
KMD Version : 610.71
CUDA UMD Version : 13.3
Attached GPUs : 1
GPU 00000000:64:00.0
Performance State : P5
Clocks Event Reasons
Idle : Not Active
Applications Clocks Setting : Not Active
SW Power Cap : Active
HW Slowdown : Not Active
HW Thermal Slowdown : Not Active
HW Power Brake Slowdown : Not Active
Sync Boost : Not Active
SW Thermal Slowdown : Not Active
Display Clock Setting : Not Active
Clocks Event Reasons Counters
SW Power Capping : 65277286042 us
Sync Boost : 0 us
SW Thermal Slowdown : 62604198347 us
HW Thermal Slowdown : 0 us
HW Power Braking : 17078 us
Sparse Operation Mode : N/A
Temperature
GPU Current Temp : 59 C
GPU Current T.Limit Temp : 28 C
GPU Shutdown T.Limit Temp Specification : -5 C
GPU Slowdown T.Limit Temp Specification : -2 C
GPU Max Operating T.Limit Temp Specification : 0 C
GPU Target Temperature Specification : 87 C
Memory Current Temp : N/A
Memory Max Operating T.Limit Temp Specification: N/A
GPU Power Readings
Average Power Draw : 0.00 W
Instantaneous Power Draw : 32.72 W
GPU Ceiling Power Limit
Current Power Limit : 33.00 W
Requested Power Limit : N/A
Default Power Limit : 95.00 W
GPU Base Power
Current Base Power : N/A
Requested Base Power : N/A
Default Base Power : N/A
Min Power Limit : 5.00 W
Max Power Limit : 130.00 W
Power Samples
Duration : Not Found
Number of Samples : Not Found
Max : Not Found
Min : Not Found
Avg : Not Found
GPU Memory Power Readings
Average Power Draw : N/A
Instantaneous Power Draw : N/A
Module Power Readings
Average Power Draw : N/A
Instantaneous Power Draw : N/A
Current Power Limit : N/A
Requested Power Limit : N/A
Default Power Limit : N/A
Min Power Limit : N/A
Max Power Limit : N/A
EDPp Multiplier : N/A
Clocks
Graphics : 1665 MHz
SM : 1665 MHz
Memory : 810 MHz
Video : 1462 MHz
Applications Clocks
Graphics : Requested functionality has been deprecated
Memory : Requested functionality has been deprecated
Default Applications Clocks
Graphics : Requested functionality has been deprecated
Memory : Requested functionality has been deprecated
Deferred Clocks
Memory : N/A
Max Clocks
Graphics : 3090 MHz
SM : 3090 MHz
Memory : 14001 MHz
Video : 3090 MHz
Max Customer Boost Clocks
Graphics : N/A
SM Clock Samples
Duration : N/A
Number of Samples : N/A
Max : N/A
Min : N/A
Avg : N/A
Memory Clock Samples
Duration : N/A
Number of Samples : N/A
Max : N/A
Min : N/A
Avg : N/A
Clock Policy
Auto Boost : N/A
Auto Boost Default : N/A
@@ -0,0 +1,22 @@
"""Read diagnostic outcomes through Linux without holding Windows report locks."""
import json,os
from pathlib import Path
assert os.name!='nt'
root=Path(__file__).resolve().parent
for path in sorted([*root.glob('*-trace/report.json'),*root.glob('*-reliability/report.json')]):
try:
r=json.loads(path.read_text())
except (FileNotFoundError,json.JSONDecodeError):
continue
d={'name':path.parent.name,'status':r.get('status'),'error':r.get('error')}
if path.parent.name.endswith('-trace'):
d.update(traces=len(r.get('traces',[])),medians=r.get('median_wall_s'),stop_rpc_s=r.get('stop_rpc_s'))
else:
for key in ('saturation_reached','same_tokens_after_saturation','stale_handle_rejected','oversized_plan_refused','cleanup_error'):
if key in r:
d[key]=r[key]
crash=r.get('crash_injection',r.get('crash',{}))
d['crash_error_reported']=crash.get('explicit_error_reported')
if 'owned_processes_requiring_harness_cleanup' in r:
d['forced_cleanup_count']=len(r['owned_processes_requiring_harness_cleanup'])
print(json.dumps(d))
@@ -0,0 +1,28 @@
"""Read live report snapshots from Linux, avoiding Windows deny-delete handles."""
import json
import os
from pathlib import Path
import time
assert os.name != 'nt', 'Run with the WSL Python interpreter.'
root=Path(__file__).resolve().parent
for name in ('spark-cpu-wsl','spark-cuda-wsl','spark-cuda-windows','tts-cuda-wsl','tts-cuda-windows'):
path=root/name/'report.json'
if not path.exists():
continue
try:
r=json.loads(path.read_text())
except json.JSONDecodeError:
print(json.dumps({'name':name,'status':'snapshot_mid_write'}))
continue
row={'name':name,**{key:r.get(key) for key in ('status','requests','error','sustained_wall_s','report_write_permission_errors')}}
if r.get('status')=='running' and r.get('sustained_start_unix'):
row['sustained_elapsed_s']=round(time.time()-r['sustained_start_unix'])
print(json.dumps(row))
for name in ('retry-status','diagnostic-queue','reliability-queue','tts-reliability-queue','analysis-queue','windows-tts-retry-queue','attribution-queue','cpu-trace-refresh-queue','tts-trace-refresh-queue','attribution-retry-queue'):
path=root/(name+'.json')
if path.exists():
try:
r=json.loads(path.read_text())
print(json.dumps({'queue':name,'status':r.get('status'),'pid':r.get('pid'),'baseline_retry':r.get('baseline_retry')}))
except json.JSONDecodeError:
print(json.dumps({'queue':name,'status':'snapshot_mid_write'}))
@@ -0,0 +1,102 @@
{
"status": "exited",
"pid": 20772,
"predecessor_pid": 40704,
"predecessor_created": 1790057338.4801023,
"start": 1790058105.191317,
"jobs": [
{
"name": "spark-cpu-wsl-trace",
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 VLLM_CPU_KVCACHE_SPACE=2 OMP_NUM_THREADS=8 timeout 1800 ../.venvs/omni-cpu/bin/python benchmarks/edge_harness/profile_trace_diagnostic.py --kind spark --model ../models/Spark-X2.5-1.7B-int8 --out ../analysis/experiments/e2e_profiling_20260922/spark-cpu-wsl-trace"
],
"status": "exited",
"start": 1790060190.5552063,
"returncode": 0,
"end": 1790060565.9332244,
"benchmark_status": "completed",
"error": null
},
{
"name": "spark-cuda-wsl-trace",
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:$PATH timeout 1800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_trace_diagnostic.py --kind spark --model ../models/Spark-X2.5-4B --out ../analysis/experiments/e2e_profiling_20260922/spark-cuda-wsl-trace"
],
"status": "exited",
"start": 1790060565.9372296,
"returncode": 2,
"end": 1790060567.46022,
"benchmark_status": "missing_report",
"error": null
},
{
"name": "spark-cuda-windows-trace",
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_trace_diagnostic.py",
"--kind",
"spark",
"--model",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Spark-X2.5-4B",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\spark-cuda-windows-trace"
],
"status": "exited",
"start": 1790060567.46322,
"returncode": 1,
"end": 1790060579.0515544,
"benchmark_status": "missing_report",
"error": null
},
{
"name": "tts-cuda-wsl-trace",
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:$PATH timeout 1800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_trace_diagnostic.py --kind tts --model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5 --out ../analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl-trace"
],
"status": "exited",
"start": 1790060579.05656,
"returncode": 2,
"end": 1790060580.542679,
"benchmark_status": "missing_report",
"error": null
},
{
"name": "tts-cuda-windows-trace",
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_trace_diagnostic.py",
"--kind",
"tts",
"--model",
"C:\\Users\\zhout\\w2\\models\\Qwen3-TTS-0.6B-85e237c",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\tts-cuda-windows-trace"
],
"status": "exited",
"start": 1790060580.5466845,
"returncode": 1,
"end": 1790060587.851317,
"benchmark_status": "missing_report",
"error": null
}
],
"end": 1790060587.8553176
}
@@ -0,0 +1,78 @@
{
"status": "exited",
"pid": 40704,
"start": 1790060171.7258117,
"jobs": [
{
"name": "spark-cuda-wsl",
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:$PATH timeout 10800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_local_text.py --model ../models/Spark-X2.5-4B --out ../analysis/experiments/e2e_profiling_20260922/spark-cuda-wsl"
],
"status": "exited",
"start": 1790060171.729809,
"returncode": 0,
"end": 1790060173.2586715,
"benchmark_status": "missing_report",
"error": null
},
{
"name": "spark-cuda-windows",
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_local_text.py",
"--model",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Spark-X2.5-4B",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\spark-cuda-windows"
],
"status": "exited",
"start": 1790060173.2616706,
"returncode": 0,
"end": 1790060180.4131043,
"benchmark_status": "missing_report",
"error": null
},
{
"name": "tts-cuda-wsl",
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:$PATH timeout 10800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_local_tts.py --model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5 --out ../analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl"
],
"status": "exited",
"start": 1790060180.416104,
"returncode": 0,
"end": 1790060181.8675497,
"benchmark_status": "missing_report",
"error": null
},
{
"name": "tts-cuda-windows",
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_local_tts.py",
"--model",
"C:\\Users\\zhout\\w2\\models\\Qwen3-TTS-0.6B-85e237c",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\tts-cuda-windows"
],
"status": "exited",
"start": 1790060181.870549,
"returncode": 0,
"end": 1790060189.1714816,
"benchmark_status": "missing_report",
"error": null
}
],
"end": 1790060189.1754813
}
@@ -0,0 +1,31 @@
Traceback (most recent call last):
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\benchmarks\edge_harness\profile_local_text.py", line 132, in <module>
from vllm_omni.windows.aio import install_selector_policy
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\__init__.py", line 19, in <module>
from .version import __version__, __version_tuple__ # isort:skip # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\version.py", line 55, in <module>
warn_if_misaligned_vllm_version()
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\version.py", line 30, in warn_if_misaligned_vllm_version
from vllm import __version__ as vllm_version
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\__init__.py", line 14, in <module>
import vllm.env_override # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\env_override.py", line 858, in <module>
_patch_inductor_fallback_allow_list()
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\env_override.py", line 835, in _patch_inductor_fallback_allow_list
from torch._inductor import lowering as _lowering
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_inductor\lowering.py", line 9111, in <module>
import_submodule(kernel)
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_dynamo\utils.py", line 4384, in import_submodule
importlib.import_module(f"{mod.__name__}.{filename[:-3]}")
File "C:\Users\zhout\AppData\Local\Programs\Python\Python312\Lib\importlib\__init__.py", line 90, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_inductor\kernel\mm_grouped.py", line 142, in <module>
source=load_kernel_template("cutedsl_mm_grouped"),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_inductor\utils.py", line 4770, in load_template
return f.read()
^^^^^^^^
UnicodeDecodeError: 'gbk' codec can't decode byte 0x94 in position 618: illegal multibyte sequence
@@ -0,0 +1,20 @@
{
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_local_text.py",
"--model",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Spark-X2.5-4B",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\spark-cuda-windows"
],
"cwd": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge",
"host": "Windows-11-10.0.26200-SP0",
"scope": "Windows RAM includes WSL; GPU counters are whole-device, not model-exclusive",
"sample_interval_s": 1,
"start_unix": 1790060173.6020522,
"status": "exited",
"power_scheme": "\u9422\u57ab\u7c2e\u93c2\u89c4\ufffd\ufffd GUID: 27fa6203-3987-4dcc-918d-748559d549ec (Performance)",
"pid": 63360,
"returncode": 1,
"end_unix": 1790060180.3821137
}
@@ -0,0 +1,5 @@
{"unix": 1790060173.631572, "monotonic": 514905.812, "host_memory": {"total": 67773509632, "available": 24035213312, "percent": 64.5, "used": 43738296320, "free": 24035213312}, "host_cpu_percent": 25.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4046, 24463, 55, 17.09, 1710, 810, 0, P5", "gpu_returncode": 0}
{"unix": 1790060174.6937401, "monotonic": 514906.875, "host_memory": {"total": 67773509632, "available": 24542744576, "percent": 63.8, "used": 43230765056, "free": 24542744576}, "host_cpu_percent": 22.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4046, 24463, 55, 18.20, 1680, 810, 0, P5", "gpu_returncode": 0}
{"unix": 1790060176.0106814, "monotonic": 514908.187, "host_memory": {"total": 67773509632, "available": 25487683584, "percent": 62.4, "used": 42285826048, "free": 25487683584}, "host_cpu_percent": 17.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4046, 24463, 55, 17.79, 1665, 810, 0, P5", "gpu_returncode": 0}
{"unix": 1790060177.4634295, "monotonic": 514909.64, "host_memory": {"total": 67773509632, "available": 25450708992, "percent": 62.4, "used": 42322800640, "free": 25450708992}, "host_cpu_percent": 11.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4046, 24463, 55, 18.16, 1657, 810, 0, P5", "gpu_returncode": 0}
{"unix": 1790060178.9128952, "monotonic": 514911.093, "host_memory": {"total": 67773509632, "available": 25406222336, "percent": 62.5, "used": 42367287296, "free": 25406222336}, "host_cpu_percent": 7.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4046, 24463, 54, 17.26, 1620, 810, 0, P5", "gpu_returncode": 0}
@@ -0,0 +1,31 @@
Traceback (most recent call last):
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\benchmarks\edge_harness\profile_trace_diagnostic.py", line 140, in <module>
from vllm_omni.windows.aio import install_selector_policy
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\__init__.py", line 19, in <module>
from .version import __version__, __version_tuple__ # isort:skip # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\version.py", line 55, in <module>
warn_if_misaligned_vllm_version()
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\version.py", line 30, in warn_if_misaligned_vllm_version
from vllm import __version__ as vllm_version
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\__init__.py", line 14, in <module>
import vllm.env_override # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\env_override.py", line 858, in <module>
_patch_inductor_fallback_allow_list()
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\env_override.py", line 835, in _patch_inductor_fallback_allow_list
from torch._inductor import lowering as _lowering
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_inductor\lowering.py", line 9111, in <module>
import_submodule(kernel)
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_dynamo\utils.py", line 4384, in import_submodule
importlib.import_module(f"{mod.__name__}.{filename[:-3]}")
File "C:\Users\zhout\AppData\Local\Programs\Python\Python312\Lib\importlib\__init__.py", line 90, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_inductor\kernel\mm_grouped.py", line 142, in <module>
source=load_kernel_template("cutedsl_mm_grouped"),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_inductor\utils.py", line 4770, in load_template
return f.read()
^^^^^^^^
UnicodeDecodeError: 'gbk' codec can't decode byte 0x94 in position 618: illegal multibyte sequence
@@ -0,0 +1,22 @@
{
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_trace_diagnostic.py",
"--kind",
"spark",
"--model",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Spark-X2.5-4B",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\spark-cuda-windows-trace"
],
"cwd": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge",
"host": "Windows-11-10.0.26200-SP0",
"scope": "Windows RAM includes WSL; GPU counters are whole-device, not model-exclusive",
"sample_interval_s": 1,
"start_unix": 1790060567.8569674,
"status": "exited",
"power_scheme": "\u9422\u57ab\u7c2e\u93c2\u89c4\ufffd\ufffd GUID: 27fa6203-3987-4dcc-918d-748559d549ec (Performance)",
"pid": 42396,
"returncode": 1,
"end_unix": 1790060579.0231204
}
@@ -0,0 +1,8 @@
{"unix": 1790060567.8859663, "monotonic": 515300.062, "host_memory": {"total": 67773509632, "available": 2813661184, "percent": 95.8, "used": 64959848448, "free": 2813661184}, "host_cpu_percent": 18.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3753, 24463, 53, 17.27, 1702, 810, 0, P5", "gpu_returncode": 0}
{"unix": 1790060568.9383662, "monotonic": 515301.125, "host_memory": {"total": 67773509632, "available": 3221893120, "percent": 95.2, "used": 64551616512, "free": 3221893120}, "host_cpu_percent": 23.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3772, 24463, 53, 12.08, 427, 405, 0, P8", "gpu_returncode": 0}
{"unix": 1790060570.2571478, "monotonic": 515302.437, "host_memory": {"total": 67773509632, "available": 3608010752, "percent": 94.7, "used": 64165498880, "free": 3608010752}, "host_cpu_percent": 21.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3778, 24463, 53, 17.62, 1665, 810, 0, P5", "gpu_returncode": 0}
{"unix": 1790060571.7240214, "monotonic": 515303.906, "host_memory": {"total": 67773509632, "available": 5151072256, "percent": 92.4, "used": 62622437376, "free": 5151072256}, "host_cpu_percent": 24.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3774, 24463, 53, 17.60, 1635, 810, 0, P5", "gpu_returncode": 0}
{"unix": 1790060573.1758518, "monotonic": 515305.359, "host_memory": {"total": 67773509632, "available": 6478401536, "percent": 90.4, "used": 61295108096, "free": 6478401536}, "host_cpu_percent": 22.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3774, 24463, 53, 13.68, 270, 405, 0, P8", "gpu_returncode": 0}
{"unix": 1790060574.638596, "monotonic": 515306.828, "host_memory": {"total": 67773509632, "available": 6952316928, "percent": 89.7, "used": 60821192704, "free": 6952316928}, "host_cpu_percent": 14.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3774, 24463, 53, 11.95, 202, 405, 0, P8", "gpu_returncode": 0}
{"unix": 1790060576.0972688, "monotonic": 515308.281, "host_memory": {"total": 67773509632, "available": 7677448192, "percent": 88.7, "used": 60096061440, "free": 7677448192}, "host_cpu_percent": 17.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3770, 24463, 53, 17.35, 1597, 810, 0, P5", "gpu_returncode": 0}
{"unix": 1790060577.5458121, "monotonic": 515309.734, "host_memory": {"total": 67773509632, "available": 9116598272, "percent": 86.5, "used": 58656911360, "free": 9116598272}, "host_cpu_percent": 15.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3770, 24463, 53, 17.03, 1590, 810, 0, P5", "gpu_returncode": 0}
@@ -0,0 +1,2 @@
bash: -c: line 1: syntax error near unexpected token `('
bash: -c: line 1: `cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/lib/wsl/lib:/mnt/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.4/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/powershell:/mnt/c/Users/zhout/.codex/tmp/arg0/codex-arg07mHRat:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/libheif/libheif/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/jxrlib/jxrlib/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/poppler/Library/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/bin/override:/mnt/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.4/bin/x64:/mnt/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.4/bin:/mnt/c/Windows/system32:/mnt/c/Windows:/mnt/c/Windows/System32/Wbem:/mnt/c/Windows/System32/WindowsPowerShell/v1.0/:/mnt/c/Windows/System32/OpenSSH/:/mnt/c/Program Files (x86)/NVIDIA Corporation/PhysX/Common:/mnt/c/Program Files/NVIDIA Corporation/NVIDIA App/NvDLISR:/mnt/c/Windows/System32/WindowsPowerShell/v1.0:/mnt/c/Program Files/Git/cmd:/mnt/c/Program Files/NVIDIA Corporation/Nsight Compute 2026.3.0/:/mnt/c/Users/zhout/.cargo/bin:/mnt/c/Users/zhout/AppData/Local/Programs/Python/Python312/Scripts/:/mnt/c/Users/zhout/AppData/Local/Programs/Python/Python312/:/mnt/c/Users/zhout/AppData/Local/Programs/Python/Launcher/:/mnt/c/Users/zhout/AppData/Local/Programs/cursor/resources/app/codeBin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/powershell:/mnt/c/Users/zhout/AppData/Local/Microsoft/WindowsApps:/mnt/c/Users/zhout/AppData/Local/Programs/cursor/resources/app/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/bin/fallback:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/node/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/git/cmd:/mnt/c/Users/zhout/AppData/Local/OpenAI/Codex/bin/73fd6465d9c76545:/mnt/c/Users/zhout/AppData/Local/OpenAI/Codex/bin/247581e40ee272fb timeout 10800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_local_text.py --model ../models/Spark-X2.5-4B --out ../analysis/experiments/e2e_profiling_20260922/spark-cuda-wsl'
@@ -0,0 +1,21 @@
{
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:$PATH timeout 10800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_local_text.py --model ../models/Spark-X2.5-4B --out ../analysis/experiments/e2e_profiling_20260922/spark-cuda-wsl"
],
"cwd": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge",
"host": "Windows-11-10.0.26200-SP0",
"scope": "Windows RAM includes WSL; GPU counters are whole-device, not model-exclusive",
"sample_interval_s": 1,
"start_unix": 1790060172.150004,
"status": "exited",
"power_scheme": "\u9422\u57ab\u7c2e\u93c2\u89c4\ufffd\ufffd GUID: 27fa6203-3987-4dcc-918d-748559d549ec (Performance)",
"pid": 64896,
"returncode": 2,
"end_unix": 1790060173.2406642
}
@@ -0,0 +1 @@
{"unix": 1790060172.1820033, "monotonic": 514904.359, "host_memory": {"total": 67773509632, "available": 22391828480, "percent": 67.0, "used": 45381681152, "free": 22391828480}, "host_cpu_percent": 15.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4046, 24463, 55, 14.03, 900, 405, 0, P8", "gpu_returncode": 0}
@@ -0,0 +1,2 @@
bash: -c: line 1: syntax error near unexpected token `('
bash: -c: line 1: `cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/lib/wsl/lib:/mnt/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.4/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/powershell:/mnt/c/Users/zhout/.codex/tmp/arg0/codex-arg07mHRat:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/libheif/libheif/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/jxrlib/jxrlib/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/poppler/Library/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/bin/override:/mnt/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.4/bin/x64:/mnt/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.4/bin:/mnt/c/Windows/system32:/mnt/c/Windows:/mnt/c/Windows/System32/Wbem:/mnt/c/Windows/System32/WindowsPowerShell/v1.0/:/mnt/c/Windows/System32/OpenSSH/:/mnt/c/Program Files (x86)/NVIDIA Corporation/PhysX/Common:/mnt/c/Program Files/NVIDIA Corporation/NVIDIA App/NvDLISR:/mnt/c/Windows/System32/WindowsPowerShell/v1.0:/mnt/c/Program Files/Git/cmd:/mnt/c/Program Files/NVIDIA Corporation/Nsight Compute 2026.3.0/:/mnt/c/Users/zhout/.cargo/bin:/mnt/c/Users/zhout/AppData/Local/Programs/Python/Python312/Scripts/:/mnt/c/Users/zhout/AppData/Local/Programs/Python/Python312/:/mnt/c/Users/zhout/AppData/Local/Programs/Python/Launcher/:/mnt/c/Users/zhout/AppData/Local/Programs/cursor/resources/app/codeBin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/powershell:/mnt/c/Users/zhout/AppData/Local/Microsoft/WindowsApps:/mnt/c/Users/zhout/AppData/Local/Programs/cursor/resources/app/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/bin/fallback:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/node/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/git/cmd:/mnt/c/Users/zhout/AppData/Local/OpenAI/Codex/bin/73fd6465d9c76545:/mnt/c/Users/zhout/AppData/Local/OpenAI/Codex/bin/247581e40ee272fb timeout 1800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_trace_diagnostic.py --kind spark --model ../models/Spark-X2.5-4B --out ../analysis/experiments/e2e_profiling_20260922/spark-cuda-wsl-trace'
@@ -0,0 +1,21 @@
{
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:$PATH timeout 1800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_trace_diagnostic.py --kind spark --model ../models/Spark-X2.5-4B --out ../analysis/experiments/e2e_profiling_20260922/spark-cuda-wsl-trace"
],
"cwd": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge",
"host": "Windows-11-10.0.26200-SP0",
"scope": "Windows RAM includes WSL; GPU counters are whole-device, not model-exclusive",
"sample_interval_s": 1,
"start_unix": 1790060566.342099,
"status": "exited",
"power_scheme": "\u9422\u57ab\u7c2e\u93c2\u89c4\ufffd\ufffd GUID: 27fa6203-3987-4dcc-918d-748559d549ec (Performance)",
"pid": 44684,
"returncode": 2,
"end_unix": 1790060567.440716
}
@@ -0,0 +1 @@
{"unix": 1790060566.3766065, "monotonic": 515298.562, "host_memory": {"total": 67773509632, "available": 1684791296, "percent": 97.5, "used": 66088718336, "free": 1684791296}, "host_cpu_percent": 14.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3763, 24463, 53, 17.71, 1702, 810, 0, P5", "gpu_returncode": 0}
@@ -0,0 +1,31 @@
Traceback (most recent call last):
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\benchmarks\edge_harness\profile_local_tts.py", line 165, in <module>
from vllm_omni.windows.aio import install_selector_policy
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\__init__.py", line 19, in <module>
from .version import __version__, __version_tuple__ # isort:skip # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\version.py", line 55, in <module>
warn_if_misaligned_vllm_version()
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\version.py", line 30, in warn_if_misaligned_vllm_version
from vllm import __version__ as vllm_version
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\__init__.py", line 14, in <module>
import vllm.env_override # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\env_override.py", line 858, in <module>
_patch_inductor_fallback_allow_list()
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\env_override.py", line 835, in _patch_inductor_fallback_allow_list
from torch._inductor import lowering as _lowering
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_inductor\lowering.py", line 9111, in <module>
import_submodule(kernel)
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_dynamo\utils.py", line 4384, in import_submodule
importlib.import_module(f"{mod.__name__}.{filename[:-3]}")
File "C:\Users\zhout\AppData\Local\Programs\Python\Python312\Lib\importlib\__init__.py", line 90, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_inductor\kernel\mm_grouped.py", line 142, in <module>
source=load_kernel_template("cutedsl_mm_grouped"),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_inductor\utils.py", line 4770, in load_template
return f.read()
^^^^^^^^
UnicodeDecodeError: 'gbk' codec can't decode byte 0x94 in position 618: illegal multibyte sequence
@@ -0,0 +1,20 @@
{
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_local_tts.py",
"--model",
"C:\\Users\\zhout\\w2\\models\\Qwen3-TTS-0.6B-85e237c",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\tts-cuda-windows"
],
"cwd": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge",
"host": "Windows-11-10.0.26200-SP0",
"scope": "Windows RAM includes WSL; GPU counters are whole-device, not model-exclusive",
"sample_interval_s": 1,
"start_unix": 1790060182.2059293,
"status": "exited",
"power_scheme": "\u9422\u57ab\u7c2e\u93c2\u89c4\ufffd\ufffd GUID: 27fa6203-3987-4dcc-918d-748559d549ec (Performance)",
"pid": 62484,
"returncode": 1,
"end_unix": 1790060189.144959
}
@@ -0,0 +1,5 @@
{"unix": 1790060182.2339296, "monotonic": 514914.421, "host_memory": {"total": 67773509632, "available": 26110607360, "percent": 61.5, "used": 41662902272, "free": 26110607360}, "host_cpu_percent": 6.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4046, 24463, 54, 18.72, 1590, 810, 0, P5", "gpu_returncode": 0}
{"unix": 1790060183.287921, "monotonic": 514915.468, "host_memory": {"total": 67773509632, "available": 25606938624, "percent": 62.2, "used": 42166571008, "free": 25606938624}, "host_cpu_percent": 9.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4046, 24463, 54, 14.57, 375, 405, 2, P8", "gpu_returncode": 0}
{"unix": 1790060184.7676566, "monotonic": 514916.953, "host_memory": {"total": 67773509632, "available": 25494081536, "percent": 62.4, "used": 42279428096, "free": 25494081536}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4046, 24463, 53, 19.30, 1672, 810, 1, P5", "gpu_returncode": 0}
{"unix": 1790060186.2106762, "monotonic": 514918.39, "host_memory": {"total": 67773509632, "available": 25424269312, "percent": 62.5, "used": 42349240320, "free": 25424269312}, "host_cpu_percent": 9.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4046, 24463, 53, 18.50, 1710, 810, 1, P5", "gpu_returncode": 0}
{"unix": 1790060187.6714928, "monotonic": 514919.859, "host_memory": {"total": 67773509632, "available": 25400971264, "percent": 62.5, "used": 42372538368, "free": 25400971264}, "host_cpu_percent": 8.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4046, 24463, 53, 14.87, 997, 405, 1, P8", "gpu_returncode": 0}
@@ -0,0 +1,31 @@
Traceback (most recent call last):
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\benchmarks\edge_harness\profile_trace_diagnostic.py", line 140, in <module>
from vllm_omni.windows.aio import install_selector_policy
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\__init__.py", line 19, in <module>
from .version import __version__, __version_tuple__ # isort:skip # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\version.py", line 55, in <module>
warn_if_misaligned_vllm_version()
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\version.py", line 30, in warn_if_misaligned_vllm_version
from vllm import __version__ as vllm_version
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\__init__.py", line 14, in <module>
import vllm.env_override # noqa: F401
^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\env_override.py", line 858, in <module>
_patch_inductor_fallback_allow_list()
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\env_override.py", line 835, in _patch_inductor_fallback_allow_list
from torch._inductor import lowering as _lowering
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_inductor\lowering.py", line 9111, in <module>
import_submodule(kernel)
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_dynamo\utils.py", line 4384, in import_submodule
importlib.import_module(f"{mod.__name__}.{filename[:-3]}")
File "C:\Users\zhout\AppData\Local\Programs\Python\Python312\Lib\importlib\__init__.py", line 90, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_inductor\kernel\mm_grouped.py", line 142, in <module>
source=load_kernel_template("cutedsl_mm_grouped"),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\_inductor\utils.py", line 4770, in load_template
return f.read()
^^^^^^^^
UnicodeDecodeError: 'gbk' codec can't decode byte 0x94 in position 618: illegal multibyte sequence
@@ -0,0 +1,22 @@
{
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_trace_diagnostic.py",
"--kind",
"tts",
"--model",
"C:\\Users\\zhout\\w2\\models\\Qwen3-TTS-0.6B-85e237c",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\tts-cuda-windows-trace"
],
"cwd": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge",
"host": "Windows-11-10.0.26200-SP0",
"scope": "Windows RAM includes WSL; GPU counters are whole-device, not model-exclusive",
"sample_interval_s": 1,
"start_unix": 1790060580.8961785,
"status": "exited",
"power_scheme": "\u9422\u57ab\u7c2e\u93c2\u89c4\ufffd\ufffd GUID: 27fa6203-3987-4dcc-918d-748559d549ec (Performance)",
"pid": 13956,
"returncode": 1,
"end_unix": 1790060587.8268032
}
@@ -0,0 +1,5 @@
{"unix": 1790060580.9251828, "monotonic": 515313.109, "host_memory": {"total": 67773509632, "available": 14605930496, "percent": 78.4, "used": 53167579136, "free": 14605930496}, "host_cpu_percent": 13.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3786, 24463, 52, 11.48, 180, 405, 1, P8", "gpu_returncode": 0}
{"unix": 1790060581.9816196, "monotonic": 515314.156, "host_memory": {"total": 67773509632, "available": 14227529728, "percent": 79.0, "used": 53545979904, "free": 14227529728}, "host_cpu_percent": 19.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3782, 24463, 53, 19.22, 1327, 810, 1, P5", "gpu_returncode": 0}
{"unix": 1790060583.4301763, "monotonic": 515315.609, "host_memory": {"total": 67773509632, "available": 14376071168, "percent": 78.8, "used": 53397438464, "free": 14376071168}, "host_cpu_percent": 17.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3782, 24463, 53, 17.97, 1717, 810, 1, P5", "gpu_returncode": 0}
{"unix": 1790060584.9211826, "monotonic": 515317.109, "host_memory": {"total": 67773509632, "available": 15048978432, "percent": 77.8, "used": 52724531200, "free": 15048978432}, "host_cpu_percent": 18.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3782, 24463, 53, 17.60, 1725, 810, 1, P5", "gpu_returncode": 0}
{"unix": 1790060586.369542, "monotonic": 515318.546, "host_memory": {"total": 67773509632, "available": 15909814272, "percent": 76.5, "used": 51863695360, "free": 15909814272}, "host_cpu_percent": 24.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3782, 24463, 52, 13.39, 465, 405, 0, P8", "gpu_returncode": 0}
@@ -0,0 +1,2 @@
bash: -c: line 1: syntax error near unexpected token `('
bash: -c: line 1: `cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/lib/wsl/lib:/mnt/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.4/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/powershell:/mnt/c/Users/zhout/.codex/tmp/arg0/codex-arg07mHRat:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/libheif/libheif/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/jxrlib/jxrlib/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/poppler/Library/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/bin/override:/mnt/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.4/bin/x64:/mnt/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.4/bin:/mnt/c/Windows/system32:/mnt/c/Windows:/mnt/c/Windows/System32/Wbem:/mnt/c/Windows/System32/WindowsPowerShell/v1.0/:/mnt/c/Windows/System32/OpenSSH/:/mnt/c/Program Files (x86)/NVIDIA Corporation/PhysX/Common:/mnt/c/Program Files/NVIDIA Corporation/NVIDIA App/NvDLISR:/mnt/c/Windows/System32/WindowsPowerShell/v1.0:/mnt/c/Program Files/Git/cmd:/mnt/c/Program Files/NVIDIA Corporation/Nsight Compute 2026.3.0/:/mnt/c/Users/zhout/.cargo/bin:/mnt/c/Users/zhout/AppData/Local/Programs/Python/Python312/Scripts/:/mnt/c/Users/zhout/AppData/Local/Programs/Python/Python312/:/mnt/c/Users/zhout/AppData/Local/Programs/Python/Launcher/:/mnt/c/Users/zhout/AppData/Local/Programs/cursor/resources/app/codeBin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/powershell:/mnt/c/Users/zhout/AppData/Local/Microsoft/WindowsApps:/mnt/c/Users/zhout/AppData/Local/Programs/cursor/resources/app/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/bin/fallback:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/node/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/git/cmd:/mnt/c/Users/zhout/AppData/Local/OpenAI/Codex/bin/73fd6465d9c76545:/mnt/c/Users/zhout/AppData/Local/OpenAI/Codex/bin/247581e40ee272fb timeout 10800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_local_tts.py --model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5 --out ../analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl'
@@ -0,0 +1,21 @@
{
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:$PATH timeout 10800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_local_tts.py --model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5 --out ../analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl"
],
"cwd": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge",
"host": "Windows-11-10.0.26200-SP0",
"scope": "Windows RAM includes WSL; GPU counters are whole-device, not model-exclusive",
"sample_interval_s": 1,
"start_unix": 1790060180.7591414,
"status": "exited",
"power_scheme": "\u9422\u57ab\u7c2e\u93c2\u89c4\ufffd\ufffd GUID: 27fa6203-3987-4dcc-918d-748559d549ec (Performance)",
"pid": 57324,
"returncode": 2,
"end_unix": 1790060181.8515525
}
@@ -0,0 +1 @@
{"unix": 1790060180.7881372, "monotonic": 514912.968, "host_memory": {"total": 67773509632, "available": 26121744384, "percent": 61.5, "used": 41651765248, "free": 26121744384}, "host_cpu_percent": 10.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4046, 24463, 54, 18.61, 1605, 810, 0, P5", "gpu_returncode": 0}
@@ -0,0 +1,2 @@
bash: -c: line 1: syntax error near unexpected token `('
bash: -c: line 1: `cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/lib/wsl/lib:/mnt/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.4/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/powershell:/mnt/c/Users/zhout/.codex/tmp/arg0/codex-arg07mHRat:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/libheif/libheif/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/jxrlib/jxrlib/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/poppler/Library/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/bin/override:/mnt/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.4/bin/x64:/mnt/c/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v13.4/bin:/mnt/c/Windows/system32:/mnt/c/Windows:/mnt/c/Windows/System32/Wbem:/mnt/c/Windows/System32/WindowsPowerShell/v1.0/:/mnt/c/Windows/System32/OpenSSH/:/mnt/c/Program Files (x86)/NVIDIA Corporation/PhysX/Common:/mnt/c/Program Files/NVIDIA Corporation/NVIDIA App/NvDLISR:/mnt/c/Windows/System32/WindowsPowerShell/v1.0:/mnt/c/Program Files/Git/cmd:/mnt/c/Program Files/NVIDIA Corporation/Nsight Compute 2026.3.0/:/mnt/c/Users/zhout/.cargo/bin:/mnt/c/Users/zhout/AppData/Local/Programs/Python/Python312/Scripts/:/mnt/c/Users/zhout/AppData/Local/Programs/Python/Python312/:/mnt/c/Users/zhout/AppData/Local/Programs/Python/Launcher/:/mnt/c/Users/zhout/AppData/Local/Programs/cursor/resources/app/codeBin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/powershell:/mnt/c/Users/zhout/AppData/Local/Microsoft/WindowsApps:/mnt/c/Users/zhout/AppData/Local/Programs/cursor/resources/app/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/bin/fallback:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/node/bin:/mnt/c/Users/zhout/.cache/codex-runtimes/codex-primary-runtime/dependencies/native/git/cmd:/mnt/c/Users/zhout/AppData/Local/OpenAI/Codex/bin/73fd6465d9c76545:/mnt/c/Users/zhout/AppData/Local/OpenAI/Codex/bin/247581e40ee272fb timeout 1800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_trace_diagnostic.py --kind tts --model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5 --out ../analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl-trace'
@@ -0,0 +1,21 @@
{
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:$PATH timeout 1800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_trace_diagnostic.py --kind tts --model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5 --out ../analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl-trace"
],
"cwd": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge",
"host": "Windows-11-10.0.26200-SP0",
"scope": "Windows RAM includes WSL; GPU counters are whole-device, not model-exclusive",
"sample_interval_s": 1,
"start_unix": 1790060579.427969,
"status": "exited",
"power_scheme": "\u9422\u57ab\u7c2e\u93c2\u89c4\ufffd\ufffd GUID: 27fa6203-3987-4dcc-918d-748559d549ec (Performance)",
"pid": 24940,
"returncode": 2,
"end_unix": 1790060580.5256815
}
@@ -0,0 +1 @@
{"unix": 1790060579.4559724, "monotonic": 515311.64, "host_memory": {"total": 67773509632, "available": 13956501504, "percent": 79.4, "used": 53817008128, "free": 13956501504}, "host_cpu_percent": 18.0, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3770, 24463, 53, 17.26, 1590, 810, 0, P5", "gpu_returncode": 0}
@@ -0,0 +1,78 @@
{
"status": "exited",
"pid": 52656,
"start": 1790060589.375201,
"jobs": [
{
"name": "spark-cuda-wsl",
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/lib/wsl/lib timeout 10800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_local_text.py --model ../models/Spark-X2.5-4B --out ../analysis/experiments/e2e_profiling_20260922/spark-cuda-wsl"
],
"status": "exited",
"start": 1790060589.378202,
"returncode": 0,
"end": 1790062795.1474967,
"benchmark_status": "completed",
"error": null
},
{
"name": "spark-cuda-windows",
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_local_text.py",
"--model",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Spark-X2.5-4B",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\spark-cuda-windows"
],
"status": "exited",
"start": 1790062795.152503,
"returncode": 1,
"end": 1790062812.6604095,
"benchmark_status": "missing_report",
"error": null
},
{
"name": "tts-cuda-wsl",
"command": [
"wsl",
"-d",
"Ubuntu",
"--",
"bash",
"-lc",
"cd /home/zhout/project/edge_infer/vllm-omni-edge && PYTHONPATH=. HF_HUB_OFFLINE=1 VLLM_USE_FLASHINFER_SAMPLER=0 VLLM_WSL2_ENABLE_PIN_MEMORY=1 CUDA_HOME=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13 PATH=/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/nvidia/cu13/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/lib/wsl/lib timeout 10800 ../.venvs/omni-cuda-029/bin/python benchmarks/edge_harness/profile_local_tts.py --model /home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5 --out ../analysis/experiments/e2e_profiling_20260922/tts-cuda-wsl"
],
"status": "exited",
"start": 1790062812.6633985,
"returncode": 0,
"end": 1790065331.9386182,
"benchmark_status": "completed",
"error": null
},
{
"name": "tts-cuda-windows",
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_local_tts.py",
"--model",
"C:\\Users\\zhout\\w2\\models\\Qwen3-TTS-0.6B-85e237c",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\tts-cuda-windows"
],
"status": "exited",
"start": 1790065331.9426181,
"returncode": 0,
"end": 1790065913.1483374,
"benchmark_status": "failed",
"error": "PermissionError(13, '\u62d2\u7edd\u8bbf\u95ee\u3002')"
}
],
"end": 1790065913.152338
}
@@ -0,0 +1,19 @@
INFO 09-22 15:40:10 [patch.py:259] NVFP4 W4A4 weight_scale NaN-clamp: installed.
INFO 09-22 15:40:10 [patch.py:510] inductor factorable-divisibility patch: installed.
Traceback (most recent call last):
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\benchmarks\edge_harness\profile_local_text.py", line 132, in <module>
from vllm_omni.windows.aio import install_selector_policy
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\__init__.py", line 22, in <module>
from . import patch # noqa: F401
^^^^^^^^^^^^^^^^^^^
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\patch.py", line 588, in <module>
_patch_cumem_free_callback_cuda()
File "\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\vllm-omni-edge\vllm_omni\patch.py", line 548, in _patch_cumem_free_callback_cuda
from vllm.device_allocator.cumem import CuMemAllocator
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\device_allocator\cumem.py", line 40, in <module>
libcudart = CudaRTLibrary()
^^^^^^^^^^^^^^^
File "C:\Users\zhout\w2\omni029venv\Lib\site-packages\vllm\distributed\device_communicators\cuda_wrapper.py", line 113, in __init__
assert so_file is not None, (
^^^^^^^^^^^^^^^^^^^
AssertionError: libcudart is not loaded in the current process, try setting VLLM_CUDART_SO_PATH
@@ -0,0 +1,20 @@
{
"command": [
"C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\benchmarks\\edge_harness\\profile_local_text.py",
"--model",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Spark-X2.5-4B",
"--out",
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\e2e_profiling_20260922\\spark-cuda-windows"
],
"cwd": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge",
"host": "Windows-11-10.0.26200-SP0",
"scope": "Windows RAM includes WSL; GPU counters are whole-device, not model-exclusive",
"sample_interval_s": 1,
"start_unix": 1790062795.5994885,
"status": "exited",
"power_scheme": "\u7535\u6e90\u65b9\u6848 GUID: 27fa6203-3987-4dcc-918d-748559d549ec (Performance)",
"pid": 41696,
"returncode": 1,
"end_unix": 1790062812.6363986
}
@@ -0,0 +1,16 @@
{"unix": 1790062795.6344872, "monotonic": 517527.812, "host_memory": {"total": 67773509632, "available": 16295677952, "percent": 76.0, "used": 51477831680, "free": 16295677952}, "host_cpu_percent": 19.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3748, 24463, 59, 26.99, 690, 405, 16, P8", "gpu_returncode": 0}
{"unix": 1790062796.697404, "monotonic": 517528.875, "host_memory": {"total": 67773509632, "available": 15751299072, "percent": 76.8, "used": 52022210560, "free": 15751299072}, "host_cpu_percent": 24.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4024, 24463, 60, 29.87, 1995, 9001, 10, P4", "gpu_returncode": 0}
{"unix": 1790062797.7641768, "monotonic": 517529.953, "host_memory": {"total": 67773509632, "available": 15692275712, "percent": 76.8, "used": 52081233920, "free": 15692275712}, "host_cpu_percent": 15.9, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 4018, 24463, 59, 25.65, 1852, 9001, 3, P4", "gpu_returncode": 0}
{"unix": 1790062798.8228183, "monotonic": 517531.0, "host_memory": {"total": 67773509632, "available": 15901515776, "percent": 76.5, "used": 51871993856, "free": 15901515776}, "host_cpu_percent": 17.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3944, 24463, 59, 28.04, 1875, 9001, 4, P4", "gpu_returncode": 0}
{"unix": 1790062799.8815286, "monotonic": 517532.062, "host_memory": {"total": 67773509632, "available": 15827492864, "percent": 76.6, "used": 51946016768, "free": 15827492864}, "host_cpu_percent": 9.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3902, 24463, 58, 27.57, 1470, 810, 8, P5", "gpu_returncode": 0}
{"unix": 1790062800.942021, "monotonic": 517533.125, "host_memory": {"total": 67773509632, "available": 15797198848, "percent": 76.7, "used": 51976310784, "free": 15797198848}, "host_cpu_percent": 11.8, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3893, 24463, 58, 28.03, 907, 810, 10, P5", "gpu_returncode": 0}
{"unix": 1790062802.0103402, "monotonic": 517534.187, "host_memory": {"total": 67773509632, "available": 15785836544, "percent": 76.7, "used": 51987673088, "free": 15785836544}, "host_cpu_percent": 11.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3756, 24463, 58, 28.28, 885, 810, 10, P5", "gpu_returncode": 0}
{"unix": 1790062803.0759206, "monotonic": 517535.265, "host_memory": {"total": 67773509632, "available": 15777288192, "percent": 76.7, "used": 51996221440, "free": 15777288192}, "host_cpu_percent": 12.5, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3756, 24463, 58, 26.22, 1117, 405, 21, P8", "gpu_returncode": 0}
{"unix": 1790062804.1309664, "monotonic": 517536.312, "host_memory": {"total": 67773509632, "available": 15529177088, "percent": 77.1, "used": 52244332544, "free": 15529177088}, "host_cpu_percent": 14.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3752, 24463, 58, 21.70, 930, 405, 9, P8", "gpu_returncode": 0}
{"unix": 1790062805.1994843, "monotonic": 517537.375, "host_memory": {"total": 67773509632, "available": 15451832320, "percent": 77.2, "used": 52321677312, "free": 15451832320}, "host_cpu_percent": 14.6, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3760, 24463, 58, 25.38, 997, 405, 13, P8", "gpu_returncode": 0}
{"unix": 1790062806.2630026, "monotonic": 517538.437, "host_memory": {"total": 67773509632, "available": 15632650240, "percent": 76.9, "used": 52140859392, "free": 15632650240}, "host_cpu_percent": 18.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3760, 24463, 58, 30.04, 1035, 405, 28, P8", "gpu_returncode": 0}
{"unix": 1790062807.319172, "monotonic": 517539.5, "host_memory": {"total": 67773509632, "available": 15664582656, "percent": 76.9, "used": 52108926976, "free": 15664582656}, "host_cpu_percent": 14.3, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3760, 24463, 58, 29.79, 1177, 405, 20, P8", "gpu_returncode": 0}
{"unix": 1790062808.3724585, "monotonic": 517540.562, "host_memory": {"total": 67773509632, "available": 15551918080, "percent": 77.1, "used": 52221591552, "free": 15551918080}, "host_cpu_percent": 15.7, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3760, 24463, 57, 24.76, 1012, 405, 14, P8", "gpu_returncode": 0}
{"unix": 1790062809.450934, "monotonic": 517541.64, "host_memory": {"total": 67773509632, "available": 15574700032, "percent": 77.0, "used": 52198809600, "free": 15574700032}, "host_cpu_percent": 16.4, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3760, 24463, 57, 26.30, 1110, 405, 21, P8", "gpu_returncode": 0}
{"unix": 1790062810.525321, "monotonic": 517542.703, "host_memory": {"total": 67773509632, "available": 15510667264, "percent": 77.1, "used": 52262842368, "free": 15510667264}, "host_cpu_percent": 15.1, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3760, 24463, 58, 33.36, 1215, 405, 28, P8", "gpu_returncode": 0}
{"unix": 1790062811.5796947, "monotonic": 517543.765, "host_memory": {"total": 67773509632, "available": 15488258048, "percent": 77.1, "used": 52285251584, "free": 15488258048}, "host_cpu_percent": 17.2, "power": {"ACLineStatus": 1, "BatteryFlag": 1, "BatteryLifePercent": 100, "SystemStatusFlag": 0, "BatteryLifeTime": 4294967295, "BatteryFullLifeTime": 4294967295}, "gpu_csv": "GPU-bf6e910e-657c-15d7-c558-f169df134d8a, NVIDIA GeForce RTX 5090 Laptop GPU, 3768, 24463, 57, 25.00, 810, 9001, 3, P4", "gpu_returncode": 0}
@@ -0,0 +1,194 @@
{
"timestamp": 1790057418.269803,
"python": "C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"platform": "Windows-11-10.0.26200-SP0",
"packages": {
"vllm": "0.29.0+cu134",
"torch": "2.13.0+cu130",
"vllm-omni": "0.29.0",
"transformers": "5.14.1",
"qai-hub": null,
"onnxruntime": null
},
"roots": [
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models",
"exists": true
},
{
"path": "C:\\Users\\zhout\\.cache\\huggingface\\hub",
"exists": true
},
{
"path": "C:\\Users\\zhout\\w2\\models",
"exists": true
}
],
"artifacts": [
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Qwen3.8-27B-FP8",
"model_type": "qwen3_5",
"weight_shards": 66,
"missing_shards": [],
"weight_bytes": 30866866928
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-gptq-g128",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1287662032
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-int4-g32",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1068136688
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Spark-X2.5-1.7B-int8",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1979003288
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-int4-g64-rtn",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 961443656
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Qwen3.8-27B-NVFP4",
"model_type": "qwen3_5",
"weight_shards": 3,
"missing_shards": [],
"weight_bytes": 21921697280
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-int4-g64",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 961443656
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-int4-g32-expanded",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 3415340632
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-int4-g128-nodequant",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-int4-g128-nodequant\\model.safetensors"
],
"weight_bytes": 0
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-int4-g32-rtn",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1068136688
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-int4-g64-fpembed",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1347320208
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-int4-g64-nocustomop",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [
"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-int4-g64-nocustomop\\model.safetensors"
],
"weight_bytes": 0
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-int4-g64-expanded",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 3415340632
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-gptq-asym-g128",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1427131344
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-gptq-asym-g64",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1460472840
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-gptq-g128-head",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1427131536
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\MiniCPM5-2B",
"model_type": "llama",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 5033557096
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-int4-g128",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 908097200
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\spark2_5-gptq-g64",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1460473032
},
{
"path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Spark-X2.5-4B",
"model_type": "spark2_5",
"weight_shards": 5,
"missing_shards": [],
"weight_bytes": 8224192408
},
{
"path": "C:\\Users\\zhout\\w2\\models\\Qwen3-TTS-0.6B-85e237c",
"model_type": "qwen3_tts",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1811626576
}
],
"source_sha256": {
"profile_local_text.py": "33df55fea28437c5cc79e1d3a8017374b3bbbeb91afc1cb572568b1facb62e95",
"profile_local_tts.py": "89b30bb6f7e123383a7e2bec1e423cee67dec00019eeec04479819adc841e70e",
"profile_host_command.py": "6e0636470c29402aaccc9b0600cdbbbf3340ae97b30a0bc2795b89d9ebf602c7",
"profile_cpu_step.py": "818cb9409a0fc308cf5a08b6794da4b1dfee16cb45c48d6b84de5c130a572b59"
},
"git": {
"returncode": 128,
"stdout": "",
"stderr": "fatal: detected dubious ownership in repository at '//wsl.localhost/Ubuntu/home/zhout/project/edge_infer/vllm-omni-edge'\n'//wsl.localhost/Ubuntu/home/zhout/project/edge_infer/vllm-omni-edge/.git' may refer to a non-local directory\nTo add an exception for this directory, call:\n\n\tgit config --global --add safe.directory '%(prefix)///wsl.localhost/Ubuntu/home/zhout/project/edge_infer/vllm-omni-edge'\n"
},
"adb": {
"error": "FileNotFoundError(2, '\u7cfb\u7edf\u627e\u4e0d\u5230\u6307\u5b9a\u7684\u6587\u4ef6\u3002', None, 2, None)"
}
}
@@ -0,0 +1,210 @@
{
"timestamp": 1790057420.958391,
"python": "/home/zhout/project/edge_infer/.venvs/omni-cpu/bin/python",
"platform": "Linux-6.18.33.2-microsoft-standard-WSL2-x86_64-with-glibc2.43",
"packages": {
"vllm": "0.28.0+cpu",
"torch": "2.13.0+cpu",
"vllm-omni": "0.28.1.dev154+g3834de310.d20260914",
"transformers": "5.14.1",
"qai-hub": null,
"onnxruntime": "1.29.0"
},
"roots": [
{
"path": "/home/zhout/project/edge_infer/models",
"exists": true
},
{
"path": "/home/zhout/.cache/huggingface/hub",
"exists": true
},
{
"path": "/mnt/c/Users/zhout/w2/models",
"exists": true
}
],
"artifacts": [
{
"path": "/home/zhout/project/edge_infer/models/Qwen3.8-27B-FP8",
"model_type": "qwen3_5",
"weight_shards": 66,
"missing_shards": [],
"weight_bytes": 30866866928
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-gptq-g128",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1287662032
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-int4-g32",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1068136688
},
{
"path": "/home/zhout/project/edge_infer/models/Spark-X2.5-1.7B-int8",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1979003288
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-int4-g64-rtn",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 961443656
},
{
"path": "/home/zhout/project/edge_infer/models/Qwen3.8-27B-NVFP4",
"model_type": "qwen3_5",
"weight_shards": 3,
"missing_shards": [],
"weight_bytes": 21921697280
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-int4-g64",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 961443656
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-int4-g32-expanded",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 3415340632
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-int4-g128-nodequant",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [
"/home/zhout/project/edge_infer/models/spark2_5-int4-g128-nodequant/model.safetensors"
],
"weight_bytes": 0
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-int4-g32-rtn",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1068136688
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-int4-g64-fpembed",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1347320208
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-int4-g64-nocustomop",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [
"/home/zhout/project/edge_infer/models/spark2_5-int4-g64-nocustomop/model.safetensors"
],
"weight_bytes": 0
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-int4-g64-expanded",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 3415340632
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-gptq-asym-g128",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1427131344
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-gptq-asym-g64",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1460472840
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-gptq-g128-head",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1427131536
},
{
"path": "/home/zhout/project/edge_infer/models/MiniCPM5-2B",
"model_type": "llama",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 5033557096
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-int4-g128",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 908097200
},
{
"path": "/home/zhout/project/edge_infer/models/spark2_5-gptq-g64",
"model_type": "spark2_5",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1460473032
},
{
"path": "/home/zhout/project/edge_infer/models/Spark-X2.5-4B",
"model_type": "spark2_5",
"weight_shards": 5,
"missing_shards": [],
"weight_bytes": 8224192408
},
{
"path": "/home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3.8-27B-FP8/snapshots/017b9c7af6b5689d5dd426a76e0bc077eb5ca20a",
"model_type": "qwen3_5",
"weight_shards": 0,
"missing_shards": [],
"weight_bytes": 0
},
{
"path": "/home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5",
"model_type": "qwen3_tts",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1811626576
},
{
"path": "/mnt/c/Users/zhout/w2/models/Qwen3-TTS-0.6B-85e237c",
"model_type": "qwen3_tts",
"weight_shards": 1,
"missing_shards": [],
"weight_bytes": 1811626576
}
],
"source_sha256": {
"profile_local_text.py": "33df55fea28437c5cc79e1d3a8017374b3bbbeb91afc1cb572568b1facb62e95",
"profile_local_tts.py": "89b30bb6f7e123383a7e2bec1e423cee67dec00019eeec04479819adc841e70e",
"profile_host_command.py": "6e0636470c29402aaccc9b0600cdbbbf3340ae97b30a0bc2795b89d9ebf602c7",
"profile_cpu_step.py": "818cb9409a0fc308cf5a08b6794da4b1dfee16cb45c48d6b84de5c130a572b59"
},
"git": {
"returncode": 0,
"stdout": "ab2f2a3d658db5be5ec96a950da55cb74b48e7aa\n",
"stderr": ""
},
"adb": {
"returncode": 0,
"stdout": "List of devices attached\n\n",
"stderr": ""
}
}
@@ -0,0 +1,48 @@
"""Read-only current inventory without loading model runtimes during a benchmark."""
import argparse
import hashlib
import importlib.metadata
import json
import platform
import subprocess
import sys
import time
from pathlib import Path
p = argparse.ArgumentParser()
p.add_argument('--root', required=True, type=Path)
p.add_argument('--out', required=True, type=Path)
a = p.parse_args()
r = {'timestamp': time.time(), 'python': sys.executable, 'platform': platform.platform(),
'packages': {}, 'roots': [], 'artifacts': [], 'source_sha256': {}}
for name in ('vllm', 'torch', 'vllm-omni', 'transformers', 'qai-hub', 'onnxruntime'):
try:
r['packages'][name] = importlib.metadata.version(name)
except importlib.metadata.PackageNotFoundError:
r['packages'][name] = None
roots = [a.root/'models', Path.home()/'.cache/huggingface/hub',
Path('C:/Users/zhout/w2/models') if sys.platform == 'win32' else Path('/mnt/c/Users/zhout/w2/models')]
for root in roots:
r['roots'].append({'path': str(root), 'exists': root.is_dir()})
if not root.is_dir():
continue
for item in root.iterdir():
if not any(s in item.name.lower() for s in ('spark', 'qwen3', 'minicpm', 'internvla')):
continue
for cfg in list(item.glob('config.json')) + list(item.glob('snapshots/*/config.json')):
data = json.loads(cfg.read_text(encoding='utf-8'))
weights = list(cfg.parent.glob('*.safetensors'))
r['artifacts'].append({'path': str(cfg.parent), 'model_type': data.get('model_type'),
'weight_shards': len(weights),
'missing_shards': [str(w) for w in weights if not w.is_file()],
'weight_bytes': sum(w.stat().st_size for w in weights if w.is_file())})
for path in (a.root/'vllm-omni-edge/benchmarks/edge_harness').glob('profile_*.py'):
r['source_sha256'][path.name] = hashlib.sha256(path.read_bytes()).hexdigest()
for cmd in (['git', '-C', str(a.root/'vllm-omni-edge'), 'rev-parse', 'HEAD'], ['adb', 'devices', '-l']):
try:
result = subprocess.run(cmd, capture_output=True, text=True, errors='replace', timeout=10)
r[cmd[0]] = {'returncode': result.returncode, 'stdout': result.stdout, 'stderr': result.stderr}
except Exception as error:
r[cmd[0]] = {'error': repr(error)}
a.out.write_text(json.dumps(r, indent=2))
print(f'{len(r["artifacts"])} artifact configurations inventoried: {a.out}')
@@ -0,0 +1,241 @@
# Omni abstraction implementation and qualification — 2026-09-22
Implementation: `vllm-omni-edge`, branch `codex/omni-edge-abstraction`, based on
`00510ce38bbb96ef2e4ce462618d06ab142fae7c`. Implementation committed as
`723c5502` and pushed to the user's
[vLLM-Omni fork branch](https://github.com/tzhouam/vllm-omni/tree/codex/omni-edge-abstraction).
The working tree is clean. The pre-commit wheel/source identities below remain
the original validation snapshot; the committed runtime matches it, with the
hardware-support and validation table added to the guide before publication.
The original dirty `vllm-omni` and clean `vllm-omni-029` trees were preserved.
See the [backend guide](../../../vllm-omni-edge/docs/design/omni_edge_backends.md)
and [completion plan](../../plan_omni_edge_completion_20260922.md).
## Implemented boundary
- Standalone `omni_stage_contracts`: version/features, tensors, requests/events,
opaque state, physical topology and hashed artifacts; compatible legacy imports.
- Explicit host routes, worker bootstrap, Windows process identity and verified
cross-domain retirement. Host-local initialization locks work from UNC checkouts.
- `external.graph.v1` driven by real `PipelineConfig`, `StageRuntime`, `StagePool`,
orchestrator and public `Omni`/`AsyncOmni`; native execution/KV/batching stay vLLM.
- Graph-containing plans reserve all declared memory pools before loading.
CPU/iGPU/NPU shared RAM, discrete VRAM and WSL quota are separate constraints.
Unverified release is quarantined.
- One admitted graph request, bounded copied tensors, consumer ACK,
epoch/generation fencing and worker retirement for non-preemptible cancellation.
- Native Windows SHM uses host-local locks, exact payload framing and retained
producer handles until a generation-specific consumer ACK. Retention is capped
at 64 MiB / 256 buffers; cancellation/close releases unconsumed mappings.
This implements stateless, fixed-bucket graphs. Full native admission migration,
stateful mobile generation, general fan-out and all model/device qualification
are unfinished. G1/G2/G3 remain open at their full accepted scope.
## Evidence matrix
D = detection, B = backend execution, C = model component, P = complete specified
pipeline, E = estimate. Synthetic topology and test doubles are contract tests.
| Route | Raw record | Proven scope |
|---|---|---|
| WSL Spark 4B BF16 CUDA | [wsl-m0-cuda-1.log](wsl-m0-cuda-1.log), 11 passed | P for the M0 test workload: 12 prompts × 128 tokens, context/state/cancel and memory checks. Not a new reference-token parity benchmark. |
| Native Windows Spark 4B BF16 CUDA | [windows-m0-cuda-6.log](windows-m0-cuda-6.log), 11 passed | P for the same M0 acceptance workload on this native Windows environment; includes UNC checkpoint/worktree paths. |
| WSL Qwen3-TTS 0.6B, real weights | [wsl-tts-6-real.log](wsl-tts-6-real.log), 1 passed | Two-stage edge-profile smoke test only; helper caps generation at two codec frames, so this does not close streaming/M2. |
| Native Windows Qwen3-TTS 0.6B | [tts-stream-windows-5.log](tts-stream-windows-5.log) | Public AsyncOmni two-stage real-weight streaming completes with audio and clean shutdown. Playback stalls remain; not full M2 acceptance. |
| WSL ORT CPU Add | [graph-cpu-wsl-2.json](graph-cpu-wsl-2.json) | B, public Omni, 20 requests, zero retained reservation after shutdown. |
| Native Windows ORT CPU Add | [graph-cpu-windows-2.json](graph-cpu-windows-2.json) | B, native controller/worker, 20 requests. Not CPU text support. |
| WSL → Windows DirectML Add | [graph-dml-crossdomain.json](graph-dml-crossdomain.json) | B, actual DML nodes, 20 requests. Not the historical 890M vision component. |
| WSL → Windows AMD NPU A16W8 | [graph-npu-crossdomain-2.json](graph-npu-crossdomain-2.json) | B, VitisAI=1 / CPU=2 nodes explicitly allowed; verified retirement. |
| Same A16W8 artifact on CPU | [graph-npu-cpu-reference.json](graph-npu-cpu-reference.json) | Backend reference, not original FP checkpoint quality. |
| Installed Omni wheel outside checkout | [installed-wheel-graph.json](installed-wheel-graph.json) | Public API + real ORT CPU, 20 requests. |
| Rebuilt Omni wheel after transport fixes | [installed-wheel-bounded.json](installed-wheel-bounded.json) | Same public API test from `/tmp`, actual worker under `/tmp/omni-platform-bounded-check`, exact outputs and zero retained reservation. Earlier builds remain separately recorded. |
| Qualcomm S25 component | [inference](aihub-s25-infer.json), [profile](aihub-s25-profile.json) | C, existing Spark attention component; not full Spark or an Android Omni controller. |
[Numerical checks](numerical-checks.json): CPU/Windows/DML Add outputs are exact.
NPU versus the same quantized CPU graph: maximum absolute error
`4.458427429199219e-05`, normalized maximum `3.111236521857185e-05`, below the
preselected `0.002` bound. These probes do not validate model quality.
Raw timings are functional-check samples, not controlled performance comparisons.
Some initialization overlapped independent CPU checks. Power policy and thermal
equilibrium were not controlled. No speedup or sustained power claim is made.
## Desktop TTS streaming acceptance remains open
The real-weight edge-profile smoke test passes, and a longer Chinese utterance
runs through `AsyncOmni` with the existing 2→4→8→16→25-frame ramp and 72-frame
left context. [Raw streaming record](tts-stream/Qwen3-TTS-12Hz-0.6B-CustomVoice/profile_edge/20260922-120641_abstraction.json)
and [log](tts-stream.log) preserve one warmup and **one measured request**, concurrency
one, same pinned checkpoint, BF16, RTX 5090 Laptop, native vLLM sampler.
The measured request emitted six nonterminal chunks (6.4 seconds of audio), then
a terminal tail. First audio was about 411 ms, but playback starting then would
stall about 4.42 seconds in total. Thus functional streaming works while the
continuous-playback acceptance criterion is **not met**. This is a diagnostic
single-request result, not a qualified latency percentile or performance claim.
Saved WAVs contain the streamed prefix only; the existing benchmark does not
append the terminal tail. No listening/ASR quality or interruption/recovery gate
has been passed. Peak GPU usage in this tool is explicitly whole-GPU, not exclusive
model attribution; power/thermal conditions were not fixed.
Native Windows now also completes the same two-stage stream after the SHM fixes.
[Raw Windows record](tts-stream-windows/Qwen3-TTS-0.6B-85e237c/profile_edge/20260922-123626_abstraction.json)
has one warmup and one measured request using the byte-identical native checkpoint
bundle. The measured request produced six nonterminal chunks / 6.4 seconds of
audio, first audio about 387 ms, and about 4.08 seconds of playback stall when
starting at first audio. Wall time was 11.51 seconds. These are diagnostic samples,
not a Windows-versus-WSL performance comparison. Both worker processes retired
normally. [Audio checks](tts-audio-checks.json) verify finite, nonzero 24 kHz saved
prefixes; they do not establish listening quality or terminal-tail correctness.
Reproduce from the worktree, using the CUDA_HOME/PATH of the inventoried venv:
```bash
VLLM_USE_FLASHINFER_SAMPLER=0 HF_HUB_OFFLINE=1 PYTHONPATH=. \
../.venvs/omni-cuda-029/bin/python benchmarks/tts/stream_latency_bench.py \
--model Qwen/Qwen3-TTS-12Hz-0.6B-CustomVoice --query-type CustomVoice \
--txt-prompts ../analysis/experiments/omni_abstraction_20260922/tts-prompts.txt \
--deploy-profile edge --warmup 1 --repeat 1 --save-wav \
--output-dir ../analysis/experiments/omni_abstraction_20260922/tts-stream
```
Next desktop experiment: attribute the native-sampler/per-frame synchronization
and transport cost under the same input before changing stage placement. Do not
split onto another accelerator just because it is available.
## Qualcomm AI Hub Workbench
The user authorized this test facility. The supplied token was passed to the SDK
in memory via stdin and is not stored in the repository or runtime configuration.
AI Hub remains outside the local deployment path.
- [Inventory](aihub-inventory.json): SDK 0.55.0, 78 device/OS entries, including
S25 Android 15, Snapdragon X Elite/X2 Elite Windows 11, SA8775P and RB3. Listing
is D, not qualification of every listed device.
- Existing compile [jgdd1ljrg](https://workbench.aihub.qualcomm.com/jobs/jgdd1ljrg/),
target `mnowl6xpq`. The historical label `full1024` means **one full-attention
component with a 1024 cache bucket**, not the complete model.
- Fresh inference [jp0mvkj6g](https://workbench.aihub.qualcomm.com/jobs/jp0mvkj6g/)
and NPU profile [jpyo7nx75](https://workbench.aihub.qualcomm.com/jobs/jpyo7nx75/)
succeeded on Samsung Galaxy S25, Android 15, Snapdragon 8 Elite for Galaxy.
- Inference reused dataset `d7m83gjy2` from `j57er3q9p`, with the same compiled
W8A16 artifact. [Repeatability](aihub-repeatability.json): all three outputs
finite and exactly equal. This does not establish original-checkpoint quality.
- The profile preserves raw `all_inference_times`, load/memory fields, input
shapes/types, options, graph detail and Hub version. `estimated_inference_time`
is not relabeled a median or full-model latency.
`qualcomm_workbench.py` inventories, submits jobs for explicit existing model IDs,
and collects results. It uses a configured SDK profile or `--token-stdin`.
Example with an already configured profile, from the workspace root:
```bash
.venvs/aihub/bin/python analysis/experiments/omni_abstraction_20260922/qualcomm_workbench.py \
collect --job jpyo7nx75 --out /tmp/s25-profile.json
```
No ADB device was connected. M1 still requires local prefill, 128-token generation,
KV/ring/sampling, 512/1024 transitions, cancel/reset and full resident memory.
M2 still requires local NPU/GPU co-residency, streaming recovery and 30-minute
thermal behavior. Separate Hub jobs do not establish these properties.
## Reproduction and environment
Final focused regression: [WSL](wsl-regression-shm.log) **415 passed, 1 skipped, 20
deselected**; [native Windows](windows-regression-shm.log) **78 passed, 2
skipped** (the controller lacks ONNX for two tests; actual ORT runs use separate
worker environments). The final Windows buffer/cancellation/retained-key follow-up
also passes [three tests](windows-shm-bounded.log). Ruff and diff whitespace checks pass. Earlier snapshots
and failed test-fixture setup attempts remain alongside the final logs.
[WSL inventory](wsl-inventory.json), [Windows inventory](windows-inventory.json),
[CPU](windows-cpu.json), [display](windows-display.json) and
[source baseline](source-baseline.txt) record actual imports/packages and hardware.
GPU: RTX 5090 **Laptop**, 24463 MiB, Windows driver 610.71. Desktop/server numbers
are not interchangeable. Commands below run from `vllm-omni-edge`:
```bash
../.venvs/omni-cuda-029/bin/python -m pytest -q -m 'not omni and not local_model' \
tests/engine/test_graph_backend.py tests/edge/local \
tests/config/test_vllm_native_pipelines.py tests/engine/test_async_omni_engine_stage_init.py \
tests/engine/test_parallel_stage_init.py tests/engine/test_stage_runtime_launch_concurrency.py \
tests/engine/test_stage_pool_collective_rpc.py tests/engine/test_stage_metadata.py \
tests/entrypoints/test_omni_entrypoints.py tests/entrypoints/test_async_omni.py \
tests/worker/test_forward_kwargs_filtering.py
../.venvs/omni-cuda-029/bin/python -m pytest -q tests/edge/local/test_e2e_local_text.py
```
Generate hashed probe bundles using `prepare_probes.py` from the workspace root.
Use the [public graph runner](../../../vllm-omni-edge/examples/edge/run_graph_stage.py)
and [route examples](../../../vllm-omni-edge/examples/edge/README.md). Reports retain
route, artifact identity, placement and reservation. Workers:
`.venvs/omni-cuda-029/bin/python` (WSL),
`C:\Users\zhout\npu-ep\Scripts\python.exe` (Windows CPU/VitisAI), and
`C:\Users\zhout\dml-ep\Scripts\python.exe` (DirectML).
Windows controller: `C:\Users\zhout\w2\omni029venv\Scripts\python.exe`;
`PYTHONPATH` is the ordinary UNC worktree path, `PYTHONUTF8=1`, and
`VLLM_CUDART_SO_PATH` points to that environment's `torch\lib\cudart64_13.dll`.
Usage statistics were disabled. No vendor wheel was modified here.
Package source/wheel identities are in [release-identities.json](release-identities.json).
The tested main wheel and standalone contracts wheel/sdist are preserved in
[`packages/`](packages/) in this evidence directory.
Build commands: `uv build --wheel --out-dir /tmp/omni-platform-shm-wheels` and
`uv build packages/omni-stage-contracts --out-dir /tmp/omni-contracts-final-wheels`.
The contracts sdist also installs in a fresh, dependency-free environment and
imports under `python -I` without NumPy, torch, vLLM or Omni. For the final main
wheel, install with `uv pip install --no-deps --target /tmp/omni-platform-bounded-check
/tmp/omni-platform-shm-wheels/*.whl`, then run the graph example from `/tmp`
with `PYTHONPATH=/tmp/omni-platform-bounded-check` using the existing vLLM environment.
## Retained failures
- Initial NPU execution passed but shutdown quarantined memory: socket closure
preceded native identity verification. `graph-npu-crossdomain.json` retains it;
the corrected `-2` run verifies release.
- Windows M0 `-2` failed in default worker-path discovery; planning passes after
the fix. `-3`/`-4` were stopped while stalled. `-5` traced a blocking `/tmp`
open through UNC, then exited with native access violation. The host-local
path/creation fix is covered by lock and model reruns.
- TTS `-1` lacked complete artifacts. Pinned CustomVoice 0.6B revision
`85e237c12c027371202489a0ec509ded67b5e4b5` was then downloaded. `-2`/`-3` lacked
CUDA compiler/ninja paths; `-4` lacked the C++ frontend needed by FlashInfer
sampling; `-5` exposed CUDA wrapper introspection. These tests defaulted to
**dummy weights** and are not model-quality evidence. The introspection fix
is tested with the actual vLLM wrapper. Real-weight tests require
`--run-level advanced_model`; this environment explicitly selects the native
vLLM sampler with `VLLM_USE_FLASHINFER_SAMPLER=0`.
- Native Windows `windows-tts-real-1.log` stopped in test-fixture setup because
an unrelated diffusion test helper imports missing `diffusers`. Direct public
benchmark `tts-stream-windows-1.log` then reported an incomplete snapshot:
Windows could not follow the Linux cache symlinks. A native copy of the same
pinned checkpoint was made without overwriting an existing bundle; all 13 files
were SHA256-compared with the source. [Bundle provenance](tts-native-bundle.json).
- `tts-stream-windows-2.log` loaded the real talker weights, then failed publishing
the compiler cache at a 261-character Windows path (`WinError 3`). A separate
rerun explicitly sets `VLLM_CACHE_ROOT=C:\Users\zhout\c29`, shortening that
target to 253 characters. This uses the runtime's cache setting, with no global
Windows policy change and no precision/model substitution.
- `tts-stream-windows-3.log` passed stage compilation and initialized both
stages with the short cache path, then stalled on the first request. The
benchmark created `asyncio.run` before importing Omni and installing Windows
selector policy. Its entry point now explicitly installs the existing policy
before creating the loop, as the local-text CLI already does. The original
attempt was retired with its two worker processes before retrying.
- `tts-stream-windows-4.log` still stalled with a verified selector loop.
[Talker stack](windows-tts-talker-stack.txt) located the blocked file lock:
`/dev/shm` resolved through the UNC checkout. Paths now select the actual host
directory. Windows named mappings also needed retained producer handles and
payload-length framing; closing the only handle immediately can destroy them.
The bounded generation/ACK implementation and permanent-lock-error handling
pass native cross-process and cancellation tests. The `-5` stream then completed.
- `forward-regression.log` used a nonexistent path; `-2` passed. Metadata fixture
setup failures are retained; the corrected metadata/lock suite passed 95 tests
in `metadata-lock-regression.log`.
Three early graph reports have ephemeral localhost handshake tokens redacted;
measurements remain unchanged. Historical vision/CPU/mobile/VLA results are not
promoted to proof of this implementation. Remaining required rows stay open.
@@ -0,0 +1,34 @@
{
"timestamp_utc": "2026-09-22T03:52:48.169689+00:00",
"qai_hub_version": "0.55.0",
"facility": "Qualcomm AI Hub Workbench",
"command": "collect",
"job_id": "jp0mvkj6g",
"url": "https://workbench.aihub.qualcomm.com/jobs/jp0mvkj6g/",
"status": "SUCCESS",
"status_message": "",
"options": "--compute_unit npu",
"hub_version": "aihub-2026.09.11.0",
"device": {
"name": "Samsung Galaxy S25",
"os": "15",
"attributes": [
"os:android",
"framework:tflite",
"framework:onnx",
"abi:aarch64-android",
"vendor:samsung",
"format:phone",
"chipset:qualcomm-snapdragon-8-elite-for-galaxy",
"chipset:sm8750-ac",
"hexagon:v79",
"soc-model:69",
"htp-supports-fp16:true",
"htp-supports-weight-sharing:true",
"framework:qnn"
]
},
"model_id": "mnowl6xpq",
"input_dataset_id": "d7m83gjy2",
"outputs": "aihub-s25-infer.npz"
}
@@ -0,0 +1,2 @@
# Preserve raw experiment bytes for SHA256 verification, including original whitespace.
evidence/** -text -whitespace
@@ -0,0 +1,572 @@
# Mobile / PC × model qualification audit
2026-09-22: **60 named pairings checked**, not 60 successful executions.
PASS = specified full workload passed; PARTIAL = functional output with acceptance gaps; COMPONENT = one model component only; PROFILE_ONLY = component timing without quality; FAILED = attempted execution/startup failed; REJECTED = specific artifact refused; BLOCKED = a named prerequisite is missing. Historical evidence is marked in each finding.
| Device / execution configuration | Spark-X2.5 | Qwen3-TTS 0.6B CustomVoice | Qwen3.8-27B | MiniCPM-o 4.5 | InternVLA-A1 |
|---|---|---|---|---|---|
| PC HX370: CPU / WSL | [PASS](#pc_cpu_wsl-spark) | [FAILED](#pc_cpu_wsl-tts) | [BLOCKED](#pc_cpu_wsl-qwen27) | [BLOCKED](#pc_cpu_wsl-minicpm) | [BLOCKED](#pc_cpu_wsl-vla) |
| PC HX370: CPU / native Windows | [BLOCKED](#pc_cpu_windows-spark) | [BLOCKED](#pc_cpu_windows-tts) | [BLOCKED](#pc_cpu_windows-qwen27) | [BLOCKED](#pc_cpu_windows-minicpm) | [BLOCKED](#pc_cpu_windows-vla) |
| PC HX370 + RTX 5090 Laptop / WSL | [PASS](#pc_cuda_wsl-spark) | [PARTIAL](#pc_cuda_wsl-tts) | [FAILED](#pc_cuda_wsl-qwen27) | [BLOCKED](#pc_cuda_wsl-minicpm) | [BLOCKED](#pc_cuda_wsl-vla) |
| PC HX370 + RTX 5090 Laptop / Windows | [PASS](#pc_cuda_windows-spark) | [PARTIAL](#pc_cuda_windows-tts) | [FAILED](#pc_cuda_windows-qwen27) | [BLOCKED](#pc_cuda_windows-minicpm) | [BLOCKED](#pc_cuda_windows-vla) |
| PC HX370 + Radeon 890M / Windows worker | [BLOCKED](#pc_igpu-spark) | [BLOCKED](#pc_igpu-tts) | [COMPONENT](#pc_igpu-qwen27) | [BLOCKED](#pc_igpu-minicpm) | [BLOCKED](#pc_igpu-vla) |
| PC HX370 + AMD NPU / Windows worker | [BLOCKED](#pc_npu-spark) | [BLOCKED](#pc_npu-tts) | [REJECTED](#pc_npu-qwen27) | [BLOCKED](#pc_npu-minicpm) | [BLOCKED](#pc_npu-vla) |
| PC CPU+iGPU+NPU +/- discrete GPU, joint model execution | [BLOCKED](#pc_joint-spark) | [BLOCKED](#pc_joint-tts) | [BLOCKED](#pc_joint-qwen27) | [BLOCKED](#pc_joint-minicpm) | [BLOCKED](#pc_joint-vla) |
| PC Snapdragon X Elite CRD / AI Hub | [BLOCKED](#pc_xelite-spark) | [PROFILE_ONLY](#pc_xelite-tts) | [BLOCKED](#pc_xelite-qwen27) | [BLOCKED](#pc_xelite-minicpm) | [BLOCKED](#pc_xelite-vla) |
| Mobile Galaxy S25 / Snapdragon 8 Elite for Galaxy | [COMPONENT](#mobile_s25-spark) | [COMPONENT](#mobile_s25-tts) | [BLOCKED](#mobile_s25-qwen27) | [COMPONENT](#mobile_s25-minicpm) | [BLOCKED](#mobile_s25-vla) |
| Mobile Galaxy S24 / Snapdragon 8 Gen 3 | [BLOCKED](#mobile_s24-spark) | [COMPONENT](#mobile_s24-tts) | [BLOCKED](#mobile_s24-qwen27) | [COMPONENT](#mobile_s24-minicpm) | [BLOCKED](#mobile_s24-vla) |
| Embedded SA8775P ADP / AI Hub | [BLOCKED](#embedded_sa8775p-spark) | [PROFILE_ONLY](#embedded_sa8775p-tts) | [BLOCKED](#embedded_sa8775p-qwen27) | [BLOCKED](#embedded_sa8775p-minicpm) | [BLOCKED](#embedded_sa8775p-vla) |
| Embedded RB3 Gen 2 / QCS6490 / AI Hub | [BLOCKED](#embedded_rb3-spark) | [PROFILE_ONLY](#embedded_rb3-tts) | [BLOCKED](#embedded_rb3-qwen27) | [BLOCKED](#embedded_rb3-minicpm) | [BLOCKED](#embedded_rb3-vla) |
## Scope and reproduction
PC rows are execution configurations on the HX370/890M/AMD NPU/RTX 5090 Laptop machine. X Elite is a separate Windows ARM device accessed through AI Hub. The two embedded kits are not phones. Other SKUs are outside this finite audit, not implied supported.
The checked roots contain MiniCPM5-2B, which must not substitute for MiniCPM-o 4.5. Missing complete MiniCPM-o and InternVLA artifacts block those local runs. ADB reports no attached phone; Hub component jobs cannot prove a device-local controller or sustained co-residency.
The CPU venv is vLLM 0.28; the CUDA/native-Windows venvs are 0.29. The CPU TTS tuple failure is specific to the mixed-version environment. Preserve failures instead of describing these as universal model limitations.
Raw selected reports are in `evidence/`. `matrix.json` retains every source path/hash, cell finding and next step. Fresh probe scripts are in `repro/`; see their `--help` and the workspace experiment README for exact environments. No model weights or API credentials are included.
## Per-pair results
<a id="pc_cpu_wsl-spark"></a>
### PC HX370: CPU / WSL × Spark-X2.5
**PASS — P**. Fresh Spark 1.7B INT8 acceptance: 12 prompts x 128 tokens; clean cancellation. Current Omni branch with the existing vLLM 0.28 CPU wheel; version mismatch warning retained, not a claim about a 0.29 CPU wheel.
Evidence: [spark-cpu](evidence/spark-cpu.json), [spark-cpu-log](evidence/spark-cpu-log.log).
Next: Qualify a matching vLLM 0.29 CPU build and token parity separately.
<a id="pc_cpu_wsl-tts"></a>
### PC HX370: CPU / WSL × Qwen3-TTS 0.6B CustomVoice
**FAILED — execution**. Fresh real-weight two-frame probe loaded both stages but generation failed in sanitize_min_tokens_stop_ids: expected four tuple fields, got three. Existing CPU wheel is vLLM 0.28 versus Omni 0.29. No audio pass.
Evidence: [tts-cpu](evidence/tts-cpu.json), [tts-cpu-log](evidence/tts-cpu-log.log).
Next: Use a matching CPU runtime or explicitly validated compatibility fix; repeat real audio, then full streaming gates.
<a id="pc_cpu_wsl-qwen27"></a>
### PC HX370: CPU / WSL × Qwen3.8-27B
**BLOCKED — none**. No compatible CPU artifact/deployment for this model was found in the checked model roots. Available Qwen 27B FP8/NVFP4 CUDA artifacts do not establish a CPU route.
Evidence: [host-wsl](evidence/host-wsl.json).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_cpu_wsl-minicpm"></a>
### PC HX370: CPU / WSL × MiniCPM-o 4.5
**BLOCKED — none**. No complete matching checkpoint found in the inventoried workspace, HF cache and native model roots. MiniCPM5-2B is not MiniCPM-o 4.5. Runtime registration alone is not a model run.
Evidence: [host-wsl](evidence/host-wsl.json), [host-windows](evidence/host-windows.json).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_cpu_wsl-vla"></a>
### PC HX370: CPU / WSL × InternVLA-A1
**BLOCKED — none**. No complete matching checkpoint found in the inventoried workspace, HF cache and native model roots. MiniCPM5-2B is not MiniCPM-o 4.5. Runtime registration alone is not a model run.
Evidence: [host-wsl](evidence/host-wsl.json), [host-windows](evidence/host-windows.json).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_cpu_windows-spark"></a>
### PC HX370: CPU / native Windows × Spark-X2.5
**BLOCKED — none**. The installed native Windows vLLM extension lacks cpu_attn_reshape_and_cache and cpu_attn_get_scheduler_metadata. The separate ORT CPU graph worker is not a whole-model text/TTS adapter; a qualified CPU build/binding is missing.
Evidence: [host-windows](evidence/host-windows.json), [windows-cpu-kernels](evidence/windows-cpu-kernels.json), [backend-factory](evidence/backend-factory.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_cpu_windows-tts"></a>
### PC HX370: CPU / native Windows × Qwen3-TTS 0.6B CustomVoice
**BLOCKED — none**. The installed native Windows vLLM extension lacks cpu_attn_reshape_and_cache and cpu_attn_get_scheduler_metadata. The separate ORT CPU graph worker is not a whole-model text/TTS adapter; a qualified CPU build/binding is missing.
Evidence: [host-windows](evidence/host-windows.json), [windows-cpu-kernels](evidence/windows-cpu-kernels.json), [backend-factory](evidence/backend-factory.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_cpu_windows-qwen27"></a>
### PC HX370: CPU / native Windows × Qwen3.8-27B
**BLOCKED — none**. The installed native Windows vLLM extension lacks cpu_attn_reshape_and_cache and cpu_attn_get_scheduler_metadata. The separate ORT CPU graph worker is not a whole-model text/TTS adapter; a qualified CPU build/binding is missing.
Evidence: [host-windows](evidence/host-windows.json), [windows-cpu-kernels](evidence/windows-cpu-kernels.json), [backend-factory](evidence/backend-factory.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_cpu_windows-minicpm"></a>
### PC HX370: CPU / native Windows × MiniCPM-o 4.5
**BLOCKED — none**. No complete matching checkpoint found in the inventoried workspace, HF cache and native model roots. MiniCPM5-2B is not MiniCPM-o 4.5. Runtime registration alone is not a model run.
Evidence: [host-wsl](evidence/host-wsl.json), [host-windows](evidence/host-windows.json).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_cpu_windows-vla"></a>
### PC HX370: CPU / native Windows × InternVLA-A1
**BLOCKED — none**. No complete matching checkpoint found in the inventoried workspace, HF cache and native model roots. MiniCPM5-2B is not MiniCPM-o 4.5. Runtime registration alone is not a model run.
Evidence: [host-wsl](evidence/host-wsl.json), [host-windows](evidence/host-windows.json).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_cuda_wsl-spark"></a>
### PC HX370 + RTX 5090 Laptop / WSL × Spark-X2.5
**PASS — P**. Spark 4B BF16: 11 M0 tests passed on this branch for text, state, cancellation and memory; scoped to the recorded workload.
Evidence: [spark-cuda-wsl](evidence/spark-cuda-wsl.log).
Next: Broaden only with a named workload/device/precision qualification.
<a id="pc_cuda_wsl-tts"></a>
### PC HX370 + RTX 5090 Laptop / WSL × Qwen3-TTS 0.6B CustomVoice
**PARTIAL — P-limited**. Real-weight two-stage audio completes. One measured utterance has playback stalls; speech quality, long streaming, interruption/recovery and thermal gates remain open.
Evidence: [tts-cuda-wsl](evidence/tts-cuda-wsl.json).
Next: Resolve and measure playback stalls; run quality, interruption and thermal tests.
<a id="pc_cuda_wsl-qwen27"></a>
### PC HX370 + RTX 5090 Laptop / WSL × Qwen3.8-27B
**FAILED — startup**. Fresh public Omni startup rejects the real NVFP4 checkpoint: no registered Omni pipeline. Historical bare-vLLM short-text success does not qualify this integration or multimodal inference.
Evidence: [qwen-wsl](evidence/qwen-wsl.json), [qwen-text-historical](evidence/qwen-text-historical.json).
Next: Add/validate an Omni pipeline binding; rerun text, image, context and artifact-quality tests.
<a id="pc_cuda_wsl-minicpm"></a>
### PC HX370 + RTX 5090 Laptop / WSL × MiniCPM-o 4.5
**BLOCKED — none**. No complete matching checkpoint found in the inventoried workspace, HF cache and native model roots. MiniCPM5-2B is not MiniCPM-o 4.5. Runtime registration alone is not a model run.
Evidence: [host-wsl](evidence/host-wsl.json), [host-windows](evidence/host-windows.json).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_cuda_wsl-vla"></a>
### PC HX370 + RTX 5090 Laptop / WSL × InternVLA-A1
**BLOCKED — none**. No complete matching checkpoint found in the inventoried workspace, HF cache and native model roots. MiniCPM5-2B is not MiniCPM-o 4.5. Runtime registration alone is not a model run.
Evidence: [host-wsl](evidence/host-wsl.json), [host-windows](evidence/host-windows.json).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_cuda_windows-spark"></a>
### PC HX370 + RTX 5090 Laptop / Windows × Spark-X2.5
**PASS — P**. Spark 4B BF16: 11 M0 tests passed on this branch for text, state, cancellation and memory; scoped to the recorded workload.
Evidence: [spark-cuda-windows](evidence/spark-cuda-windows.log).
Next: Broaden only with a named workload/device/precision qualification.
<a id="pc_cuda_windows-tts"></a>
### PC HX370 + RTX 5090 Laptop / Windows × Qwen3-TTS 0.6B CustomVoice
**PARTIAL — P-limited**. Real-weight two-stage audio completes. One measured utterance has playback stalls; speech quality, long streaming, interruption/recovery and thermal gates remain open.
Evidence: [tts-cuda-windows](evidence/tts-cuda-windows.json).
Next: Resolve and measure playback stalls; run quality, interruption and thermal tests.
<a id="pc_cuda_windows-qwen27"></a>
### PC HX370 + RTX 5090 Laptop / Windows × Qwen3.8-27B
**FAILED — startup**. Fresh public Omni startup rejects the real NVFP4 checkpoint: no registered Omni pipeline. Historical bare-vLLM short-text success does not qualify this integration or multimodal inference.
Evidence: [qwen-windows](evidence/qwen-windows.json), [qwen-text-historical](evidence/qwen-text-historical.json).
Next: Add/validate an Omni pipeline binding; rerun text, image, context and artifact-quality tests.
<a id="pc_cuda_windows-minicpm"></a>
### PC HX370 + RTX 5090 Laptop / Windows × MiniCPM-o 4.5
**BLOCKED — none**. No complete matching checkpoint found in the inventoried workspace, HF cache and native model roots. MiniCPM5-2B is not MiniCPM-o 4.5. Runtime registration alone is not a model run.
Evidence: [host-wsl](evidence/host-wsl.json), [host-windows](evidence/host-windows.json).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_cuda_windows-vla"></a>
### PC HX370 + RTX 5090 Laptop / Windows × InternVLA-A1
**BLOCKED — none**. No complete matching checkpoint found in the inventoried workspace, HF cache and native model roots. MiniCPM5-2B is not MiniCPM-o 4.5. Runtime registration alone is not a model run.
Evidence: [host-wsl](evidence/host-wsl.json), [host-windows](evidence/host-windows.json).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_igpu-spark"></a>
### PC HX370 + Radeon 890M / Windows worker × Spark-X2.5
**BLOCKED — none**. No placement- and quality-verified whole-model graph bundle/stateful adapter for this model on this AMD route. Small backend graphs do not establish model support.
Evidence: [backend-dml](evidence/backend-dml.json), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_igpu-tts"></a>
### PC HX370 + Radeon 890M / Windows worker × Qwen3-TTS 0.6B CustomVoice
**BLOCKED — none**. No placement- and quality-verified whole-model graph bundle/stateful adapter for this model on this AMD route. Small backend graphs do not establish model support.
Evidence: [backend-dml](evidence/backend-dml.json), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_igpu-qwen27"></a>
### PC HX370 + Radeon 890M / Windows worker × Qwen3.8-27B
**COMPONENT — C-historical**. FP32 448x448 vision tower: DirectML 85/113 nodes; normalized max error 9.095e-06 versus torch CPU. Historical component path, not full 27B or current graph-stage image-to-text integration.
Evidence: [qwen-vision-dml](evidence/qwen-vision-dml.json).
Next: Recover the hashed tower bundle and qualify its current Omni graph handoff with the language stage.
<a id="pc_igpu-minicpm"></a>
### PC HX370 + Radeon 890M / Windows worker × MiniCPM-o 4.5
**BLOCKED — none**. No placement- and quality-verified whole-model graph bundle/stateful adapter for this model on this AMD route. Small backend graphs do not establish model support.
Evidence: [backend-dml](evidence/backend-dml.json), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_igpu-vla"></a>
### PC HX370 + Radeon 890M / Windows worker × InternVLA-A1
**BLOCKED — none**. No placement- and quality-verified whole-model graph bundle/stateful adapter for this model on this AMD route. Small backend graphs do not establish model support.
Evidence: [backend-dml](evidence/backend-dml.json), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_npu-spark"></a>
### PC HX370 + AMD NPU / Windows worker × Spark-X2.5
**BLOCKED — none**. No placement- and quality-verified whole-model graph bundle/stateful adapter for this model on this AMD route. Small backend graphs do not establish model support.
Evidence: [backend-npu](evidence/backend-npu.json), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_npu-tts"></a>
### PC HX370 + AMD NPU / Windows worker × Qwen3-TTS 0.6B CustomVoice
**BLOCKED — none**. No placement- and quality-verified whole-model graph bundle/stateful adapter for this model on this AMD route. Small backend graphs do not establish model support.
Evidence: [backend-npu](evidence/backend-npu.json), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_npu-qwen27"></a>
### PC HX370 + AMD NPU / Windows worker × Qwen3.8-27B
**REJECTED — artifact**. The tested A16W8 whole-vision-tower export failed NPU placement. This conclusion is specific to that export, not all future Qwen/NPU combinations.
Evidence: [qwen-vision-npu](evidence/qwen-vision-npu.json).
Next: Validate a supported export or smaller useful component, including same-checkpoint numerical quality.
<a id="pc_npu-minicpm"></a>
### PC HX370 + AMD NPU / Windows worker × MiniCPM-o 4.5
**BLOCKED — none**. No placement- and quality-verified whole-model graph bundle/stateful adapter for this model on this AMD route. Small backend graphs do not establish model support.
Evidence: [backend-npu](evidence/backend-npu.json), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_npu-vla"></a>
### PC HX370 + AMD NPU / Windows worker × InternVLA-A1
**BLOCKED — none**. No placement- and quality-verified whole-model graph bundle/stateful adapter for this model on this AMD route. Small backend graphs do not establish model support.
Evidence: [backend-npu](evidence/backend-npu.json), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_joint-spark"></a>
### PC CPU+iGPU+NPU +/- discrete GPU, joint model execution × Spark-X2.5
**BLOCKED — none**. No qualifying same-model multi-accelerator deployment/artifact plan or overlap/recovery evidence. Individual routes are not a joint pipeline.
Evidence: [backend-dml](evidence/backend-dml.json), [backend-npu](evidence/backend-npu.json), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_joint-tts"></a>
### PC CPU+iGPU+NPU +/- discrete GPU, joint model execution × Qwen3-TTS 0.6B CustomVoice
**BLOCKED — none**. No qualifying same-model multi-accelerator deployment/artifact plan or overlap/recovery evidence. Individual routes are not a joint pipeline.
Evidence: [backend-dml](evidence/backend-dml.json), [backend-npu](evidence/backend-npu.json), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_joint-qwen27"></a>
### PC CPU+iGPU+NPU +/- discrete GPU, joint model execution × Qwen3.8-27B
**BLOCKED — none**. No qualifying same-model multi-accelerator deployment/artifact plan or overlap/recovery evidence. Individual routes are not a joint pipeline.
Evidence: [backend-dml](evidence/backend-dml.json), [backend-npu](evidence/backend-npu.json), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_joint-minicpm"></a>
### PC CPU+iGPU+NPU +/- discrete GPU, joint model execution × MiniCPM-o 4.5
**BLOCKED — none**. No qualifying same-model multi-accelerator deployment/artifact plan or overlap/recovery evidence. Individual routes are not a joint pipeline.
Evidence: [backend-dml](evidence/backend-dml.json), [backend-npu](evidence/backend-npu.json), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_joint-vla"></a>
### PC CPU+iGPU+NPU +/- discrete GPU, joint model execution × InternVLA-A1
**BLOCKED — none**. No qualifying same-model multi-accelerator deployment/artifact plan or overlap/recovery evidence. Individual routes are not a joint pipeline.
Evidence: [backend-dml](evidence/backend-dml.json), [backend-npu](evidence/backend-npu.json), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_xelite-spark"></a>
### PC Snapdragon X Elite CRD / AI Hub × Spark-X2.5
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_xelite-tts"></a>
### PC Snapdragon X Elite CRD / AI Hub × Qwen3-TTS 0.6B CustomVoice
**PROFILE_ONLY — C-timing-only**. Historical QNN talker profile re-fetched successfully; no numerical/full-pipeline gate. Historical TFLite vocoder target was refused on this Windows ARM device.
Evidence: [tts-xelite](evidence/tts-xelite.json), [tts-xelite-vocoder-rejected](evidence/tts-xelite-vocoder-rejected.json), [tts-other-devices](evidence/tts-other-devices.json), [tts-other-device-code](evidence/tts-other-device-code.py).
Next: Validate target-specific numerical quality, complete local execution, memory and sustained behavior.
<a id="pc_xelite-qwen27"></a>
### PC Snapdragon X Elite CRD / AI Hub × Qwen3.8-27B
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_xelite-minicpm"></a>
### PC Snapdragon X Elite CRD / AI Hub × MiniCPM-o 4.5
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="pc_xelite-vla"></a>
### PC Snapdragon X Elite CRD / AI Hub × InternVLA-A1
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="mobile_s25-spark"></a>
### Mobile Galaxy S25 / Snapdragon 8 Elite for Galaxy × Spark-X2.5
**COMPONENT — C**. Fresh 2026-09-22 W8A16 full-attention component inference/profile passed; full1024 denotes one cache bucket. No full prefill/decode/KV/ring/sampling loop.
Evidence: [spark-s25](evidence/spark-s25.json), [spark-s25-parity](evidence/spark-s25-parity.json).
Next: Implement and validate local 128-token generation, 512/1024 transitions, cancellation and resident memory.
<a id="mobile_s25-tts"></a>
### Mobile Galaxy S25 / Snapdragon 8 Elite for Galaxy × Qwen3-TTS 0.6B CustomVoice
**COMPONENT — C**. Fresh FP16 predictor inference passed; its one output exactly matches the same compiled artifact/dataset reference. Historical decoder parity exists. No complete co-resident NPU/GPU stream.
Evidence: [tts-s25](evidence/tts-s25.json), [hub-repeatability](evidence/hub-repeatability.json), [tts-mobile-parity](evidence/tts-mobile-parity.json).
Next: Validate the device-local talker/predictor/vocoder pipeline, output quality, recovery and 30-minute thermal behavior.
<a id="mobile_s25-qwen27"></a>
### Mobile Galaxy S25 / Snapdragon 8 Elite for Galaxy × Qwen3.8-27B
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="mobile_s25-minicpm"></a>
### Mobile Galaxy S25 / Snapdragon 8 Elite for Galaxy × MiniCPM-o 4.5
**COMPONENT — C**. Fresh FP16 speech-head inference passed; all 41 outputs exactly match the same artifact/dataset reference. Historical FP16 numerical parity passed; tested W8A16 top-1 parity failed. Thinker/encoders/vocoder are not qualified together.
Evidence: [minicpm-s25](evidence/minicpm-s25.json), [hub-repeatability](evidence/hub-repeatability.json), [minicpm-mobile-parity](evidence/minicpm-mobile-parity.json).
Next: Supply a qualified complete mobile checkpoint/export and validate the full multimodal/stateful pipeline.
<a id="mobile_s25-vla"></a>
### Mobile Galaxy S25 / Snapdragon 8 Elite for Galaxy × InternVLA-A1
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="mobile_s24-spark"></a>
### Mobile Galaxy S24 / Snapdragon 8 Gen 3 × Spark-X2.5
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="mobile_s24-tts"></a>
### Mobile Galaxy S24 / Snapdragon 8 Gen 3 × Qwen3-TTS 0.6B CustomVoice
**COMPONENT — C-historical**. Historical FP16 decoder parity has SNR 39.13 dB. Tested calibrated INT8 decoder parity failed with negative SNR. Neither result is a full local TTS stream.
Evidence: [tts-mobile-parity](evidence/tts-mobile-parity.json).
Next: Validate the complete local pipeline and a quality-passing artifact set.
<a id="mobile_s24-qwen27"></a>
### Mobile Galaxy S24 / Snapdragon 8 Gen 3 × Qwen3.8-27B
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="mobile_s24-minicpm"></a>
### Mobile Galaxy S24 / Snapdragon 8 Gen 3 × MiniCPM-o 4.5
**COMPONENT — C-historical**. Historical FP16 speech-head job re-fetched successfully; SNR 49.22 dB/top-1 match in the recorded parity test. W8A16 top-1 failed. Not complete MiniCPM-o.
Evidence: [minicpm-s24](evidence/minicpm-s24.json), [minicpm-mobile-parity](evidence/minicpm-mobile-parity.json).
Next: Qualify thinker/encoders/vocoder and stateful local integration.
<a id="mobile_s24-vla"></a>
### Mobile Galaxy S24 / Snapdragon 8 Gen 3 × InternVLA-A1
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="embedded_sa8775p-spark"></a>
### Embedded SA8775P ADP / AI Hub × Spark-X2.5
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="embedded_sa8775p-tts"></a>
### Embedded SA8775P ADP / AI Hub × Qwen3-TTS 0.6B CustomVoice
**PROFILE_ONLY — C-timing-only**. Historical NPU talker and GPU vocoder profiles re-fetched successfully; no complete pipeline, parity or co-residency qualification.
Evidence: [tts-sa8775p-npu](evidence/tts-sa8775p-npu.json), [tts-sa8775p-gpu](evidence/tts-sa8775p-gpu.json), [tts-other-devices](evidence/tts-other-devices.json), [tts-other-device-code](evidence/tts-other-device-code.py).
Next: Validate target-specific numerical quality, complete local execution, memory and sustained behavior.
<a id="embedded_sa8775p-qwen27"></a>
### Embedded SA8775P ADP / AI Hub × Qwen3.8-27B
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="embedded_sa8775p-minicpm"></a>
### Embedded SA8775P ADP / AI Hub × MiniCPM-o 4.5
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="embedded_sa8775p-vla"></a>
### Embedded SA8775P ADP / AI Hub × InternVLA-A1
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="embedded_rb3-spark"></a>
### Embedded RB3 Gen 2 / QCS6490 / AI Hub × Spark-X2.5
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="embedded_rb3-tts"></a>
### Embedded RB3 Gen 2 / QCS6490 / AI Hub × Qwen3-TTS 0.6B CustomVoice
**PROFILE_ONLY — C-timing-only**. Historical GPU vocoder profile re-fetched successfully. The attempted NPU talker build was rejected for floating-point inputs. No full model pipeline.
Evidence: [tts-rb3-gpu](evidence/tts-rb3-gpu.json), [tts-rb3-talker-rejected](evidence/tts-rb3-talker-rejected.json), [tts-other-devices](evidence/tts-other-devices.json), [tts-other-device-code](evidence/tts-other-device-code.py).
Next: Validate target-specific numerical quality, complete local execution, memory and sustained behavior.
<a id="embedded_rb3-qwen27"></a>
### Embedded RB3 Gen 2 / QCS6490 / AI Hub × Qwen3.8-27B
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="embedded_rb3-minicpm"></a>
### Embedded RB3 Gen 2 / QCS6490 / AI Hub × MiniCPM-o 4.5
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
<a id="embedded_rb3-vla"></a>
### Embedded RB3 Gen 2 / QCS6490 / AI Hub × InternVLA-A1
**BLOCKED — none**. No complete qualified target artifact and device-local stateful Omni backend. Hub jobs provide component execution, not an on-device generation/streaming controller; ADB has no attached device.
Evidence: [hub-inventory](evidence/hub-inventory.json), [host-wsl](evidence/host-wsl.json), [backend-factory](evidence/backend-factory.py), [graph-contract](evidence/graph-contract.py).
Next: Supply and validate the missing matching artifact/backend, then run the complete specified workload.
@@ -0,0 +1,183 @@
{
"schema_version": 1,
"evidence": "B",
"platform": "Linux-6.18.33.2-microsoft-standard-WSL2-x86_64-with-glibc2.43",
"python": "/home/zhout/project/edge_infer/vllm-omni-edge/../.venvs/omni-cuda-029/bin/python",
"workload": {
"repeats": 20,
"concurrency": 1
},
"artifact": "/home/zhout/project/edge_infer/analysis/experiments/omni_abstraction_20260922/artifacts/cpu_add/manifest.json",
"samples_s": [
0.0040255889762192965,
0.0033558340510353446,
0.0017729569808579981,
0.0013527399860322475,
0.002440641983412206,
0.0013856349978595972,
0.0013715020031668246,
0.005610267980955541,
0.0013573350152000785,
0.0012883200543001294,
0.0012204480008222163,
0.0011961509590037167,
0.0017715750145725906,
0.0011716459994204342,
0.0011642409954220057,
0.001186243025586009,
0.0011836979538202286,
0.0013943579979240894,
0.0030256269965320826,
0.004145854036323726
],
"started_unix": 1790047607.8205295,
"startup_s": 1.99209214001894,
"execution_plan": {
"backend": "external.graph.v1",
"stage_id": 0,
"worker_generation": "c2f7ca31da7e4afcb9751363336eead1",
"artifact_sha256": "4314a53e6394d9be101ec3b05b1d7baeea58dbd314fe8d5d2c12d94a6017b051",
"component": "cpu_add",
"route": {
"name": "amd-dml",
"interpreter": "/mnt/c/Users/zhout/dml-ep/Scripts/python.exe",
"worker": "/home/zhout/project/edge_infer/vllm-omni-edge/vllm_omni/edge/local/external/worker_ort.py",
"ep": "dml",
"is_windows": true,
"available": true,
"reason": "",
"extra": null
},
"reserved_bytes": {
"machine:ram": 536870912
},
"max_io_bytes": 8388608,
"placement": {
"ep": "dml",
"graph_path": "/home/zhout/project/edge_infer/analysis/experiments/omni_abstraction_20260922/artifacts/cpu_add/graph.onnx",
"session_providers": [
"DmlExecutionProvider",
"CPUExecutionProvider"
],
"available_providers": [
"DmlExecutionProvider",
"CPUExecutionProvider"
],
"node_counts": {
"DmlExecutionProvider": 1
},
"total_nodes": 1,
"target_nodes": 1,
"fraction_on_target": 1.0,
"session_create_s": 0.3837424000375904,
"warmup_s": 0.0069688999792560935,
"rss_bytes": 145149952,
"inputs": [
{
"name": "x",
"type": "tensor(float)",
"shape": [
2,
3
]
}
],
"outputs": [
{
"name": "y",
"type": "tensor(float)",
"shape": [
2,
3
]
}
],
"profile_path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\omni_abstraction_20260922\\graph-dml-crossdomain.placement_2026-09-22_11-26-49.json",
"ep_directory": "",
"requested_provider_missing": "",
"fallback_note": "",
"onnxruntime": "1.24.4",
"note": ""
},
"worker": {
"executable": "C:\\Users\\zhout\\dml-ep\\Scripts\\python.exe",
"python": "3.12.10 (tags/v3.12.10:0cc8128, Apr 8 2025, 12:21:36) [MSC v.1943 64 bit (AMD64)]",
"platform": "win32",
"pid": 33568,
"onnxruntime": "1.24.4",
"numpy": "2.5.3",
"available_providers": [
"DmlExecutionProvider",
"CPUExecutionProvider"
],
"rss_bytes": 54603776,
"process_identity": {
"pid": 33568,
"created_filetime": 134345212080641171
}
},
"evidence": "B",
"stateful": false
},
"worker_stats": {
"runs": 20,
"total_run_s": 0.011883700266480446,
"rss_bytes": 145235968,
"peak_rss_bytes": 145256448,
"report": {
"ep": "dml",
"onnxruntime": "1.24.4",
"available_providers": [
"DmlExecutionProvider",
"CPUExecutionProvider"
],
"session_create_s": 0.3837424000375904,
"session_providers": [
"DmlExecutionProvider",
"CPUExecutionProvider"
],
"inputs": [
{
"name": "x",
"type": "tensor(float)",
"shape": [
2,
3
]
}
],
"outputs": [
{
"name": "y",
"type": "tensor(float)",
"shape": [
2,
3
]
}
],
"warmup_s": 0.0069688999792560935,
"profile_path": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\omni_abstraction_20260922\\graph-dml-crossdomain.placement_2026-09-22_11-26-49.json",
"node_counts": {
"DmlExecutionProvider": 1
},
"total_nodes": 1,
"target_nodes": 1,
"fraction_on_target": 1.0,
"rss_bytes": 145149952
}
},
"finite": true,
"status": "passed",
"ledger_after_shutdown": {
"capacities": {
"machine:ram": 1073741824
},
"reserved": {
"machine:ram": 0
},
"owners": [],
"quarantined": []
},
"ended_unix": 1790047610.5372653
}
@@ -0,0 +1,10 @@
# SPDX-License-Identifier: Apache-2.0
"""Factories for non-vLLM stages owned by the existing StageRuntime."""
def create_graph_client(metadata, config, ledger, reservation):
from .graph import GraphStageClient
if config.get("backend", {}).get("name") != "external.graph.v1":
raise ValueError("graph stage requires backend.name=external.graph.v1")
return GraphStageClient(metadata, config["backend"], ledger, reservation)
@@ -0,0 +1,188 @@
{
"schema_version": 1,
"evidence": "B",
"platform": "Linux-6.18.33.2-microsoft-standard-WSL2-x86_64-with-glibc2.43",
"python": "/home/zhout/project/edge_infer/vllm-omni-edge/../.venvs/omni-cuda-029/bin/python",
"workload": {
"repeats": 20,
"concurrency": 1
},
"artifact": "/home/zhout/project/edge_infer/analysis/experiments/omni_abstraction_20260922/artifacts/amd_npu_a16w8/manifest.json",
"samples_s": [
0.014123815984930843,
0.0061385720036923885,
0.0058239150093868375,
0.00862913700984791,
0.006411314010620117,
0.02813155995681882,
0.005825735977850854,
0.005439646018203348,
0.006521859031636268,
0.0055095599964261055,
0.004404937033541501,
0.006788280967157334,
0.005359956994652748,
0.0058780250255949795,
0.0045300599886104465,
0.006785528967157006,
0.006678219011519104,
0.0063079120009206235,
0.0045537170371972024,
0.006222707044798881
],
"started_unix": 1790047130.3935041,
"startup_s": 5.256746579951141,
"execution_plan": {
"backend": "external.graph.v1",
"stage_id": 0,
"worker_generation": "7b8fc7c330a649f685c5c257778d0d57",
"artifact_sha256": "63889910407277b0a557f7c58cfe6a4ce4b3884711961a90f3e9e52105c0f1ed",
"component": "amd_npu_a16w8",
"route": {
"name": "amd-npu",
"interpreter": "/mnt/c/Users/zhout/npu-ep/Scripts/python.exe",
"worker": "/home/zhout/project/edge_infer/vllm-omni-edge/vllm_omni/edge/local/external/worker_ort.py",
"ep": "vitisai",
"is_windows": true,
"available": true,
"reason": "",
"extra": null
},
"reserved_bytes": {
"machine:ram": 1073741824
},
"max_io_bytes": 8388608,
"placement": {
"ep": "vitisai",
"graph_path": "/home/zhout/project/edge_infer/analysis/experiments/omni_abstraction_20260922/artifacts/amd_npu_a16w8/graph.onnx",
"session_providers": [
"vitisai",
"CPUExecutionProvider"
],
"available_providers": [
"AzureExecutionProvider",
"CPUExecutionProvider",
"vitisai"
],
"node_counts": {
"CPUExecutionProvider": 2,
"vitisai": 1
},
"total_nodes": 3,
"target_nodes": 1,
"fraction_on_target": 0.3333333333333333,
"session_create_s": 2.7006354000186548,
"warmup_s": 0.002900300023611635,
"rss_bytes": 283721728,
"inputs": [
{
"name": "x",
"type": "tensor(float)",
"shape": [
256,
1024
]
}
],
"outputs": [
{
"name": "y",
"type": "tensor(float)",
"shape": [
256,
1024
]
}
],
"profile_path": "onnxruntime_profile__2026-09-22_11-18-52_927.json",
"ep_directory": "C:\\Program Files\\WindowsApps\\WindowsWorkload.EP.AMD.VitisAI.Framework.1.8_1.8.63.0_x64__8wekyb3d8bbwe\\ExecutionProvider",
"requested_provider_missing": "",
"fallback_note": "",
"onnxruntime": "1.30.0",
"note": ""
},
"worker": {
"executable": "C:\\Users\\zhout\\npu-ep\\Scripts\\python.exe",
"python": "3.12.10 (tags/v3.12.10:0cc8128, Apr 8 2025, 12:21:36) [MSC v.1943 64 bit (AMD64)]",
"platform": "win32",
"pid": 23080,
"onnxruntime": "1.30.0",
"numpy": "2.5.3",
"available_providers": [
"AzureExecutionProvider",
"CPUExecutionProvider"
],
"rss_bytes": 55009280,
"process_identity": {
"pid": 23080,
"created_filetime": 134345207305451697
}
},
"evidence": "B",
"stateful": false
},
"worker_stats": {
"runs": 20,
"total_run_s": 0.020845199760515243,
"rss_bytes": 285020160,
"peak_rss_bytes": 288174080,
"report": {
"ep": "vitisai",
"onnxruntime": "1.30.0",
"ep_directory": "C:\\Program Files\\WindowsApps\\WindowsWorkload.EP.AMD.VitisAI.Framework.1.8_1.8.63.0_x64__8wekyb3d8bbwe\\ExecutionProvider",
"available_providers": [
"AzureExecutionProvider",
"CPUExecutionProvider",
"vitisai"
],
"session_create_s": 2.7006354000186548,
"session_providers": [
"vitisai",
"CPUExecutionProvider"
],
"inputs": [
{
"name": "x",
"type": "tensor(float)",
"shape": [
256,
1024
]
}
],
"outputs": [
{
"name": "y",
"type": "tensor(float)",
"shape": [
256,
1024
]
}
],
"warmup_s": 0.002900300023611635,
"profile_path": "onnxruntime_profile__2026-09-22_11-18-52_927.json",
"node_counts": {
"CPUExecutionProvider": 2,
"vitisai": 1
},
"total_nodes": 3,
"target_nodes": 1,
"fraction_on_target": 0.3333333333333333,
"rss_bytes": 283721728
}
},
"finite": true,
"status": "passed",
"ledger_after_shutdown": {
"capacities": {
"machine:ram": 2147483648
},
"reserved": {
"machine:ram": 0
},
"owners": [],
"quarantined": []
},
"ended_unix": 1790047136.6063926
}
@@ -0,0 +1,219 @@
# SPDX-License-Identifier: Apache-2.0
"""One bounded, non-preemptible graph stage using the existing worker.
The runtime owns startup and capacity. This adapter owns one in-flight call,
including its output until acknowledged by the consumer. No token scheduler,
provider fallback, or automatic worker replay is introduced here.
"""
from __future__ import annotations
import asyncio
import dataclasses
import math
import uuid
from pathlib import Path
from typing import Any
import numpy as np
from omni_stage_contracts import ArtifactManifest, BufferRef, StageEvent, StageRequest
from vllm_omni.edge.local.external.client import ExternalWorker
from vllm_omni.engine.resource_ledger import ResourceUnavailable
from vllm_omni.engine.stage_client import StageClientBase
from vllm_omni.host.routes import resolve_route
from vllm_omni.outputs import OmniRequestOutput
class GraphStageClient(StageClientBase):
def __init__(self, metadata, config, ledger, reservation) -> None:
for name, value in vars(metadata).items():
setattr(self, name, value)
self.stage_type = "graph"
self._ledger, self._reservation = ledger, reservation
self._generation = uuid.uuid4().hex
self._config = dict(config)
self._worker = None
self._closed = False
self._active: str | None = None
self._task: asyncio.Task | None = None
self._output: OmniRequestOutput | None = None
self._epoch = 0
self._max_io_bytes = int(config.get("max_io_bytes", 8 << 20))
if self._max_io_bytes <= 0 or self._max_io_bytes > min(reservation.demands.values()):
raise ValueError("graph I/O limit must be positive and fit the stage reservation")
try:
manifest_path = Path(config["manifest"]).resolve()
manifest = ArtifactManifest.read(manifest_path)
graph_name = manifest.metadata["graph_file"]
examples_name = manifest.metadata["example_inputs_file"]
if graph_name not in manifest.files or examples_name not in manifest.files:
raise ValueError("graph and placement examples must be hashed artifact payloads")
if sum((manifest_path.parent / n).stat().st_size for n in manifest.files) > min(
reservation.demands.values()
):
raise ResourceUnavailable("artifact files exceed stage memory reservation")
route = resolve_route(config["route"])
self._worker = ExternalWorker(
route, start_timeout_s=float(config.get("start_timeout_s", 120)), max_payload_bytes=self._max_io_bytes
)
self._worker.start()
with np.load(manifest_path.parent / examples_name, allow_pickle=False) as example:
inputs = {name: example[name] for name in example.files}
self._describe(inputs)
self.load_report = self._worker.load(
manifest_path.parent / graph_name,
example_inputs=inputs,
ep_dir=config.get("ep_dir"),
intra_op_num_threads=config.get("intra_op_num_threads"),
profile_prefix=config.get("profile_prefix"),
artifact_files=[manifest_path.parent / name for name in manifest.files],
)
report = self.load_report
minimum = float(config.get("min_fraction_on_target", 1.0))
if not 0 < minimum <= 1:
raise ValueError("placement threshold must be in (0, 1]")
if (
report.requested_provider_missing
or report.fraction_on_target is None
or not math.isfinite(report.fraction_on_target)
or not 0 < report.fraction_on_target <= 1
or report.target_nodes <= 0
or report.fraction_on_target < minimum
):
raise RuntimeError(f"REFUSE_EP_PLACEMENT: {report.summary()}")
allowed = set(config.get("allowed_providers", report.session_providers if route.ep == "cpu" else ()))
if not allowed or set(report.node_counts) - allowed:
raise RuntimeError("REFUSE_EP_PLACEMENT: declare all permitted execution providers")
if report.rss_bytes > min(reservation.demands.values()):
raise ResourceUnavailable("loaded worker RSS exceeds stage memory reservation")
self._input_schema = {name: (value.dtype.str, value.shape) for name, value in inputs.items()}
from omni_stage_contracts.types import file_digest
self.execution_plan = {
"backend": "external.graph.v1",
"stage_id": self.stage_id,
"worker_generation": self._generation,
"artifact_sha256": file_digest(manifest_path),
"component": manifest.component,
"route": route.to_dict(),
"reserved_bytes": dict(reservation.demands),
"max_io_bytes": self._max_io_bytes,
"placement": report.to_dict(),
"worker": {k: v for k, v in self._worker.hello.items() if k != "token"},
"evidence": "B",
"stateful": False,
}
except BaseException:
self.shutdown()
raise
def _describe(self, tensors: dict[str, np.ndarray]) -> tuple[BufferRef, ...]:
refs = tuple(
BufferRef(
name, str(self.stage_id), self._generation, array.dtype.name, tuple(array.shape), int(array.nbytes)
)
for name, array in tensors.items()
)
if sum(r.nbytes for r in refs) > self._max_io_bytes:
raise ResourceUnavailable("graph payload exceeds admitted I/O bound")
return refs
async def add_request_async(self, request_id: str, prompt: Any, params: Any = None) -> None:
self.check_health()
if self._active is not None:
raise ResourceUnavailable("graph stage has an unacknowledged request; capacity is one")
if not isinstance(prompt, dict) or not isinstance(prompt.get("tensors"), dict):
raise ValueError("graph prompt must contain a tensors mapping supplied by its model adapter")
inputs = {name: np.asarray(value) for name, value in prompt["tensors"].items()}
refs = self._describe(inputs)
if {name: (value.dtype.str, value.shape) for name, value in inputs.items()} != self._input_schema:
raise ValueError("input names/dtypes/shapes differ from the placement-verified artifact bucket")
# Copy at submission: application mutation cannot change an admitted call.
inputs = {name: value.copy() for name, value in inputs.items()}
self._epoch += 1
epoch = self._epoch
request = StageRequest(request_id, self.stage_id, epoch, self._generation, inputs=refs)
self._active = request_id
self._task = asyncio.create_task(self._run(request, inputs), name=f"graph-{self.stage_id}-{request_id}")
async def _run(self, request: StageRequest, inputs: dict[str, np.ndarray]) -> None:
try:
outputs, timing = await asyncio.to_thread(self._worker.run, inputs)
refs = self._describe(outputs)
if sum(x.nbytes for x in outputs.values()) + sum(x.nbytes for x in inputs.values()) > self._max_io_bytes:
raise ResourceUnavailable("combined graph input/output exceeds admitted I/O bound")
event = StageEvent(
request.request_id, self.stage_id, request.epoch, 1, "tensor", self._generation, refs, terminal=True
)
output = OmniRequestOutput(
request_id=request.request_id,
stage_id=self.stage_id,
final_output_type=self.final_output_type or "latent",
_custom_output={"tensors": outputs, "stage_event": dataclasses.asdict(event)},
metrics={"graph_timing": timing.to_dict()},
)
except asyncio.CancelledError:
raise
except Exception as exc:
output = OmniRequestOutput.from_error(request.request_id, str(exc))
output.stage_id = self.stage_id
if not self._closed and self._epoch == request.epoch:
loop = asyncio.get_running_loop()
output._stage_release = lambda: loop.call_soon_threadsafe(
self.acknowledge, request.request_id, request.epoch, request.worker_generation
)
self._output = output
def get_graph_output_nowait(self):
# Delivery is separate from release: the slot stays charged until ACK.
output, self._output = self._output, None
return output
def acknowledge(self, request_id: str, epoch: int, generation: str) -> None:
if (
self._active == request_id
and epoch == self._epoch
and generation == self._generation
and (self._task is None or self._task.done())
):
self._active = None
self._task = None
async def abort_requests_async(self, request_ids: list[str]) -> None:
if self._active not in request_ids:
return
self._epoch += 1
self._output = None
# A completed call needs no worker kill. Otherwise cancellation retires
# this single-session worker; the runtime will report it unavailable.
if self._task is not None and not self._task.done():
drained = await asyncio.to_thread(self._worker.terminate)
self._closed = True
done, _ = await asyncio.wait({self._task}, timeout=5)
self._ledger.release(self._reservation, drained=drained and bool(done) and not self._task.cancelled())
self._active = None
def check_health(self) -> None:
if self._closed:
from vllm.v1.engine.exceptions import EngineDeadError
raise EngineDeadError()
async def collective_rpc_async(self, method, timeout=None, args=(), kwargs=None):
raise NotImplementedError(f"graph backend does not implement collective RPC {method}")
def shutdown(self) -> None:
self._closed = True
self._output = None
drained = self._worker is None or self._worker.terminate()
task = self._task
if task is not None and not task.done():
# Process exit does not release Python input/transport references.
# Keep them charged until the call coroutine actually unwinds.
self._ledger.release(self._reservation, drained=False)
task.add_done_callback(
lambda done: self._ledger.release(self._reservation, drained=drained and not done.cancelled())
)
else:
self._ledger.release(self._reservation, drained=drained)
@@ -0,0 +1,54 @@
{
"timestamp": "2026-09-22T05:37:31.241692+00:00",
"platform": "Windows-11-10.0.26200-SP0",
"python": "C:\\Users\\zhout\\w2\\omni029venv\\Scripts\\python.exe",
"evidence": "preflight",
"packages": {
"vllm": "0.29.0+cu134",
"torch": "2.13.0+cu130",
"transformers": "5.14.1",
"onnxruntime": null,
"onnxruntime-directml": null
},
"search_roots": [
{
"path": "Microsoft.PowerShell.Core\\FileSystem::\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models",
"exists": false
},
{
"path": "C:\\Users\\zhout\\.cache\\huggingface\\hub",
"exists": true
},
{
"path": "C:\\Users\\zhout\\w2\\models",
"exists": true
}
],
"artifacts": [
{
"directory": "C:\\Users\\zhout\\w2\\models\\Qwen3-TTS-0.6B-85e237c",
"name": "Qwen3-TTS-0.6B-85e237c",
"model_type": "qwen3_tts",
"architectures": [
"Qwen3TTSForConditionalGeneration"
],
"weight_shards": 1,
"weight_bytes": 1811626576
}
],
"vllm_platform": "cuda",
"registered_pipelines": {
"spark2_5": true,
"qwen3_tts": true,
"qwen3_5": false,
"minicpmo_4_5": true
},
"nvidia-smi": {
"returncode": 0,
"stdout": "NVIDIA GeForce RTX 5090 Laptop GPU, 24463 MiB, 20263 MiB\n",
"stderr": ""
},
"adb": {
"error": "[WinError 2] \u7cfb\u7edf\u627e\u4e0d\u5230\u6307\u5b9a\u7684\u6587\u4ef6\u3002"
}
}
@@ -0,0 +1,264 @@
{
"timestamp": "2026-09-22T05:37:30.425887+00:00",
"platform": "Linux-6.18.33.2-microsoft-standard-WSL2-x86_64-with-glibc2.43",
"python": "/home/zhout/project/edge_infer/.venvs/omni-cuda-029/bin/python",
"evidence": "preflight",
"packages": {
"vllm": "0.29.0",
"torch": "2.13.0",
"transformers": "5.14.1",
"onnxruntime": "1.30.0",
"onnxruntime-directml": null
},
"search_roots": [
{
"path": "/home/zhout/project/edge_infer/models",
"exists": true
},
{
"path": "/home/zhout/.cache/huggingface/hub",
"exists": true
},
{
"path": "/mnt/c/Users/zhout/w2/models",
"exists": true
}
],
"artifacts": [
{
"directory": "/home/zhout/project/edge_infer/models/Qwen3.8-27B-FP8",
"name": "Qwen3.8-27B-FP8",
"model_type": "qwen3_5",
"architectures": [
"Qwen3_5ForConditionalGeneration"
],
"weight_shards": 66,
"weight_bytes": 30866866928
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-gptq-g128",
"name": "spark2_5-gptq-g128",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 1287662032
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-int4-g32",
"name": "spark2_5-int4-g32",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 1068136688
},
{
"directory": "/home/zhout/project/edge_infer/models/Spark-X2.5-1.7B-int8",
"name": "Spark-X2.5-1.7B-int8",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 1979003288
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-int4-g64-rtn",
"name": "spark2_5-int4-g64-rtn",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 961443656
},
{
"directory": "/home/zhout/project/edge_infer/models/Qwen3.8-27B-NVFP4",
"name": "Qwen3.8-27B-NVFP4",
"model_type": "qwen3_5",
"architectures": [
"Qwen3_5ForConditionalGeneration"
],
"weight_shards": 3,
"weight_bytes": 21921697280
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-int4-g64",
"name": "spark2_5-int4-g64",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 961443656
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-int4-g32-expanded",
"name": "spark2_5-int4-g32-expanded",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 3415340632
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-int4-g128-nodequant",
"error": "[Errno 2] No such file or directory: '/home/zhout/project/edge_infer/models/spark2_5-int4-g128-nodequant/model.safetensors'"
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-int4-g32-rtn",
"name": "spark2_5-int4-g32-rtn",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 1068136688
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-int4-g64-fpembed",
"name": "spark2_5-int4-g64-fpembed",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 1347320208
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-int4-g64-nocustomop",
"error": "[Errno 2] No such file or directory: '/home/zhout/project/edge_infer/models/spark2_5-int4-g64-nocustomop/model.safetensors'"
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-int4-g64-expanded",
"name": "spark2_5-int4-g64-expanded",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 3415340632
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-gptq-asym-g128",
"name": "spark2_5-gptq-asym-g128",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 1427131344
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-gptq-asym-g64",
"name": "spark2_5-gptq-asym-g64",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 1460472840
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-gptq-g128-head",
"name": "spark2_5-gptq-g128-head",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 1427131536
},
{
"directory": "/home/zhout/project/edge_infer/models/MiniCPM5-2B",
"name": "MiniCPM5-2B",
"model_type": "llama",
"architectures": [
"LlamaForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 5033557096
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-int4-g128",
"name": "spark2_5-int4-g128",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 908097200
},
{
"directory": "/home/zhout/project/edge_infer/models/spark2_5-gptq-g64",
"name": "spark2_5-gptq-g64",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 1,
"weight_bytes": 1460473032
},
{
"directory": "/home/zhout/project/edge_infer/models/Spark-X2.5-4B",
"name": "Spark-X2.5-4B",
"model_type": "spark2_5",
"architectures": [
"Spark2_5ForCausalLM"
],
"weight_shards": 5,
"weight_bytes": 8224192408
},
{
"directory": "/home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3.8-27B-FP8/snapshots/017b9c7af6b5689d5dd426a76e0bc077eb5ca20a",
"name": "models--Qwen--Qwen3.8-27B-FP8",
"model_type": "qwen3_5",
"architectures": [
"Qwen3_5ForConditionalGeneration"
],
"weight_shards": 0,
"weight_bytes": 0
},
{
"directory": "/home/zhout/.cache/huggingface/hub/models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice/snapshots/85e237c12c027371202489a0ec509ded67b5e4b5",
"name": "models--Qwen--Qwen3-TTS-12Hz-0.6B-CustomVoice",
"model_type": "qwen3_tts",
"architectures": [
"Qwen3TTSForConditionalGeneration"
],
"weight_shards": 1,
"weight_bytes": 1811626576
},
{
"directory": "/mnt/c/Users/zhout/w2/models/Qwen3-TTS-0.6B-85e237c",
"name": "Qwen3-TTS-0.6B-85e237c",
"model_type": "qwen3_tts",
"architectures": [
"Qwen3TTSForConditionalGeneration"
],
"weight_shards": 1,
"weight_bytes": 1811626576
}
],
"vllm_platform": "cuda",
"registered_pipelines": {
"spark2_5": true,
"qwen3_tts": true,
"qwen3_5": false,
"minicpmo_4_5": true
},
"nvidia-smi": {
"returncode": 0,
"stdout": "NVIDIA GeForce RTX 5090 Laptop GPU, 24463 MiB, 20263 MiB\n",
"stderr": ""
},
"adb": {
"returncode": 0,
"stdout": "List of devices attached\n\n",
"stderr": ""
}
}
@@ -0,0 +1,523 @@
[
{
"model": "tts",
"job": "j5wl18dzp",
"reference_job": "jpez3xm7p",
"model_id": "mmd5oy30q",
"input_dataset_id": "d70qr8459",
"scope": "same compiled component repeatability only",
"outputs": [
{
"name": "output_0__0",
"shape": [
1,
17,
1024
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
}
]
},
{
"model": "minicpm",
"job": "jpe7l8r75",
"reference_job": "jgol682xg",
"model_id": "mn7zvvw8m",
"input_dataset_id": "d7gwxe3y2",
"scope": "same compiled component repeatability only",
"outputs": [
{
"name": "output_0__0",
"shape": [
1,
6562
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_1__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_2__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_3__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_4__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_5__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_6__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_7__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_8__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_9__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_10__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_11__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_12__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_13__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_14__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_15__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_16__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_17__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_18__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_19__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_20__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_21__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_22__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_23__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_24__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_25__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_26__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_27__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_28__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_29__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_30__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_31__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_32__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_33__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_34__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_35__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_36__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_37__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_38__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_39__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
},
{
"name": "output_40__0",
"shape": [
1,
12,
1,
64
],
"finite": true,
"exact": true,
"max_abs_difference": 0.0
}
]
}
]
@@ -0,0 +1,26 @@
{
"S25|fp16": {
"snr_db": 48.86255471981432,
"corr": 0.999994236694899,
"top1_match": true,
"job": "jgol682xg"
},
"S25|w8a16": {
"snr_db": 2.3150011558735324,
"corr": 0.7138362463736316,
"top1_match": false,
"job": "jp4yr3nvp"
},
"S24|fp16": {
"snr_db": 49.221230017543675,
"corr": 0.9999949011919217,
"top1_match": true,
"job": "jp0m0646g"
},
"S24|w8a16": {
"snr_db": 0.069410481494823,
"corr": 0.5731221096245495,
"top1_match": false,
"job": "jgol68zxg"
}
}
@@ -0,0 +1,34 @@
{
"timestamp_utc": "2026-09-22T05:41:07.867017+00:00",
"qai_hub_version": "0.55.0",
"facility": "Qualcomm AI Hub Workbench",
"command": "collect",
"job_id": "jp0m0646g",
"url": "https://workbench.aihub.qualcomm.com/jobs/jp0m0646g/",
"status": "SUCCESS",
"status_message": "",
"options": "",
"hub_version": "aihub-2026.08.28.1",
"device": {
"name": "Samsung Galaxy S24",
"os": "14",
"attributes": [
"os:android",
"framework:tflite",
"framework:onnx",
"abi:aarch64-android",
"vendor:samsung",
"format:phone",
"chipset:qualcomm-snapdragon-8gen3",
"chipset:sm8650",
"hexagon:v75",
"soc-model:57",
"htp-supports-fp16:true",
"htp-supports-weight-sharing:true",
"framework:qnn"
]
},
"model_id": "mqp411wgq",
"input_dataset_id": "d7zn8rk57",
"outputs": "minicpm-s24-reference.npz"
}
@@ -0,0 +1,34 @@
{
"timestamp_utc": "2026-09-22T05:41:29.604567+00:00",
"qai_hub_version": "0.55.0",
"facility": "Qualcomm AI Hub Workbench",
"command": "collect",
"job_id": "jpe7l8r75",
"url": "https://workbench.aihub.qualcomm.com/jobs/jpe7l8r75/",
"status": "SUCCESS",
"status_message": "",
"options": "--compute_unit npu",
"hub_version": "aihub-2026.09.11.0",
"device": {
"name": "Samsung Galaxy S25",
"os": "15",
"attributes": [
"os:android",
"framework:tflite",
"framework:onnx",
"abi:aarch64-android",
"vendor:samsung",
"format:phone",
"chipset:qualcomm-snapdragon-8-elite-for-galaxy",
"chipset:sm8750-ac",
"hexagon:v79",
"soc-model:69",
"htp-supports-fp16:true",
"htp-supports-weight-sharing:true",
"framework:qnn"
]
},
"model_id": "mn7zvvw8m",
"input_dataset_id": "d7gwxe3y2",
"outputs": "minicpm-s25-repeat.npz"
}
@@ -0,0 +1,386 @@
{
"args": {
"model": "Qwen3.8-27B-NVFP4",
"tag": "nvfp4_fullgpu",
"offload": 0.0,
"max_len": 4096,
"batch_tokens": 128,
"contexts": "128,512,2048",
"output_tokens": 16
},
"started_unix": 1789451559.825598,
"status": "completed",
"requests": [
{
"label": "warmup",
"warmup": true,
"input_tokens": 37,
"requested_input_tokens": 64,
"output_tokens": 4,
"wall_s": 2.104777352999008,
"ttft_s": 0.9845618159997684,
"effective_prefill_tok_s": 37.58016957262204,
"decode_tok_s": 2.678075334243908,
"text": "A local inference engine",
"token_events": [
{
"tokens": 1,
"elapsed_s": 0.9845618159997684
},
{
"tokens": 2,
"elapsed_s": 1.4607479930000409
},
{
"tokens": 3,
"elapsed_s": 1.9160753899996052
},
{
"tokens": 4,
"elapsed_s": 2.1047692880001705
}
],
"engine_metrics": {
"num_generation_tokens": 4,
"arrival_time": 1789451614.1118956,
"queued_ts": 16132.809216287,
"scheduled_ts": 16132.809240102,
"first_token_ts": 16133.773814405,
"last_token_ts": 16134.894747982,
"first_token_latency": 0.9666800498962402,
"is_corrupted": false
}
},
{
"label": "context_128",
"warmup": false,
"input_tokens": 101,
"requested_input_tokens": 128,
"output_tokens": 16,
"wall_s": 7.534435138000845,
"ttft_s": 0.8878744009998627,
"effective_prefill_tok_s": 113.75482825753372,
"decode_tok_s": 2.2568085983584214,
"text": "A local inference engine schedules model stages and manages memory.\n",
"token_events": [
{
"tokens": 1,
"elapsed_s": 0.8878744009998627
},
{
"tokens": 2,
"elapsed_s": 1.35589112299931
},
{
"tokens": 3,
"elapsed_s": 1.8163898959992366
},
{
"tokens": 4,
"elapsed_s": 2.2728916380001465
},
{
"tokens": 5,
"elapsed_s": 2.740661313999226
},
{
"tokens": 6,
"elapsed_s": 3.191756124000676
},
{
"tokens": 7,
"elapsed_s": 3.6650295590006863
},
{
"tokens": 8,
"elapsed_s": 4.116174912000133
},
{
"tokens": 9,
"elapsed_s": 4.581921675999183
},
{
"tokens": 10,
"elapsed_s": 5.050290941999265
},
{
"tokens": 11,
"elapsed_s": 5.5145125439994445
},
{
"tokens": 12,
"elapsed_s": 5.978590863000136
},
{
"tokens": 13,
"elapsed_s": 6.428808316000868
},
{
"tokens": 14,
"elapsed_s": 6.903809924999223
},
{
"tokens": 15,
"elapsed_s": 7.354738661999363
},
{
"tokens": 16,
"elapsed_s": 7.534428304999892
}
],
"engine_metrics": {
"num_generation_tokens": 16,
"arrival_time": 1789451616.200588,
"queued_ts": 16134.897727778,
"scheduled_ts": 16134.897737055,
"first_token_ts": 16135.783655995,
"last_token_ts": 16142.430436973,
"first_token_latency": 0.8875420093536377,
"is_corrupted": false
}
},
{
"label": "context_512",
"warmup": false,
"input_tokens": 485,
"requested_input_tokens": 512,
"output_tokens": 16,
"wall_s": 9.34543342500001,
"ttft_s": 2.698834197999531,
"effective_prefill_tok_s": 179.70722334832524,
"decode_tok_s": 2.2567944713093335,
"text": "The passage consists of the single sentence \"A local inference engine schedules model stages and",
"token_events": [
{
"tokens": 1,
"elapsed_s": 2.698834197999531
},
{
"tokens": 2,
"elapsed_s": 3.153196487999594
},
{
"tokens": 3,
"elapsed_s": 3.620412973999919
},
{
"tokens": 4,
"elapsed_s": 4.0760655800004315
},
{
"tokens": 5,
"elapsed_s": 4.530665960000988
},
{
"tokens": 6,
"elapsed_s": 5.001150199001131
},
{
"tokens": 7,
"elapsed_s": 5.45293877900076
},
{
"tokens": 8,
"elapsed_s": 5.922671457999968
},
{
"tokens": 9,
"elapsed_s": 6.380228691999946
},
{
"tokens": 10,
"elapsed_s": 6.8396083309999085
},
{
"tokens": 11,
"elapsed_s": 7.307941597000536
},
{
"tokens": 12,
"elapsed_s": 7.773795327000698
},
{
"tokens": 13,
"elapsed_s": 8.249526080000578
},
{
"tokens": 14,
"elapsed_s": 8.700053388000015
},
{
"tokens": 15,
"elapsed_s": 9.167452538000362
},
{
"tokens": 16,
"elapsed_s": 9.345429708000665
}
],
"engine_metrics": {
"num_generation_tokens": 16,
"arrival_time": 1789451623.7372339,
"queued_ts": 16142.434277205,
"scheduled_ts": 16142.434285471,
"first_token_ts": 16145.130608161,
"last_token_ts": 16151.777934355,
"first_token_latency": 2.698073387145996,
"is_corrupted": false
}
},
{
"label": "context_2048",
"warmup": false,
"input_tokens": 2021,
"requested_input_tokens": 2048,
"output_tokens": 16,
"wall_s": 16.710036779999427,
"ttft_s": 10.016890127999432,
"effective_prefill_tok_s": 201.75922608463642,
"decode_tok_s": 2.241099848233223,
"text": "The passage consists of the single sentence \"A local inference engine schedules model stages and",
"token_events": [
{
"tokens": 1,
"elapsed_s": 10.016890127999432
},
{
"tokens": 2,
"elapsed_s": 10.475717346998863
},
{
"tokens": 3,
"elapsed_s": 10.951587396999457
},
{
"tokens": 4,
"elapsed_s": 11.405946809998568
},
{
"tokens": 5,
"elapsed_s": 11.883892373998606
},
{
"tokens": 6,
"elapsed_s": 12.338071106998541
},
{
"tokens": 7,
"elapsed_s": 12.809085696999318
},
{
"tokens": 8,
"elapsed_s": 13.279166899999836
},
{
"tokens": 9,
"elapsed_s": 13.738810389999344
},
{
"tokens": 10,
"elapsed_s": 14.21198344899858
},
{
"tokens": 11,
"elapsed_s": 14.666852663998725
},
{
"tokens": 12,
"elapsed_s": 15.146523536999666
},
{
"tokens": 13,
"elapsed_s": 15.601053123999009
},
{
"tokens": 14,
"elapsed_s": 16.074013286999616
},
{
"tokens": 15,
"elapsed_s": 16.53617112899883
},
{
"tokens": 16,
"elapsed_s": 16.710032341999977
}
],
"engine_metrics": {
"num_generation_tokens": 16,
"arrival_time": 1789451633.0867412,
"queued_ts": 16151.783924979,
"scheduled_ts": 16151.783939036,
"first_token_ts": 16161.797966789,
"last_token_ts": 16168.492024295,
"first_token_latency": 10.01593279838562,
"is_corrupted": false
}
}
],
"idle_cpu_pct": [
4.0,
0.0,
1.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
1.0,
0.0
],
"wsl_memory_before": {
"total": 33184985088,
"available": 31711698944,
"percent": 4.4,
"used": 1473286144,
"free": 31611633664,
"active": 661553152,
"inactive": 90931200,
"buffers": 3821568,
"cached": 469770240,
"shared": 1900544,
"slab": 468426752
},
"import_s": 10.525000752999404,
"vllm_file": "/home/zhout/project/edge_infer/.venvs/omni-cuda/lib/python3.12/site-packages/vllm/__init__.py",
"config": {
"model": "/home/zhout/project/edge_infer/models/Qwen3.8-27B-NVFP4",
"dtype": "bfloat16",
"max_model_len": 4096,
"max_num_seqs": 1,
"max_num_batched_tokens": 128,
"gpu_memory_utilization": 0.9,
"enforce_eager": true,
"cpu_offload_gb": 0.0,
"language_model_only": true,
"enable_prefix_caching": false,
"seed": 42,
"disable_log_stats": false
},
"engine_load_s": 42.73773059799896,
"loaded_unix": 1789451614.0896077,
"ended_unix": 1789451649.7974334,
"peak": {
"tree_rss": 13575667712,
"tree_pss": 13079872512,
"tree_rss_anon": 3798523904,
"gpu_used": 25273769984,
"gpu_power_mw": 39459,
"gpu_temp": 49,
"wsl_system_used": 5491564544
}
}
@@ -0,0 +1,81 @@
{
"runtime": {
"python": "3.12.13",
"platform": "Linux-6.18.33.2-microsoft-standard-WSL2-x86_64-with-glibc2.43",
"torch": "2.13.0+cu130",
"vllm": "0.28.0",
"vllm_omni": "0.28.1.dev154+g3834de310.d20260914",
"vllm_omni_file": "/home/zhout/project/edge_infer/vllm-omni/vllm_omni/__init__.py",
"vllm_file": "/home/zhout/project/edge_infer/.venvs/omni-cuda/lib/python3.12/site-packages/vllm/__init__.py",
"checkouts": {
"/home/zhout/project/edge_infer/vllm-omni": "3834de31051ae428beb2765915cdaff1772b9bbc-dirty",
"/home/zhout/project/edge_infer": "758b3af238b19e2c2abc668f23a767bb835a4a22-dirty"
}
},
"shape": {
"image_size": 448,
"grid_thw": [
1,
28,
28
],
"patches": 784,
"patch_dim": 1536,
"merged_tokens": 196,
"out_hidden_size": 5120
},
"artifact": {
"sha256": "68c8ee4a9ad8509c3a17e4591d3ba4fa0f2b30a5b725c3dd4e93a4dd8ca5fa65",
"bytes": 1838533565,
"fmt": "onnx:fp32",
"opset": 21
},
"reference": {
"backend": "torch cpu fp32",
"median_s": 1.3556148889983888,
"threads": 12
},
"arms": {
"igpu_dml_fp32": {
"node_counts": {
"DmlExecutionProvider": 85,
"CPUExecutionProvider": 28
},
"fraction_on_target": 0.7522123893805309,
"parity_vs_torch_cpu": {
"max_abs": 0.00101470947265625,
"mean_abs": 1.7557707678861334e-06,
"normalized_max": 9.09517166292062e-06,
"cosine": 0.9999999403953552
},
"runs": 10,
"median_worker_s": 0.23143709999567363,
"median_round_trip_s": 0.24530861800303683,
"median_transport_s": 0.012688652001088485,
"samples_worker_s": [
0.21845380000013392,
0.22525360000145156,
0.2263950000051409,
0.22689469999750145,
0.2282961000018986,
0.23143709999567363,
0.2368339999957243,
0.24216529999102931,
0.24823209999885876,
0.24826890000258572
],
"note": "medians over 10 runs after the load; the first call after a session is opened is materially slower and is excluded by the warm-up the load itself does"
},
"cuda_5090_fp32": {
"median_s": 0.09445196900196606,
"max_memory_allocated_bytes": 1952522240,
"parity_vs_torch_cpu": {
"max_abs": 0.06308555603027344,
"mean_abs": 0.0001078158529708162,
"normalized_max": 0.000565456401091069,
"cosine": 0.9999995827674866
},
"note": "torch runs matmul in TF32 by default on CUDA; this is why its deviation from the CPU reference is larger than the iGPU's"
}
}
}
@@ -0,0 +1,355 @@
{
"argv": [
"/home/zhout/project/edge_infer/vllm-omni/vllm_omni/edge/local/__main__.py",
"external",
"--graph",
"/tmp/claude-1000/-home-zhout-project-edge-infer/e1528a86-4037-4e80-b83f-3a2f6cd1e24f/scratchpad/tower_npu/tower_a16w8.onnx",
"--format",
"onnx:a16w8",
"--opset",
"21",
"--component",
"qwen3_5_vision_tower_448_a16w8",
"--source-model",
"models/Qwen3.8-27B-FP8",
"--exporter",
"vllm_omni.edge.local.artifacts.vision_tower",
"--device",
"npu:amd",
"--min-placement",
"0.30",
"--runs",
"5",
"--inputs",
"/tmp/claude-1000/-home-zhout-project-edge-infer/e1528a86-4037-4e80-b83f-3a2f6cd1e24f/scratchpad/tower_io.npz",
"--profile-dir",
"/tmp/claude-1000/-home-zhout-project-edge-infer/e1528a86-4037-4e80-b83f-3a2f6cd1e24f/scratchpad",
"--json",
"analysis/experiments/m3_amd_devices_20260915/m32_tower_npu.json"
],
"runtime": {
"python": "3.12.13",
"platform": "Linux-6.18.33.2-microsoft-standard-WSL2-x86_64-with-glibc2.43",
"torch": "2.13.0+cu130",
"vllm": "0.28.0",
"vllm_omni": "0.28.1.dev154+g3834de310.d20260914",
"vllm_omni_file": "/home/zhout/project/edge_infer/vllm-omni/vllm_omni/__init__.py",
"vllm_file": "/home/zhout/project/edge_infer/.venvs/omni-cuda/lib/python3.12/site-packages/vllm/__init__.py",
"checkouts": {
"/home/zhout/project/edge_infer/vllm-omni": "3834de31051ae428beb2765915cdaff1772b9bbc-dirty",
"/home/zhout/project/edge_infer": "758b3af238b19e2c2abc668f23a767bb835a4a22-dirty"
}
},
"devices": [
{
"device_id": "cuda:0",
"kind": "gpu_discrete",
"vendor": "nvidia",
"name": "NVIDIA GeForce RTX 5090 Laptop GPU",
"backend": "vllm:cuda",
"runnable": true,
"memory_pool": "vram",
"memory_bytes": 25650855936,
"compute_capability": [
12,
0
],
"weight_formats": [
"awq",
"compressed-tensors:fp8",
"dense",
"gptq",
"modelopt_fp4"
],
"evidence": "B",
"reason": "",
"masked": false,
"extra": {
"sm_count": 82,
"source": "torch.cuda"
}
},
{
"device_id": "npu:amd",
"kind": "npu",
"vendor": "amd",
"name": "NPU Compute Accelerator Device",
"backend": "ort:vitisai",
"runnable": true,
"memory_pool": "host_ram",
"memory_bytes": 0,
"compute_capability": null,
"weight_formats": [
"onnx:a16w8"
],
"evidence": "B",
"reason": "An MCDM device; WSL2's GPU-PV forwards WDDM display adapters only, so it has no device node here and nothing installed inside WSL reaches it. It does work from a Windows-side process -- onnxruntime>=1.25 plus the WindowsWorkload.EP.AMD.VitisAI.Framework appx, loading onnxruntime_vitisai_ep.dll (not the RyzenAI *Light* EP beside it) with its own directory on the DLL search path, against an A16W8-quantized opset-21 graph. Measured 5.3x the CPU on a 1024x2048x2048 GEMM. See vllm_omni/edge/npu_ryzenai.py.",
"masked": false,
"extra": {
"source": "wsl-interop",
"probe_route": "ryzenai-ep-windows",
"host_pool_bytes": 33184985088,
"host_pool_available_bytes": 29899563008,
"worker_route": "ort-vitisai",
"worker_interpreter": "/mnt/c/Users/zhout/npu-ep/Scripts/python.exe",
"routes": [
{
"name": "ort-vitisai",
"interpreter": "/mnt/c/Users/zhout/npu-ep/Scripts/python.exe",
"worker": "/home/zhout/project/edge_infer/vllm-omni/vllm_omni/edge/local/external/worker_ort.py",
"ep": "vitisai",
"is_windows": true,
"available": true,
"reason": "",
"extra": null
}
],
"executes": "exported graphs, not checkpoints",
"dedicated_vram_bytes": 0
}
},
{
"device_id": "gpu_integrated:amd",
"kind": "gpu_integrated",
"vendor": "amd",
"name": "AMD Radeon(TM) 890M Graphics",
"backend": "ort:dml",
"runnable": true,
"memory_pool": "host_ram",
"memory_bytes": 0,
"compute_capability": null,
"weight_formats": [
"onnx:fp16",
"onnx:fp32"
],
"evidence": "B",
"reason": "No /dev/dri under WSL2, but reachable through DirectML over /dev/dxg: pip install torch-directml in its own venv (it pins torch==2.4.1). Measured 1.12 TFLOP/s fp32 and 5-7.4 GB/s -- below the CPU on both, so route work here only when the CPU is the thing you are trying to free.",
"masked": false,
"extra": {
"source": "wsl-interop",
"probe_route": "directml",
"host_pool_bytes": 33184985088,
"host_pool_available_bytes": 29899563008,
"worker_route": "ort-dml",
"worker_interpreter": "/mnt/c/Users/zhout/dml-ep/Scripts/python.exe",
"routes": [
{
"name": "ort-dml",
"interpreter": "/mnt/c/Users/zhout/dml-ep/Scripts/python.exe",
"worker": "/home/zhout/project/edge_infer/vllm-omni/vllm_omni/edge/local/external/worker_ort.py",
"ep": "dml",
"is_windows": true,
"available": true,
"reason": "",
"extra": null
},
{
"name": "torch-dml",
"interpreter": "/home/zhout/project/edge_infer/.venvs/dml/bin/python",
"worker": "/home/zhout/project/edge_infer/vllm-omni/vllm_omni/edge/local/external/worker_dml.py",
"ep": "dml",
"is_windows": false,
"available": true,
"reason": "",
"extra": null
}
],
"executes": "exported graphs, not checkpoints",
"dedicated_vram_bytes": 0
}
},
{
"device_id": "cpu",
"kind": "cpu",
"vendor": "amd",
"name": "AMD Ryzen AI 9 HX 370 w/ Radeon 890M",
"backend": null,
"runnable": false,
"memory_pool": "host_ram",
"memory_bytes": 33184985088,
"compute_capability": null,
"weight_formats": [
"compressed-tensors:int8",
"dense",
"gptq"
],
"evidence": "D",
"reason": "vllm.platforms.current_platform is 'cuda', not 'cpu': this interpreter's vLLM wheel has no CPU executor. The CPU build lives in a separate venv (.venvs/omni-cpu); a CPU plan from here is a plan for that interpreter, not something this one can run.",
"masked": false,
"extra": {
"n_physical": 12,
"n_logical": 24,
"ram_available_bytes": 29899563008,
"bf16": true
}
}
],
"plan": {
"artifact": {
"path": "/tmp/claude-1000/-home-zhout-project-edge-infer/e1528a86-4037-4e80-b83f-3a2f6cd1e24f/scratchpad/tower_npu/tower_a16w8.onnx",
"sha256": "215746bbfece7b94540c8f833cc19f45b13e0664eaea34eeda4618a60eef3a2c",
"bytes": 464117283,
"fmt": "onnx:a16w8",
"opset": 21,
"source_model": "models/Qwen3.8-27B-FP8",
"source_revision": null,
"component": "qwen3_5_vision_tower_448_a16w8",
"exporter": "vllm_omni.edge.local.artifacts.vision_tower",
"input_spec": [],
"output_spec": [],
"calibration": null,
"parity": null,
"notes": ""
},
"device": {
"device_id": "npu:amd",
"kind": "npu",
"vendor": "amd",
"name": "NPU Compute Accelerator Device",
"backend": "ort:vitisai",
"runnable": true,
"memory_pool": "host_ram",
"memory_bytes": 0,
"compute_capability": null,
"weight_formats": [
"onnx:a16w8"
],
"evidence": "B",
"reason": "An MCDM device; WSL2's GPU-PV forwards WDDM display adapters only, so it has no device node here and nothing installed inside WSL reaches it. It does work from a Windows-side process -- onnxruntime>=1.25 plus the WindowsWorkload.EP.AMD.VitisAI.Framework appx, loading onnxruntime_vitisai_ep.dll (not the RyzenAI *Light* EP beside it) with its own directory on the DLL search path, against an A16W8-quantized opset-21 graph. Measured 5.3x the CPU on a 1024x2048x2048 GEMM. See vllm_omni/edge/npu_ryzenai.py.",
"masked": false,
"extra": {
"source": "wsl-interop",
"probe_route": "ryzenai-ep-windows",
"host_pool_bytes": 33184985088,
"host_pool_available_bytes": 29899563008,
"worker_route": "ort-vitisai",
"worker_interpreter": "/mnt/c/Users/zhout/npu-ep/Scripts/python.exe",
"routes": [
{
"name": "ort-vitisai",
"interpreter": "/mnt/c/Users/zhout/npu-ep/Scripts/python.exe",
"worker": "/home/zhout/project/edge_infer/vllm-omni/vllm_omni/edge/local/external/worker_ort.py",
"ep": "vitisai",
"is_windows": true,
"available": true,
"reason": "",
"extra": null
}
],
"executes": "exported graphs, not checkpoints",
"dedicated_vram_bytes": 0
}
},
"route": {
"name": "ort-vitisai",
"interpreter": "/mnt/c/Users/zhout/npu-ep/Scripts/python.exe",
"worker": "/home/zhout/project/edge_infer/vllm-omni/vllm_omni/edge/local/external/worker_ort.py",
"ep": "vitisai",
"is_windows": true,
"available": true,
"reason": "",
"extra": null
},
"reservations": [
{
"pool": "host_ram",
"purpose": "graph weights",
"bytes": 464117283,
"lifetime": "session",
"reclaimable": "no",
"evidence": "D",
"note": "the exported file, onnx:a16w8, sha 215746bbfece",
"actual_upper_bound_bytes": null
},
{
"pool": "host_ram",
"purpose": "worker runtime",
"bytes": 335544320,
"lifetime": "session",
"reclaimable": "on_release",
"evidence": "E",
"note": "interpreter plus execution provider in the worker process; measured 270 MiB for a VitisAI session on a 2 MiB graph and 369 MiB for a DirectML session on the 27B vision tower. NOTE: on an integrated GPU the device allocations come out of this same system RAM and do not appear in the worker's working set, so the measured figure is a lower bound for this pool, not a total",
"actual_upper_bound_bytes": null
},
{
"pool": "host_ram",
"purpose": "worker workspace",
"bytes": 268435456,
"lifetime": "request",
"reclaimable": "on_release",
"evidence": "E",
"note": "activations and EP scratch; not separable by any counter here",
"actual_upper_bound_bytes": null
},
{
"pool": "host_ram",
"purpose": "external reserve",
"bytes": 1073741824,
"lifetime": "session",
"reclaimable": "no",
"evidence": "E",
"note": "host RAM this engine does not control; the Windows side included",
"actual_upper_bound_bytes": null
}
],
"refusals": [
{
"code": "execution_provider_declined_graph",
"device_id": "npu:amd",
"message": "vitisai took 0 of 3246 nodes (0%, below the 30% required); the split was CPUExecutionProvider=3246",
"remedy": "the graph is not in a shape XDNA2 partitions. Check, in this order: the quantization is A16W8 (QUInt16 activations, QInt8 weights) at opset >= 21; the EP loaded is onnxruntime_vitisai_ep.dll and not the RyzenAI *Light* provider beside it, which registers cleanly and claims zero nodes from every graph; and that the graph is not mostly requantization, since the partitioner leaves dequantize nodes on the CPU by its own account. Running it anyway would be a CPU fallback reported as NPU execution."
}
],
"min_fraction_on_target": 0.3,
"budget_bytes": 2141838883,
"admitted": true,
"report": {
"ep": "vitisai",
"graph_path": "/tmp/claude-1000/-home-zhout-project-edge-infer/e1528a86-4037-4e80-b83f-3a2f6cd1e24f/scratchpad/tower_npu/tower_a16w8.onnx",
"session_providers": [
"vitisai",
"CPUExecutionProvider"
],
"available_providers": [
"AzureExecutionProvider",
"CPUExecutionProvider",
"vitisai"
],
"node_counts": {
"CPUExecutionProvider": 3246
},
"total_nodes": 3246,
"target_nodes": 0,
"fraction_on_target": 0.0,
"session_create_s": 75.55920579998929,
"warmup_s": 2.251566899998579,
"rss_bytes": 931209216,
"inputs": [
{
"name": "patches",
"type": "tensor(float)",
"shape": [
784,
1536
]
}
],
"outputs": [
{
"name": "embeds",
"type": "tensor(float)",
"shape": [
196,
5120
]
}
],
"profile_path": "\\\\wsl.localhost\\Ubuntu\\tmp\\claude-1000\\-home-zhout-project-edge-infer\\e1528a86-4037-4e80-b83f-3a2f6cd1e24f\\scratchpad\\qwen3_5_vision_tower_448_a16w8__2026-09-16_09-44-15_178.json",
"ep_directory": "C:\\Program Files\\WindowsApps\\WindowsWorkload.EP.AMD.VitisAI.Framework.1.8_1.8.63.0_x64__8wekyb3d8bbwe\\ExecutionProvider",
"requested_provider_missing": "",
"fallback_note": "",
"onnxruntime": "1.30.0",
"note": ""
}
}
}
@@ -0,0 +1,21 @@
{
"platform": "Windows-11-10.0.26200-SP0",
"config": {
"model": "\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Qwen3.8-27B-NVFP4",
"language_model_only": true,
"max_model_len": 512,
"max_num_seqs": 1,
"max_num_batched_tokens": 128,
"enforce_eager": true,
"gpu_memory_utilization": 0.8,
"cpu_offload_gb": 2,
"dtype": "bfloat16",
"stage_init_timeout": 120
},
"status": "failed",
"scope": "public Omni, short text only; explicit 2 GiB native offload",
"start": 1790055532.5138774,
"error": "ValueError(\"Model '\\\\\\\\\\\\\\\\wsl.localhost\\\\\\\\Ubuntu\\\\\\\\home\\\\\\\\zhout\\\\\\\\project\\\\\\\\edge_infer\\\\\\\\models\\\\\\\\Qwen3.8-27B-NVFP4' did not resolve to a registered Omni pipeline or a supported diffusion model.\")",
"traceback": "Traceback (most recent call last):\n File \"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\analysis\\experiments\\model_device_matrix_20260922\\qwen_omni_probe.py\", line 30, in main\n engine = Omni(**config)\n ^^^^^^^^^^^^^^\n File \"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\vllm_omni\\entrypoints\\omni_base.py\", line 223, in __init__\n self.engine = AsyncOmniEngine(\n ^^^^^^^^^^^^^^^^\n File \"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\vllm_omni\\engine\\async_omni_engine.py\", line 228, in __init__\n self.config_path, self.stage_configs = self._resolve_stage_configs(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\vllm_omni\\engine\\async_omni_engine.py\", line 1101, in _resolve_stage_configs\n load_and_resolve_stage_configs(\n File \"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\vllm_omni\\engine\\async_omni_engine.py\", line 106, in load_and_resolve_stage_configs\n return resolve_omni_config(\n ^^^^^^^^^^^^^^^^^^^^\n File \"\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\vllm-omni-edge\\vllm_omni\\config\\resolver.py\", line 254, in resolve_omni_config\n raise ValueError(\nValueError: Model '\\\\\\\\wsl.localhost\\\\Ubuntu\\\\home\\\\zhout\\\\project\\\\edge_infer\\\\models\\\\Qwen3.8-27B-NVFP4' did not resolve to a registered Omni pipeline or a supported diffusion model.\n",
"end": 1790055533.0640798
}
@@ -0,0 +1,21 @@
{
"platform": "Linux-6.18.33.2-microsoft-standard-WSL2-x86_64-with-glibc2.43",
"config": {
"model": "/home/zhout/project/edge_infer/models/Qwen3.8-27B-NVFP4",
"language_model_only": true,
"max_model_len": 512,
"max_num_seqs": 1,
"max_num_batched_tokens": 128,
"enforce_eager": true,
"gpu_memory_utilization": 0.8,
"cpu_offload_gb": 2,
"dtype": "bfloat16",
"stage_init_timeout": 120
},
"status": "failed",
"scope": "public Omni, short text only; explicit 2 GiB native offload",
"start": 1790055472.1485431,
"error": "ValueError(\"Model '/home/zhout/project/edge_infer/models/Qwen3.8-27B-NVFP4' did not resolve to a registered Omni pipeline or a supported diffusion model.\")",
"traceback": "Traceback (most recent call last):\n File \"/home/zhout/project/edge_infer/analysis/experiments/model_device_matrix_20260922/qwen_omni_probe.py\", line 30, in main\n engine = Omni(**config)\n ^^^^^^^^^^^^^^\n File \"/home/zhout/project/edge_infer/vllm-omni-edge/vllm_omni/entrypoints/omni_base.py\", line 223, in __init__\n self.engine = AsyncOmniEngine(\n ^^^^^^^^^^^^^^^^\n File \"/home/zhout/project/edge_infer/vllm-omni-edge/vllm_omni/engine/async_omni_engine.py\", line 228, in __init__\n self.config_path, self.stage_configs = self._resolve_stage_configs(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/home/zhout/project/edge_infer/vllm-omni-edge/vllm_omni/engine/async_omni_engine.py\", line 1101, in _resolve_stage_configs\n load_and_resolve_stage_configs(\n File \"/home/zhout/project/edge_infer/vllm-omni-edge/vllm_omni/engine/async_omni_engine.py\", line 106, in load_and_resolve_stage_configs\n return resolve_omni_config(\n ^^^^^^^^^^^^^^^^^^^^\n File \"/home/zhout/project/edge_infer/vllm-omni-edge/vllm_omni/config/resolver.py\", line 254, in resolve_omni_config\n raise ValueError(\nValueError: Model '/home/zhout/project/edge_infer/models/Qwen3.8-27B-NVFP4' did not resolve to a registered Omni pipeline or a supported diffusion model.\n",
"end": 1790055473.065098
}
@@ -0,0 +1,185 @@
/home/zhout/project/edge_infer/vllm-omni-edge/vllm_omni/version.py:55: RuntimeWarning: vLLM and vLLM-Omni appear to have mismatched major/minor versions:
--> vLLM-Omni version 0.29.0rc2.dev71+g00510ce38.d20260922
--> vLLM version 0.28.0
This will likely cause compatibility issues.
warn_if_misaligned_vllm_version()
W0922 13:34:23.252000 629687 .venvs/omni-cpu/lib/python3.12/site-packages/torch/utils/_pytree.py:630] <enum 'KernelPreference'> is an Enum subclass and is now natively supported by torch.compile as an opaque value type. Calling register_constant() on Enum subclasses is deprecated and will be an error in a future release.
W0922 13:34:23.278000 629687 .venvs/omni-cpu/lib/python3.12/site-packages/torch/utils/_pytree.py:630] <enum 'ScaleCalculationMode'> is an Enum subclass and is now natively supported by torch.compile as an opaque value type. Calling register_constant() on Enum subclasses is deprecated and will be an error in a future release.
INFO 09-22 13:34:24 [importing.py:53] Triton is installed but 0 active driver(s) found (expected 1). Disabling Triton to prevent runtime errors.
WARNING 09-22 13:34:24 [importing.py:65] Triton is installed, but doesn't include CPU backend. Disabling Triton.
INFO 09-22 13:34:24 [importing.py:88] Triton not installed or not compatible; certain GPU-related functions will not be available.
INFO 09-22 13:34:25 [patch.py:259] NVFP4 W4A4 weight_scale NaN-clamp: installed.
INFO 09-22 13:34:25 [patch.py:510] inductor factorable-divisibility patch: installed.
INFO 09-22 13:34:25 [patch.py:640] CPU AOT compile-cache load shim installed: compiled models are reused across engine starts instead of being recompiled.
INFO 09-22 13:34:25 [patch.py:750] CPU weight-load memory release installed (set VLLM_OMNI_CPU_RELEASE_MEMORY=0 to disable).
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
========================================================================
capability-masked startup (--mask gpu_discrete): the no-NVIDIA class
========================================================================
ADMITTED on cpu (AMD Ryzen AI 9 HX 370 w/ Radeon 890M) via vllm:cpu
artifact e25985ca3f2a44a2 compressed-tensors:int8 1.84GiB
budget 6.55GiB of 27.96GiB host_ram (available)
weights 1887 MiB host_ram session_weights D 1 safetensors shard(s), on-disk size
kv_cache 280 MiB host_ram session E flat budget at 1x context; 96 MiB if the backend accounts 21 sliding layers separately
activations 96 MiB host_ram request E 2048-token prefill chunk x 12 live tensors
backend_workspace 512 MiB host_ram session E attention scratch, driver/allocator context
load_transient 1887 MiB host_ram load E freed once the weights are resident; peaks with the largest shard
external_reserve 1024 MiB host_ram session E memory this engine does not own on a shared pool
safety_margin 1024 MiB host_ram session E fragmentation and allocator slack
kv 280 MiB flat; 96 MiB if the backend accounts 21 sliding@512 layers separately (2.91x)
not used: [no_exported_graph] npu:amd: npu:amd executes exported graphs (['onnx:a16w8']), not checkpoints, so a whole autoregressive text session cannot be placed on it
not used: [no_exported_graph] gpu_integrated:amd: gpu_integrated:amd executes exported graphs (['onnx:fp16', 'onnx:fp32']), not checkpoints, so a whole autoregressive text session cannot be placed on it
========================================================================
device-visible startup
========================================================================
ADMITTED on cpu (AMD Ryzen AI 9 HX 370 w/ Radeon 890M) via vllm:cpu
artifact e25985ca3f2a44a2 compressed-tensors:int8 1.84GiB
budget 6.55GiB of 27.99GiB host_ram (available)
weights 1887 MiB host_ram session_weights D 1 safetensors shard(s), on-disk size
kv_cache 280 MiB host_ram session E flat budget at 1x context; 96 MiB if the backend accounts 21 sliding layers separately
activations 96 MiB host_ram request E 2048-token prefill chunk x 12 live tensors
backend_workspace 512 MiB host_ram session E attention scratch, driver/allocator context
load_transient 1887 MiB host_ram load E freed once the weights are resident; peaks with the largest shard
external_reserve 1024 MiB host_ram session E memory this engine does not own on a shared pool
safety_margin 1024 MiB host_ram session E fragmentation and allocator slack
kv 280 MiB flat; 96 MiB if the backend accounts 21 sliding@512 layers separately (2.91x)
not used: [no_exported_graph] npu:amd: npu:amd executes exported graphs (['onnx:a16w8']), not checkpoints, so a whole autoregressive text session cannot be placed on it
not used: [no_exported_graph] gpu_integrated:amd: gpu_integrated:amd executes exported graphs (['onnx:fp16', 'onnx:fp32']), not checkpoints, so a whole autoregressive text session cannot be placed on it
INFO 09-22 13:34:27 [engine.py:392] [local] loading /home/zhout/project/edge_infer/models/Spark-X2.5-1.7B-int8 on cpu with {'max_model_len': 4096, 'max_num_seqs': 1, 'max_num_batched_tokens': 2048, 'enforce_eager': True, 'enable_prefix_caching': False, 'gpu_memory_utilization': 0.24, 'kv_cache_memory_bytes': 293601280, 'dtype': 'bfloat16'}
INFO 09-22 13:34:27 [omni_base.py:216] [AsyncOmni] Initializing with model /home/zhout/project/edge_infer/models/Spark-X2.5-1.7B-int8
INFO 09-22 13:34:27 [async_omni_engine.py:172] [AsyncOmniEngine] Initializing with model /home/zhout/project/edge_infer/models/Spark-X2.5-1.7B-int8
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
INFO 09-22 13:34:27 [async_omni_engine.py:290] [AsyncOmniEngine] Launching Orchestrator thread with 1 stages
INFO 09-22 13:34:27 [stage_init_utils.py:768] [stage_init] Set VLLM_WORKER_MULTIPROC_METHOD=spawn
WARNING 09-22 13:34:27 [utils.py:501] Dropping unknown OmniEngineArgs field 'inline_diffusion' (not declared on the dataclass)
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
INFO 09-22 13:34:27 [model.py:672] Resolved architecture: Spark2_5ForCausalLM
INFO 09-22 13:34:27 [model.py:1965] Using max model len 4096
INFO 09-22 13:34:28 [scheduler.py:242] Chunked prefill is enabled with max_num_batched_tokens=2048.
WARNING 09-22 13:34:28 [vllm.py:1285] Enforce eager set, disabling torch.compile and CUDAGraphs. This is equivalent to setting -cc.mode=none -cc.cudagraph_mode=none
WARNING 09-22 13:34:28 [vllm.py:1354] Inductor compilation was disabled by user settings, optimizations settings that are only active during inductor compilation will be ignored.
INFO 09-22 13:34:28 [kernel.py:308] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native'])
INFO 09-22 13:34:28 [patch.py:692] Restored explicit kv_cache_memory_bytes=293601280 (0.273 GiB); VLLM_CPU_KVCACHE_SPACE would have overridden it.
WARNING 09-22 13:34:28 [vllm.py:652] Model Runner V2 requires Triton; using the V1 model runner instead.
INFO 09-22 13:34:28 [compilation.py:329] Enabled custom fusions: norm_quant, act_quant
WARNING 09-22 13:34:28 [stage_runtime.py:778] [stage_init] Stage-0 replica 0 physical devices None are not integer GPU ids; all serial LLM replicas will share one init group
/home/zhout/project/edge_infer/vllm-omni-edge/vllm_omni/version.py:55: RuntimeWarning: vLLM and vLLM-Omni appear to have mismatched major/minor versions:
--> vLLM-Omni version 0.29.0rc2.dev71+g00510ce38.d20260922
--> vLLM version 0.28.0
This will likely cause compatibility issues.
warn_if_misaligned_vllm_version()
W0922 13:34:33.190000 629819 .venvs/omni-cpu/lib/python3.12/site-packages/torch/utils/_pytree.py:630] <enum 'KernelPreference'> is an Enum subclass and is now natively supported by torch.compile as an opaque value type. Calling register_constant() on Enum subclasses is deprecated and will be an error in a future release.
W0922 13:34:33.225000 629819 .venvs/omni-cpu/lib/python3.12/site-packages/torch/utils/_pytree.py:630] <enum 'ScaleCalculationMode'> is an Enum subclass and is now natively supported by torch.compile as an opaque value type. Calling register_constant() on Enum subclasses is deprecated and will be an error in a future release.
INFO 09-22 13:34:34 [importing.py:53] Triton is installed but 0 active driver(s) found (expected 1). Disabling Triton to prevent runtime errors.
WARNING 09-22 13:34:34 [importing.py:65] Triton is installed, but doesn't include CPU backend. Disabling Triton.
INFO 09-22 13:34:34 [importing.py:88] Triton not installed or not compatible; certain GPU-related functions will not be available.
INFO 09-22 13:34:35 [patch.py:259] NVFP4 W4A4 weight_scale NaN-clamp: installed.
INFO 09-22 13:34:35 [patch.py:510] inductor factorable-divisibility patch: installed.
INFO 09-22 13:34:35 [patch.py:640] CPU AOT compile-cache load shim installed: compiled models are reused across engine starts instead of being recompiled.
INFO 09-22 13:34:35 [patch.py:750] CPU weight-load memory release installed (set VLLM_OMNI_CPU_RELEASE_MEMORY=0 to disable).
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:34:36 [core.py:122] Initializing a V1 LLM engine (v0.28.0) with config: model='/home/zhout/project/edge_infer/models/Spark-X2.5-1.7B-int8', speculative_config=None, tokenizer='/home/zhout/project/edge_infer/models/Spark-X2.5-1.7B-int8', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=False, dtype=torch.bfloat16, max_seq_len=4096, download_dir=None, load_format=auto, tensor_parallel_size=1, pipeline_parallel_size=1, data_parallel_size=1, decode_context_parallel_size=1, dcp_comm_backend=ag_rs, disable_custom_all_reduce=True, quantization=compressed-tensors, quantization_config=None, enforce_eager=True, enable_return_routed_experts=False, kv_cache_dtype=auto, device_config=cpu, structured_outputs_config=StructuredOutputsConfig(backend='auto', disable_any_whitespace=False, disable_additional_properties=False, reasoning_parser='', reasoning_parser_plugin='', enable_in_reasoning=False), observability_config=ObservabilityConfig(show_hidden_metrics_for_version=None, otlp_traces_endpoint=None, collect_detailed_traces=None, kv_cache_metrics=False, kv_cache_metrics_sample=0.01, cudagraph_metrics=False, enable_layerwise_nvtx_tracing=False, enable_mfu_metrics=False, enable_mm_processor_stats=False, enable_logging_iteration_details=False, jit_monitor_mode='warn', jit_monitor_verbose=False), seed=0, served_model_name=/home/zhout/project/edge_infer/models/Spark-X2.5-1.7B-int8, enable_prefix_caching=False, enable_chunked_prefill=True, pooler_config=None, compilation_config={'mode': <CompilationMode.NONE: 0>, 'debug_dump_path': None, 'cache_dir': '', 'compile_cache_save_format': 'binary', 'backend': 'inductor', 'custom_ops': ['all'], 'ir_enable_torch_wrap': False, 'splitting_ops': [], 'compile_mm_encoder': False, 'cudagraph_mm_encoder': False, 'encoder_cudagraph_token_budgets': [], 'encoder_cudagraph_max_vision_items_per_batch': 0, 'encoder_cudagraph_max_frames_per_batch': None, 'compile_sizes': None, 'compile_ranges_endpoints': [2048], 'inductor_compile_config': {'enable_auto_functionalized_v2': False}, 'inductor_passes': {}, 'cudagraph_mode': <CUDAGraphMode.NONE: 0>, 'cudagraph_num_of_warmups': 0, 'cudagraph_capture_sizes': [], 'cudagraph_copy_inputs': False, 'cudagraph_specialize_lora': True, 'use_inductor_graph_partition': False, 'pass_config': {'fuse_norm_quant': True, 'fuse_act_quant': True, 'fuse_attn_quant': False, 'enable_sp': False, 'fuse_gemm_comms': False, 'fuse_allreduce_rms': False, 'enable_qk_norm_rope_fusion': False, 'fuse_rope_kvcache_cat_mla': False, 'fuse_act_padding': False, 'fuse_qk_norm_rope_kvcache': False}, 'max_cudagraph_capture_size': None, 'dynamic_shapes_config': {'type': <DynamicShapesType.BACKED: 'backed'>, 'evaluate_guards': False, 'assume_32_bit_indexing': False}, 'local_cache_dir': None, 'fast_moe_cold_start': False, 'static_all_moe_layers': []}, kernel_config=KernelConfig(ir_op_priority=IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native']), enable_flashinfer_autotune=True, enable_cutedsl_warmup=True, enable_jit_warmup=True, enable_bf16x3_router_gemm=False, moe_backend='auto', linear_backend='auto')
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:34:36 [multiproc_executor.py:150] DP group leader: node_rank=0, node_rank_within_dp=0, master_addr=127.0.0.1, mq_connect_ip=172.21.141.90 (local), world_size=1, local_world_size=1
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:34:36 [ompmultiprocessing.py:185] OpenMP thread binding info:
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:34:36 [ompmultiprocessing.py:185] VLLM_CPU_OMP_THREADS_BIND='auto', auto_setup=True, skip_setup=False
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:34:36 [ompmultiprocessing.py:185] local_world_size=1, reserve_cpu_num=1
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:34:36 [ompmultiprocessing.py:185] local_rank=0, core ids=[1, 3, 5, 7, 9, 11, 13, 15, 17, 19, 21]
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:34:36 [ompmultiprocessing.py:185] reserved_cpus=[23]
W0922 13:34:40.073000 629853 .venvs/omni-cpu/lib/python3.12/site-packages/torch/utils/_pytree.py:630] <enum 'KernelPreference'> is an Enum subclass and is now natively supported by torch.compile as an opaque value type. Calling register_constant() on Enum subclasses is deprecated and will be an error in a future release.
W0922 13:34:40.099000 629853 .venvs/omni-cpu/lib/python3.12/site-packages/torch/utils/_pytree.py:630] <enum 'ScaleCalculationMode'> is an Enum subclass and is now natively supported by torch.compile as an opaque value type. Calling register_constant() on Enum subclasses is deprecated and will be an error in a future release.
INFO 09-22 13:34:41 [importing.py:53] Triton is installed but 0 active driver(s) found (expected 1). Disabling Triton to prevent runtime errors.
WARNING 09-22 13:34:41 [importing.py:65] Triton is installed, but doesn't include CPU backend. Disabling Triton.
INFO 09-22 13:34:41 [importing.py:88] Triton not installed or not compatible; certain GPU-related functions will not be available.
/home/zhout/project/edge_infer/vllm-omni-edge/vllm_omni/version.py:55: RuntimeWarning: vLLM and vLLM-Omni appear to have mismatched major/minor versions:
--> vLLM-Omni version 0.29.0rc2.dev71+g00510ce38.d20260922
--> vLLM version 0.28.0
This will likely cause compatibility issues.
warn_if_misaligned_vllm_version()
INFO 09-22 13:34:42 [patch.py:259] NVFP4 W4A4 weight_scale NaN-clamp: installed.
INFO 09-22 13:34:42 [patch.py:510] inductor factorable-divisibility patch: installed.
INFO 09-22 13:34:42 [patch.py:640] CPU AOT compile-cache load shim installed: compiled models are reused across engine starts instead of being recompiled.
INFO 09-22 13:34:42 [patch.py:750] CPU weight-load memory release installed (set VLLM_OMNI_CPU_RELEASE_MEMORY=0 to disable).
[W922 13:34:42.576317158 utils.cpp:68] Warning: NUMA binding: Using MEMBIND policy for memory allocation on the NUMA nodes (0). Memory allocations will be strictly bound to these NUMA nodes. (function init_cpu_memory_env)
WARNING 09-22 13:34:42 [vllm.py:652] Model Runner V2 requires Triton; using the V1 model runner instead.
(Worker pid=629853) WARNING 09-22 13:34:42 [cpu_worker.py:127] libiomp is not found in LD_PRELOAD. For best performance, please follow the section `set LD_PRELOAD` in https://docs.vllm.ai/en/latest/getting_started/installation/cpu/ to setup required pre-loaded libraries.
(Worker pid=629853) INFO 09-22 13:34:42 [parallel_state.py:1638] world_size=1 rank=0 local_rank=0 distributed_init_method=file:///tmp/vllm_dist_18e922052e6e4cc9a96df0c8f74a41a3 backend=gloo
(Worker pid=629853) INFO 09-22 13:34:43 [parallel_state.py:1982] rank 0 in world size 1 is assigned as DP rank 0, PP rank 0, PCP rank 0, TP rank 0, EP rank N/A, EPLB rank N/A
(Worker pid=629853) INFO 09-22 13:34:43 [cpu_model_runner.py:131] Starting to load model /home/zhout/project/edge_infer/models/Spark-X2.5-1.7B-int8...
(Worker pid=629853) INFO 09-22 13:34:43 [__init__.py:755] Selected CPUInt8ScaledMMLinearKernel for CompressedTensorsW8A8Int8
(Worker pid=629853) INFO 09-22 13:34:43 [selector.py:217] Using HND KV cache layout for CPU_ATTN backend.
(Worker pid=629853) INFO 09-22 13:34:43 [weight_utils.py:858] Filesystem type for checkpoints: EXT4. Checkpoint size: 1.84 GiB. Available RAM: 26.90 GiB.
(Worker pid=629853) INFO 09-22 13:34:43 [weight_utils.py:881] Auto-prefetch is disabled because the filesystem (EXT4) is not a recognized network FS (NFS/Lustre). If you want to force prefetching, start vLLM with --safetensors-load-strategy=prefetch.
(Worker pid=629853) ␍Loading safetensors checkpoint shards: 0% Completed | 0/1 [00:00<?, ?it/s]
(Worker pid=629853) ␍Loading safetensors checkpoint shards: 100% Completed | 1/1 [00:01<00:00, 1.20s/it]
(Worker pid=629853) ␍Loading safetensors checkpoint shards: 100% Completed | 1/1 [00:01<00:00, 1.20s/it]
(Worker pid=629853)
(Worker pid=629853) INFO 09-22 13:34:44 [default_loader.py:430] Loading weights took 1.22 seconds
(Worker pid=629853) INFO 09-22 13:34:45 [memory.py:91] Released 104 MiB after weight load (anonymous RSS 3570 -> 3466 MiB) via ['libc.so.6:malloc_trim', 'libtcmalloc_minimal.so.4:MallocExtension_ReleaseFreeMemory']
(StageEngineCoreProc_stage0_replica0 pid=629819) WARNING 09-22 13:34:45 [torch_utils.py:250] OMP_NUM_THREADS=8 is set; leaving Torch threads at 8 for serving. Multi-threaded torch CPU ops during serving can degrade performance through spin-wait contention and cgroup CPU-quota throttling.
(Worker pid=629853) INFO 09-22 13:34:45 [cpu_worker.py:255] Explicitly set (0.27/30.91) GiB for KV cache on node 0.
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:34:45 [kv_cache_utils.py:1869] GPU KV cache size: 6,898 tokens, Maximum concurrency for 4,096 tokens per request: 1.68x
(Worker pid=629853) INFO 09-22 13:34:45 [memory.py:91] Released -0 MiB after warm-up (anonymous RSS 3746 -> 3746 MiB) via ['libc.so.6:malloc_trim', 'libtcmalloc_minimal.so.4:MallocExtension_ReleaseFreeMemory']
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:34:45 [core.py:354] init engine (profile, create kv cache, warmup model) took 0.06 s
(StageEngineCoreProc_stage0_replica0 pid=629819) [transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
(StageEngineCoreProc_stage0_replica0 pid=629819) [transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
(StageEngineCoreProc_stage0_replica0 pid=629819) [transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
(StageEngineCoreProc_stage0_replica0 pid=629819) WARNING 09-22 13:34:46 [scheduler.py:182] Using custom scheduler class vllm_omni.core.sched.omni_ar_scheduler.OmniARAsyncScheduler. This scheduler interface is not public and compatibility may not be maintained. If you have subclassed Scheduler instead of AsyncScheduler, you will see degraded performance due to async scheduling being disabled.
(StageEngineCoreProc_stage0_replica0 pid=629819) WARNING 09-22 13:34:46 [vllm.py:652] Model Runner V2 requires Triton; using the V1 model runner instead.
(StageEngineCoreProc_stage0_replica0 pid=629819) WARNING 09-22 13:34:46 [vllm.py:1285] Enforce eager set, disabling torch.compile and CUDAGraphs. This is equivalent to setting -cc.mode=none -cc.cudagraph_mode=none
(StageEngineCoreProc_stage0_replica0 pid=629819) WARNING 09-22 13:34:46 [vllm.py:1354] Inductor compilation was disabled by user settings, optimizations settings that are only active during inductor compilation will be ignored.
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:34:46 [kernel.py:308] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native'])
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:34:46 [patch.py:692] Restored explicit kv_cache_memory_bytes=293601280 (0.273 GiB); VLLM_CPU_KVCACHE_SPACE would have overridden it.
INFO 09-22 13:34:46 [stage_runtime.py:943] [StageRuntime] Stage 0 engine startup completed
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:34:46 [compilation.py:329] Enabled custom fusions: norm_quant, act_quant
INFO 09-22 13:34:46 [stage_engine_core_client.py:159] [StageEngineCoreClient] stage-0 [rep-0] initializing EngineCore
INFO 09-22 13:34:46 [stage_engine_core_client.py:215] [StageEngineCoreClient] stage-0 [rep-0] EngineCore running
INFO 09-22 13:34:46 [stage_runtime.py:958] [StageRuntime] Stage 0 initialized
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
INFO 09-22 13:34:49 [orchestrator.py:604] [Orchestrator] Starting event loop
INFO 09-22 13:34:49 [async_omni_engine.py:323] [AsyncOmniEngine] Orchestrator ready with 1 stages
INFO 09-22 13:34:49 [omni_base.py:235] [AsyncOmni] AsyncOmniEngine initialized in 21.30 seconds
INFO 09-22 13:34:49 [omni_base.py:255] [AsyncOmni] Initialized with 1 stages for model /home/zhout/project/edge_infer/models/Spark-X2.5-1.7B-int8
loaded in 21.30 s
WARNING 09-22 13:34:49 [input_processor.py:296] Passing raw prompts to InputProcessor is deprecated and will be removed in v0.18. You should instead pass the outputs of Renderer.render_cmpl() or Renderer.render_chat().
chat_short in=28 out=128 ttft=0.127s decode=16.41 tok/s
chat_tools in=137 out=128 ttft=0.268s decode=16.29 tok/s
chat_long in=2465 out=128 ttft=4.257s decode=15.51 tok/s
plain_0 in=5 out=128 ttft=0.067s decode=16.66 tok/s
plain_1 in=13 out=128 ttft=0.073s decode=16.43 tok/s
plain_2 in=18 out=128 ttft=0.079s decode=16.38 tok/s
plain_3 in=8 out=128 ttft=0.064s decode=15.84 tok/s
plain_4 in=7 out=128 ttft=0.068s decode=16.78 tok/s
plain_5 in=7 out=128 ttft=0.059s decode=16.51 tok/s
plain_6 in=3 out=128 ttft=0.070s decode=16.03 tok/s
plain_7 in=9 out=128 ttft=0.075s decode=16.22 tok/s
plain_8 in=9 out=128 ttft=0.065s decode=16.48 tok/s
INFO 09-22 13:36:28 [orchestrator.py:917] [Orchestrator] Aborted request(s) ['09e230fd09a74804-12-bce4064d']
INFO 09-22 13:36:28 [orchestrator.py:917] [Orchestrator] Aborted request(s) ['09e230fd09a74804-12-bce4064d']
INFO 09-22 13:36:28 [async_omni.py:665] [AsyncOmni] Request 09e230fd09a74804-12-bce4064d aborted.
cancel: aborted=True after 8 events, leaked=0
INFO 09-22 13:36:29 [omni_base.py:781] [AsyncOmni] Shutting down
INFO 09-22 13:36:29 [async_omni_engine.py:1807] [AsyncOmniEngine] Shutting down Orchestrator
INFO 09-22 13:36:29 [orchestrator.py:705] [Orchestrator] Received shutdown signal
INFO 09-22 13:36:29 [orchestrator.py:3092] [Orchestrator] Shutting down all 1 client(s)
INFO 09-22 13:36:29 [core_client.py:689] [shutdown] MPClient: start timeout=default
INFO 09-22 13:36:29 [core_client.py:691] [shutdown] MPClient: stopping engine manager
INFO 09-22 13:36:29 [utils.py:615] [shutdown] Process manager: send sigterm to process StageEngineCoreProc_stage0_replica0
(Worker pid=629853) INFO 09-22 13:36:29 [multiproc_executor.py:833] Parent process exited, terminating worker queues
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:36:29 [multiproc_executor.py:469] [shutdown] Executor: waiting for worker exit count=1
(StageEngineCoreProc_stage0_replica0 pid=629819) INFO 09-22 13:36:31 [multiproc_executor.py:476] [shutdown] Executor: all workers exited gracefully
INFO 09-22 13:36:34 [core_client.py:693] [shutdown] MPClient: engine manager stopped
INFO 09-22 13:36:34 [core_client.py:694] [shutdown] MPClient: cleaning up background resources
INFO 09-22 13:36:34 [core_client.py:696] [shutdown] MPClient: complete
INFO 09-22 13:36:34 [stage_pool.py:1354] [StagePool] Stage 0 replica 0 shut down
acceptance: PASS ({'prompts': 12, 'min_tokens_required': 128, 'all_reached_min': True, 'cancel_clean': True})
wrote /home/zhout/project/edge_infer/analysis/experiments/model_device_matrix_20260922/spark-cpu-current.json
@@ -0,0 +1,149 @@
INFO 09-22 11:56:02 [patch.py:259] NVFP4 W4A4 weight_scale NaN-clamp: installed.
INFO 09-22 11:56:02 [patch.py:510] inductor factorable-divisibility patch: installed.
INFO 09-22 11:56:02 [patch.py:583] [cumem-cuda] CuMemAllocator._python_free_callback patched: asleep guard extended to all platforms.
INFO 09-22 11:56:08 [scheduler.py:277] Chunked prefill is enabled with max_num_batched_tokens=2048.
INFO 09-22 11:56:08 [kernel.py:369] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['native'], fused_add_rms_norm=['native'])
--- Running test: test_the_masked_startup_reaches_a_decision
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
.--- Running test: test_a_refused_plan_cannot_be_started
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
.--- Running test: test_int8_is_refused_on_cuda_and_admitted_on_cpu
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
.INFO 09-22 11:56:26 [engine.py:392] [local] loading \\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\models\Spark-X2.5-4B on cuda:0 with {'max_model_len': 4096, 'max_num_seqs': 1, 'max_num_batched_tokens': 2048, 'enforce_eager': True, 'enable_prefix_caching': False, 'gpu_memory_utilization': 0.53, 'kv_cache_memory_bytes': 754974720, 'dtype': 'bfloat16'}
INFO 09-22 11:56:26 [omni_base.py:216] [AsyncOmni] Initializing with model \\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\models\Spark-X2.5-4B
INFO 09-22 11:56:26 [async_omni_engine.py:172] [AsyncOmniEngine] Initializing with model \\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\models\Spark-X2.5-4B
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
INFO 09-22 11:56:26 [async_omni_engine.py:290] [AsyncOmniEngine] Launching Orchestrator thread with 1 stages
WARNING 09-22 11:56:27 [utils.py:501] Dropping unknown OmniEngineArgs field 'inline_diffusion' (not declared on the dataclass)
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
INFO 09-22 11:56:27 [model.py:684] Resolved architecture: Spark2_5ForCausalLM
INFO 09-22 11:56:27 [model.py:2021] Using max model len 4096
WARNING 09-22 11:56:27 [vllm.py:1371] Enforce eager set, disabling torch.compile and CUDAGraphs. This is equivalent to setting -cc.mode=none -cc.cudagraph_mode=none
WARNING 09-22 11:56:27 [vllm.py:1406] Inductor compilation was disabled by user settings, optimizations settings that are only active during inductor compilation will be ignored.
INFO 09-22 11:56:27 [kernel.py:369] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['vllm_c', 'native'], fused_add_rms_norm=['vllm_c', 'native'])
INFO 09-22 11:56:27 [vllm.py:1585] Cudagraph is disabled under eager mode
INFO 09-22 11:56:27 [compilation.py:329] Enabled custom fusions: norm_quant, act_quant
WARNING 09-22 11:56:27 [stage_runtime.py:765] [stage_init] Stage-0 replica 0 physical devices None are not integer GPU ids; all serial LLM replicas will share one init group
INFO 09-22 11:56:45 [patch.py:259] NVFP4 W4A4 weight_scale NaN-clamp: installed.
INFO 09-22 11:56:45 [patch.py:510] inductor factorable-divisibility patch: installed.
INFO 09-22 11:56:45 [patch.py:583] [cumem-cuda] CuMemAllocator._python_free_callback patched: asleep guard extended to all platforms.
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:56:49 [core.py:123] Initializing a V1 LLM engine (v0.29.0) with config: model='\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Spark-X2.5-4B', speculative_config=None, tokenizer='\\\\wsl.localhost\\Ubuntu\\home\\zhout\\project\\edge_infer\\models\\Spark-X2.5-4B', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=False, dtype=torch.bfloat16, max_seq_len=4096, download_dir=None, load_format=auto, tensor_parallel_size=1, pipeline_parallel_size=1, data_parallel_size=1, decode_context_parallel_size=1, dcp_comm_backend=ag_rs, disable_custom_all_reduce=False, quantization=None, quantization_config=None, enforce_eager=True, enable_return_routed_experts=False, kv_cache_dtype=auto, device_config=cuda, structured_outputs_config=StructuredOutputsConfig(backend='auto', disable_any_whitespace=False, disable_additional_properties=False, reasoning_parser='', reasoning_parser_plugin='', enable_in_reasoning=False), observability_config=ObservabilityConfig(show_hidden_metrics_for_version=None, otlp_traces_endpoint=None, collect_detailed_traces=None, per_request_spec_decode_metrics='none', kv_cache_metrics=False, kv_cache_metrics_sample=0.01, cudagraph_metrics=False, enable_layerwise_nvtx_tracing=False, enable_mfu_metrics=False, enable_mm_processor_stats=False, enable_logging_iteration_details=False, jit_monitor_mode='warn', jit_monitor_verbose=False), seed=0, served_model_name=\\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\models\Spark-X2.5-4B, enable_prefix_caching=False, enable_chunked_prefill=True, pooler_config=None, compilation_config={'mode': <CompilationMode.NONE: 0>, 'debug_dump_path': None, 'cache_dir': '', 'compile_cache_save_format': 'binary', 'backend': 'inductor', 'custom_ops': ['all'], 'ir_enable_torch_wrap': False, 'splitting_ops': [], 'compile_mm_encoder': False, 'cudagraph_mm_encoder': False, 'encoder_cudagraph_token_budgets': [], 'encoder_cudagraph_max_vision_items_per_batch': 0, 'encoder_cudagraph_max_frames_per_batch': None, 'compile_sizes': [], 'compile_ranges_endpoints': [2048], 'inductor_compile_config': {'enable_auto_functionalized_v2': False, 'combo_kernels': True, 'benchmark_combo_kernel': True}, 'inductor_passes': {}, 'cudagraph_mode': <CUDAGraphMode.NONE: 0>, 'cudagraph_num_of_warmups': 0, 'cudagraph_capture_sizes': [], 'cudagraph_copy_inputs': False, 'cudagraph_specialize_lora': True, 'use_inductor_graph_partition': False, 'pass_config': {'fuse_norm_quant': True, 'fuse_act_quant': True, 'fuse_attn_quant': False, 'enable_sp': False, 'fuse_gemm_comms': False, 'fuse_allreduce_rms': False, 'enable_qk_norm_rope_fusion': False, 'fuse_rope_kvcache_cat_mla': False, 'fuse_act_padding': False, 'fuse_qk_norm_rope_kvcache': False}, 'max_cudagraph_capture_size': 0, 'dynamic_shapes_config': {'type': <DynamicShapesType.BACKED: 'backed'>, 'evaluate_guards': False, 'assume_32_bit_indexing': False}, 'local_cache_dir': None, 'fast_moe_cold_start': False, 'static_all_moe_layers': []}, kernel_config=KernelConfig(ir_op_priority=IrOpPriorityConfig(rms_norm=['vllm_c', 'native'], fused_add_rms_norm=['vllm_c', 'native']), enable_flashinfer_autotune=True, enable_cutedsl_warmup=True, enable_jit_warmup=True, enable_bf16x3_router_gemm=False, moe_backend='auto', linear_backend='auto')
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:56:50 [parallel_state.py:1775] world_size=1 rank=0 local_rank=0 distributed_init_method=file://C:\Users\zhout\AppData\Local\Temp/vllm_dist_cc490ec74fd54cbea88ba183b7556c4c backend=nccl
(StageEngineCoreProc_stage0_replica0 pid=13348) WARNING 09-22 11:56:50 [parallel_state.py:1788] Distributed backend nccl is not available; falling back to gloo.
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:56:51 [parallel_state.py:2119] rank 0 in world size 1 is assigned as DP rank 0, PP rank 0, PCP rank 0, TP rank 0, EP rank N/A, EPLB rank N/A
(StageEngineCoreProc_stage0_replica0 pid=13348) WARNING 09-22 11:56:51 [gpu_ar_worker.py:120] OMNI GPUARWorker forces v1 model runner for omni hooks.
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:56:51 [topk_topp_sampler.py:46] FlashInfer top-p/top-k sampling disabled via VLLM_USE_FLASHINFER_SAMPLER=0.
(StageEngineCoreProc_stage0_replica0 pid=13348) WARNING 09-22 11:56:51 [base.py:173] [LLM Worker 0] Sleep Mode DISABLED.
(StageEngineCoreProc_stage0_replica0 pid=13348) WARNING 09-22 11:56:51 [base.py:173] [LLM Worker 0] Sleep Mode DISABLED.
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:56:51 [gpu_model_runner.py:5379] Starting to load model \\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\models\Spark-X2.5-4B...
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:56:52 [cuda.py:492] Using FLASH_ATTN attention backend out of potential backends: ['FLASH_ATTN', 'TRITON_ATTN', 'FLEX_ATTENTION'].
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:56:52 [flash_attn.py:897] Using FlashAttention version 2
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:56:53 [weight_utils.py:863] Filesystem type for checkpoints: unknown. Checkpoint size: 7.66 GiB. Available RAM: 9.69 GiB.
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:56:53 [weight_utils.py:886] Auto-prefetch is disabled because the filesystem (unknown) is not a recognized network FS (NFS/Lustre). If you want to force prefetching, start vLLM with --safetensors-load-strategy=prefetch.
(StageEngineCoreProc_stage0_replica0 pid=13348)
Loading safetensors checkpoint shards: 0% Completed | 0/5 [00:00<?, ?it/s]
(StageEngineCoreProc_stage0_replica0 pid=13348)
Loading safetensors checkpoint shards: 20% Completed | 1/5 [00:22<01:31, 23.00s/it]
(StageEngineCoreProc_stage0_replica0 pid=13348)
Loading safetensors checkpoint shards: 40% Completed | 2/5 [00:47<01:11, 23.75s/it]
(StageEngineCoreProc_stage0_replica0 pid=13348)
Loading safetensors checkpoint shards: 60% Completed | 3/5 [01:10<00:47, 23.59s/it]
(StageEngineCoreProc_stage0_replica0 pid=13348)
Loading safetensors checkpoint shards: 80% Completed | 4/5 [01:34<00:23, 23.57s/it]
(StageEngineCoreProc_stage0_replica0 pid=13348)
Loading safetensors checkpoint shards: 100% Completed | 5/5 [01:37<00:00, 16.25s/it]
(StageEngineCoreProc_stage0_replica0 pid=13348)
Loading safetensors checkpoint shards: 100% Completed | 5/5 [01:37<00:00, 19.49s/it]
(StageEngineCoreProc_stage0_replica0 pid=13348)
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:58:30 [default_loader.py:430] Loading weights took 97.54 seconds
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:58:31 [gpu_model_runner.py:5471] Model loading took 7.66 GiB memory and 98.388669 seconds
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:58:31 [utils.py:306] Using LBNHC KV cache layout.
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:58:32 [kv_cache_utils.py:2032] GPU KV cache size: 5,105 tokens, Maximum concurrency for 4,096 tokens per request: 1.25x
(StageEngineCoreProc_stage0_replica0 pid=13348) WARNING 09-22 11:58:32 [base.py:173] [LLM Worker 0] Sleep Mode DISABLED.
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:58:32 [kernel_warmup.py:124] JIT kernel warmup starting.
(StageEngineCoreProc_stage0_replica0 pid=13348)
JIT kernel warmup (1 compile keys): 0%| | 0/1 [00:00<?, ?kernel/s]
JIT kernel warmup (1 compile keys): 100%|██████████| 1/1 [00:00<00:00, 1.31kernel/s, ComputeSlotMappingKernel (1 keys)]
JIT kernel warmup (1 compile keys): 100%|██████████| 1/1 [00:00<00:00, 1.31kernel/s, ComputeSlotMappingKernel (1 keys)]
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:58:33 [kernel_warmup.py:134] JIT kernel warmup finished in 0.76s.
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:58:34 [ll_bf16.py:30] cuteDSL (CUTLASS Python) not available, ll_bf16_gemm disabled
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:58:34 [jit_monitor.py:85] Kernel JIT monitor activated; monitored JIT compilations during inference will use mode=warn.
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:58:35 [torch_utils.py:277] Reducing Torch threads from 12 to 1 for serving. Set OMP_NUM_THREADS in the external environment to override.
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:58:35 [core.py:368] init engine (profile, create kv cache, warmup model) took 3.41 s
(StageEngineCoreProc_stage0_replica0 pid=13348) [transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
(StageEngineCoreProc_stage0_replica0 pid=13348) [transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
(StageEngineCoreProc_stage0_replica0 pid=13348) [transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'sliding_attention', 'full_attention'}
(StageEngineCoreProc_stage0_replica0 pid=13348) WARNING 09-22 11:58:36 [scheduler.py:213] Using custom scheduler class vllm_omni.core.sched.omni_ar_scheduler.OmniARAsyncScheduler. This scheduler interface is not public and compatibility may not be maintained. If you have subclassed Scheduler instead of AsyncScheduler, you will see degraded performance due to async scheduling being disabled.
(StageEngineCoreProc_stage0_replica0 pid=13348) WARNING 09-22 11:58:36 [omni_scheduler_mixin.py:118] OMNI scheduler forces v1 model runner for omni hooks.
INFO 09-22 11:58:36 [stage_runtime.py:930] [StageRuntime] Stage 0 engine startup completed
INFO 09-22 11:58:36 [stage_engine_core_client.py:159] [StageEngineCoreClient] stage-0 [rep-0] initializing EngineCore
(StageEngineCoreProc_stage0_replica0 pid=13348) WARNING 09-22 11:58:36 [vllm.py:1371] Enforce eager set, disabling torch.compile and CUDAGraphs. This is equivalent to setting -cc.mode=none -cc.cudagraph_mode=none
(StageEngineCoreProc_stage0_replica0 pid=13348) WARNING 09-22 11:58:36 [vllm.py:1406] Inductor compilation was disabled by user settings, optimizations settings that are only active during inductor compilation will be ignored.
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:58:36 [kernel.py:369] Final IR op priority after setting platform defaults: IrOpPriorityConfig(rms_norm=['vllm_c', 'native'], fused_add_rms_norm=['vllm_c', 'native'])
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:58:36 [vllm.py:1585] Cudagraph is disabled under eager mode
(StageEngineCoreProc_stage0_replica0 pid=13348) INFO 09-22 11:58:36 [compilation.py:329] Enabled custom fusions: norm_quant, act_quant
INFO 09-22 11:58:36 [stage_engine_core_client.py:215] [StageEngineCoreClient] stage-0 [rep-0] EngineCore running
INFO 09-22 11:58:36 [stage_runtime.py:945] [StageRuntime] Stage 0 initialized
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
[transformers] Unrecognized keys in `rope_parameters` for 'rope_type'='default': {'full_attention', 'sliding_attention'}
INFO 09-22 11:58:39 [orchestrator.py:604] [Orchestrator] Starting event loop
INFO 09-22 11:58:39 [async_omni_engine.py:323] [AsyncOmniEngine] Orchestrator ready with 1 stages
INFO 09-22 11:58:39 [omni_base.py:235] [AsyncOmni] AsyncOmniEngine initialized in 132.84 seconds
INFO 09-22 11:58:39 [omni_base.py:255] [AsyncOmni] Initialized with 1 stages for model \\wsl.localhost\Ubuntu\home\zhout\project\edge_infer\models\Spark-X2.5-4B
--- Running test: test_the_engine_loads_and_reports_where_it_landed
.--- Running test: test_the_kv_pool_is_the_size_the_plan_asked_for
.--- Running test: test_twelve_prompts_each_reach_128_tokens
WARNING 09-22 11:58:39 [input_processor.py:315] Passing raw prompts to InputProcessor is deprecated and will be removed in the future. You should instead pass the outputs of Renderer.render_cmpl() or Renderer.render_chat().
.--- Running test: test_the_budget_bounded_the_measured_peak
.--- Running test: test_usage_separates_what_was_measured_from_what_was_estimated
.--- Running test: test_cancel_releases_and_delivers_nothing_from_the_retired_epoch
INFO 09-22 11:59:34 [orchestrator.py:917] [Orchestrator] Aborted request(s) ['56e2a41427434ee8-12-b33cf904']
INFO 09-22 11:59:34 [orchestrator.py:917] [Orchestrator] Aborted request(s) ['56e2a41427434ee8-12-b33cf904']
INFO 09-22 11:59:34 [async_omni.py:665] [AsyncOmni] Request 56e2a41427434ee8-12-b33cf904 aborted.
.--- Running test: test_a_retired_handle_cannot_be_resubmitted
INFO 09-22 11:59:35 [orchestrator.py:917] [Orchestrator] Aborted request(s) ['d9c8163be55a49af-13-becca8b2']
INFO 09-22 11:59:35 [orchestrator.py:917] [Orchestrator] Aborted request(s) ['d9c8163be55a49af-13-becca8b2']
INFO 09-22 11:59:35 [async_omni.py:665] [AsyncOmni] Request d9c8163be55a49af-13-becca8b2 aborted.
.--- Running test: test_the_engine_still_generates_after_a_cancel
.INFO 09-22 11:59:37 [omni_base.py:781] [AsyncOmni] Shutting down
INFO 09-22 11:59:37 [async_omni_engine.py:1807] [AsyncOmniEngine] Shutting down Orchestrator
INFO 09-22 11:59:37 [orchestrator.py:705] [Orchestrator] Received shutdown signal
INFO 09-22 11:59:37 [orchestrator.py:3092] [Orchestrator] Shutting down all 1 client(s)
INFO 09-22 11:59:37 [core_client.py:689] [shutdown] MPClient: start timeout=default
INFO 09-22 11:59:37 [core_client.py:691] [shutdown] MPClient: stopping engine manager
INFO 09-22 11:59:37 [utils.py:626] [shutdown] Process manager: send sigterm to process StageEngineCoreProc_stage0_replica0
INFO 09-22 11:59:37 [core_client.py:693] [shutdown] MPClient: engine manager stopped
INFO 09-22 11:59:37 [core_client.py:694] [shutdown] MPClient: cleaning up background resources
INFO 09-22 11:59:37 [core_client.py:696] [shutdown] MPClient: complete
INFO 09-22 11:59:37 [stage_pool.py:1354] [StagePool] Stage 0 replica 0 shut down
============================== warnings summary ===============================
C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\jit\_script.py:365: 14 warnings
C:\Users\zhout\w2\omni029venv\Lib\site-packages\torch\jit\_script.py:365: DeprecationWarning: `torch.jit.script_method` is deprecated. Please switch to `torch.compile` or `torch.export`.
warnings.warn(
tests/edge/local/test_e2e_local_text.py::test_the_masked_startup_reaches_a_decision
C:\Users\zhout\w2\omni029venv\Lib\site-packages\pytest_asyncio\plugin.py:916: PytestDeprecationWarning: Overriding the "event_loop_policy" fixture is deprecated and will be removed in a future version of pytest-asyncio. Use the "pytest_asyncio_loop_factories" hook to customize event loop creation.
warnings.warn(
tests/edge/local/test_e2e_local_text.py::test_the_masked_startup_reaches_a_decision
tests\edge\local\test_e2e_local_text.py:109: PytestWarning: The test <Function test_the_masked_startup_reaches_a_decision> is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'.
def test_the_masked_startup_reaches_a_decision(model_dir):
tests/edge/local/test_e2e_local_text.py::test_a_refused_plan_cannot_be_started
tests\edge\local\test_e2e_local_text.py:124: PytestWarning: The test <Function test_a_refused_plan_cannot_be_started> is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'.
def test_a_refused_plan_cannot_be_started(model_dir):
tests/edge/local/test_e2e_local_text.py::test_int8_is_refused_on_cuda_and_admitted_on_cpu
tests\edge\local\test_e2e_local_text.py:133: PytestWarning: The test <Function test_int8_is_refused_on_cuda_and_admitted_on_cpu> is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'.
@pytest.mark.skipif(
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
--- Running Summary
11 passed, 18 warnings in 210.11s (0:03:30)
@@ -0,0 +1,25 @@
........... [100%]
=============================== warnings summary ===============================
../.venvs/omni-cuda-029/lib/python3.12/site-packages/torch/jit/_script.py:365: 14 warnings
/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/torch/jit/_script.py:365: DeprecationWarning: `torch.jit.script_method` is deprecated. Please switch to `torch.compile` or `torch.export`.
warnings.warn(
tests/edge/local/test_e2e_local_text.py::test_the_masked_startup_reaches_a_decision
/home/zhout/project/edge_infer/.venvs/omni-cuda-029/lib/python3.12/site-packages/pytest_asyncio/plugin.py:916: PytestDeprecationWarning: Overriding the "event_loop_policy" fixture is deprecated and will be removed in a future version of pytest-asyncio. Use the "pytest_asyncio_loop_factories" hook to customize event loop creation.
warnings.warn(
tests/edge/local/test_e2e_local_text.py::test_the_masked_startup_reaches_a_decision
tests/edge/local/test_e2e_local_text.py:109: PytestWarning: The test <Function test_the_masked_startup_reaches_a_decision> is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'.
def test_the_masked_startup_reaches_a_decision(model_dir):
tests/edge/local/test_e2e_local_text.py::test_a_refused_plan_cannot_be_started
tests/edge/local/test_e2e_local_text.py:124: PytestWarning: The test <Function test_a_refused_plan_cannot_be_started> is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'.
def test_a_refused_plan_cannot_be_started(model_dir):
tests/edge/local/test_e2e_local_text.py::test_int8_is_refused_on_cuda_and_admitted_on_cpu
tests/edge/local/test_e2e_local_text.py:133: PytestWarning: The test <Function test_int8_is_refused_on_cuda_and_admitted_on_cpu> is marked with '@pytest.mark.asyncio' but it is not an async function. Please remove the asyncio mark. If the test is not marked explicitly, check for global marks applied via 'pytestmark'.
@pytest.mark.skipif(
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
--- Running Summary
11 passed, 18 warnings in 261.25s (0:04:21)
Loaded 100 of 955 files, more files were not shown because too many files have changed in this diff. Show more