Sample output

Benchmark JSON Formats

The bench tool produces structured JSON for each concurrency run. bench-report reads these files to generate the HTML report. The engine can also POST results directly to the callback endpoint.

// Run result JSON (cN.json)

Each concurrency run produces a cN.json file (e.g. c10.json for concurrency=10). This is the primary output of the bench tool.

c10.json

{
  "concurrency": 10,
  "agg_rows_per_sec": 883017,
  "agg_rows_inserted": 75814101,
  "wall_time_sec": 89.2,
  "jobs": [
    {
      "run_id": "bench_20260326_143022_7841_j01",
      "started_at": "2026-03-26T14:30:22Z",
      "completed_at": "2026-03-26T14:31:51Z",
      "rows_inserted": 7581410,
      "rows_per_sec": 88301.7,
      "elapsed_sec": 85.8
    },
    {
      "run_id": "bench_20260326_143022_7841_j02",
      "started_at": "2026-03-26T14:30:22Z",
      "completed_at": "2026-03-26T14:31:52Z",
      "rows_inserted": 7581410,
      "rows_per_sec": 87685.1,
      "elapsed_sec": 86.5
    },
    // ... 8 additional job objects
  ],
  "samples": {
    "cpu_avg": 61.2,
    "cpu_peak": 78.4,
    "mem_peak_mb": 412.0,
    "mem_settled_mb": 298.0,
    "io_read_mb": 2714.0,
    "io_write_mb": 18.4,
    "net_rx_mb": 2698.0,
    "net_tx_mb": 24.1
  },
  "pg_delta": {
    "tup_inserted": 75814101,
    "blks_written": 892441,
    "wal_bytes": 14729183232,
    "checkpoints": 47
  },
  "env": {
    "host_os": "Linux 6.1.0-21",
    "cpu_model": "AMD EPYC 7B13",
    "cpu_cores": 128,
    "ram_gb": 128,
    "db_version": "PostgreSQL 15.6",
    "engine_version": "dataforge-0.4.1",
    "git_commit": "3824b13",
    "tag": "EverPure POC 2026-03-26"
  }
}

// Engine callback payload (/api/benchmark-runs)

The DataForge engine can POST results directly to the callback endpoint. This JSON structure is persisted to the benchmark_runs table.

POST /api/benchmark-runs

{
  "run_id": "bench_20260326_143022_7841",
  "engine_version": "dataforge-0.4.1",
  "submitted_at": "2026-03-26T14:31:52Z",
  "customer_email": "[email protected]",
  "token": "a3f2e1d...",
  "rows_processed": 75814101,
  "rows_per_second": 883017.4,
  "wall_time_sec": 89.2,
  "cpu_avg": 61.2,
  "cpu_peak": 78.4,
  "mem_peak_mb": 412.0,
  "mem_settled_mb": 298.0,
  "rows_failed": 0,
  "rows_dropped": 0,
  "rows_malformed": 0,
  "report_html_url": "",
  "report_json_url": "",
  "raw_payload": {}
}

// Response

202 Accepted

{
  "status": "accepted",
  "id": 47
}