Commit Overhead vs Throughput

Commit Overhead vs Throughput

Analysis of commit protocol overhead as percentage of total transaction time.

Overhead = (commit_latency / total_latency) × 100

This represents time spent in retries, exponential backoff, and manifest I/O.

Values shown as mean ± standard deviation across seeds.

real_conflict_probability = 0.0

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.4 ± 0.00.3 ± 0.00.6 ± 0.00.7 ± 0.0
0.5 ± 0.0100.0 ± 0.00.8 ± 0.00.7 ± 0.01.0 ± 0.01.1 ± 0.1
1.0 ± 0.0100.0 ± 0.01.5 ± 0.01.4 ± 0.01.8 ± 0.02.0 ± 0.0
2.0 ± 0.1100.0 ± 0.02.9 ± 0.12.8 ± 0.13.3 ± 0.13.6 ± 0.1
5.0 ± 0.0100.0 ± 0.07.0 ± 0.16.9 ± 0.07.5 ± 0.17.9 ± 0.1
9.9 ± 0.1100.0 ± 0.013.8 ± 0.013.8 ± 0.014.6 ± 0.215.0 ± 0.2
18.9 ± 0.195.4 ± 0.226.2 ± 0.126.2 ± 0.127.0 ± 0.127.3 ± 0.1
26.1 ± 0.052.4 ± 0.136.2 ± 0.036.2 ± 0.036.6 ± 0.036.8 ± 0.1
28.3 ± 0.027.8 ± 0.139.3 ± 0.039.3 ± 0.039.6 ± 0.039.7 ± 0.0

real_conflict_probability = 0.1

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.4 ± 0.00.4 ± 0.00.7 ± 0.01.1 ± 0.1
0.5 ± 0.0100.0 ± 0.00.8 ± 0.00.8 ± 0.01.2 ± 0.01.6 ± 0.0
1.0 ± 0.0100.0 ± 0.01.5 ± 0.01.4 ± 0.02.0 ± 0.12.4 ± 0.1
2.0 ± 0.0100.0 ± 0.02.9 ± 0.12.9 ± 0.13.5 ± 0.13.9 ± 0.1
4.9 ± 0.1100.0 ± 0.07.0 ± 0.17.0 ± 0.17.8 ± 0.18.3 ± 0.1
9.9 ± 0.199.9 ± 0.013.9 ± 0.113.8 ± 0.014.8 ± 0.115.4 ± 0.2
18.2 ± 0.191.9 ± 0.325.5 ± 0.125.4 ± 0.126.4 ± 0.126.9 ± 0.1
25.0 ± 0.050.2 ± 0.134.9 ± 0.034.8 ± 0.035.5 ± 0.035.9 ± 0.0
27.4 ± 0.026.9 ± 0.038.2 ± 0.038.1 ± 0.038.8 ± 0.039.2 ± 0.0

real_conflict_probability = 0.3

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.5 ± 0.00.4 ± 0.01.0 ± 0.11.4 ± 0.1
0.5 ± 0.0100.0 ± 0.00.9 ± 0.00.8 ± 0.01.5 ± 0.11.9 ± 0.1
1.0 ± 0.0100.0 ± 0.01.6 ± 0.11.5 ± 0.02.3 ± 0.12.8 ± 0.1
2.0 ± 0.0100.0 ± 0.03.0 ± 0.12.9 ± 0.13.8 ± 0.14.4 ± 0.1
4.9 ± 0.1100.0 ± 0.07.2 ± 0.17.1 ± 0.18.2 ± 0.19.0 ± 0.2
9.8 ± 0.199.2 ± 0.114.0 ± 0.113.9 ± 0.115.3 ± 0.116.1 ± 0.1
16.6 ± 0.184.2 ± 0.223.6 ± 0.123.5 ± 0.124.9 ± 0.125.7 ± 0.1
22.6 ± 0.045.4 ± 0.131.9 ± 0.031.8 ± 0.033.0 ± 0.033.6 ± 0.0
25.4 ± 0.024.8 ± 0.135.7 ± 0.035.6 ± 0.036.6 ± 0.037.1 ± 0.0

real_conflict_probability = 0.5

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.5 ± 0.00.4 ± 0.01.1 ± 0.11.5 ± 0.2
0.5 ± 0.0100.0 ± 0.01.0 ± 0.00.9 ± 0.01.6 ± 0.02.0 ± 0.0
1.0 ± 0.0100.0 ± 0.01.7 ± 0.01.6 ± 0.02.5 ± 0.13.1 ± 0.1
2.0 ± 0.0100.0 ± 0.03.1 ± 0.13.0 ± 0.14.1 ± 0.14.7 ± 0.1
4.9 ± 0.199.9 ± 0.07.4 ± 0.17.2 ± 0.18.7 ± 0.19.7 ± 0.1
9.5 ± 0.096.4 ± 0.114.0 ± 0.013.8 ± 0.015.6 ± 0.116.7 ± 0.1
14.9 ± 0.075.2 ± 0.121.5 ± 0.121.2 ± 0.123.1 ± 0.124.0 ± 0.1
19.9 ± 0.039.8 ± 0.228.5 ± 0.028.3 ± 0.029.9 ± 0.030.6 ± 0.0
22.8 ± 0.022.3 ± 0.132.4 ± 0.032.3 ± 0.033.7 ± 0.034.4 ± 0.1

Interpretation

  • Low overhead (<10%): System operating efficiently, minimal contention
  • Medium overhead (10-30%): Moderate contention, acceptable performance
  • High overhead (30-50%): High contention, commit protocol becoming significant
  • Very high overhead (>50%): Commit protocol dominates, system saturated

Values shown as mean ± standard deviation across multiple seeds. At saturation, overhead can exceed 50%, meaning more time is spent retrying commits than executing transactions!