Commit Overhead vs Throughput

Commit Overhead vs Throughput

Analysis of commit protocol overhead as percentage of total transaction time.

Overhead = (commit_latency / total_latency) × 100

This represents time spent in retries, exponential backoff, and manifest I/O.

Values shown as mean ± standard deviation across seeds.

real_conflict_probability = 0.0

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.4 ± 0.00.4 ± 0.00.6 ± 0.00.7 ± 0.0
0.5 ± 0.0100.0 ± 0.00.8 ± 0.00.8 ± 0.01.1 ± 0.01.2 ± 0.1
1.0 ± 0.0100.0 ± 0.01.5 ± 0.01.5 ± 0.01.8 ± 0.02.0 ± 0.1
1.9 ± 0.0100.0 ± 0.02.8 ± 0.02.8 ± 0.03.3 ± 0.03.5 ± 0.0
4.8 ± 0.198.0 ± 0.26.9 ± 0.16.9 ± 0.17.6 ± 0.17.9 ± 0.1
7.8 ± 0.078.8 ± 0.311.1 ± 0.111.0 ± 0.111.7 ± 0.112.0 ± 0.1
9.4 ± 0.047.5 ± 0.213.4 ± 0.013.3 ± 0.013.8 ± 0.014.2 ± 0.0
10.7 ± 0.021.3 ± 0.115.2 ± 0.015.1 ± 0.015.6 ± 0.015.8 ± 0.0
11.5 ± 0.011.2 ± 0.016.3 ± 0.016.3 ± 0.016.7 ± 0.016.9 ± 0.0

real_conflict_probability = 0.1

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.4 ± 0.00.4 ± 0.00.7 ± 0.01.1 ± 0.1
0.5 ± 0.0100.0 ± 0.00.8 ± 0.00.8 ± 0.01.2 ± 0.01.6 ± 0.0
1.0 ± 0.0100.0 ± 0.01.6 ± 0.01.5 ± 0.02.0 ± 0.12.4 ± 0.1
2.0 ± 0.0100.0 ± 0.03.0 ± 0.02.9 ± 0.03.6 ± 0.04.1 ± 0.1
4.8 ± 0.197.6 ± 0.16.9 ± 0.16.8 ± 0.17.7 ± 0.18.4 ± 0.1
7.6 ± 0.177.0 ± 0.610.9 ± 0.110.8 ± 0.111.6 ± 0.112.3 ± 0.1
9.2 ± 0.046.3 ± 0.113.1 ± 0.013.1 ± 0.013.9 ± 0.014.4 ± 0.0
10.5 ± 0.020.8 ± 0.014.9 ± 0.014.9 ± 0.015.6 ± 0.016.0 ± 0.0
11.3 ± 0.010.9 ± 0.016.1 ± 0.016.0 ± 0.016.7 ± 0.017.1 ± 0.0

real_conflict_probability = 0.3

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.5 ± 0.00.4 ± 0.01.0 ± 0.01.4 ± 0.1
0.5 ± 0.0100.0 ± 0.00.9 ± 0.00.8 ± 0.01.5 ± 0.11.9 ± 0.0
1.0 ± 0.0100.0 ± 0.01.6 ± 0.01.5 ± 0.02.3 ± 0.02.8 ± 0.1
2.0 ± 0.0100.0 ± 0.03.1 ± 0.02.9 ± 0.03.9 ± 0.04.6 ± 0.1
4.7 ± 0.195.3 ± 0.37.0 ± 0.16.9 ± 0.18.2 ± 0.19.1 ± 0.1
7.1 ± 0.072.0 ± 0.410.4 ± 0.010.3 ± 0.011.5 ± 0.012.4 ± 0.0
8.7 ± 0.043.7 ± 0.112.6 ± 0.012.5 ± 0.013.6 ± 0.014.3 ± 0.0
10.0 ± 0.019.9 ± 0.014.5 ± 0.014.4 ± 0.015.4 ± 0.016.0 ± 0.0
10.8 ± 0.010.4 ± 0.015.6 ± 0.015.4 ± 0.016.4 ± 0.016.9 ± 0.0

real_conflict_probability = 0.5

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.6 ± 0.00.5 ± 0.01.1 ± 0.01.5 ± 0.1
0.5 ± 0.0100.0 ± 0.01.0 ± 0.00.9 ± 0.01.7 ± 0.02.1 ± 0.1
1.0 ± 0.0100.0 ± 0.01.7 ± 0.01.6 ± 0.02.5 ± 0.13.2 ± 0.1
2.0 ± 0.099.9 ± 0.13.2 ± 0.13.0 ± 0.14.2 ± 0.05.0 ± 0.1
4.5 ± 0.092.1 ± 0.47.0 ± 0.16.8 ± 0.18.3 ± 0.19.5 ± 0.1
6.5 ± 0.066.4 ± 0.49.8 ± 0.09.7 ± 0.011.2 ± 0.012.2 ± 0.0
8.0 ± 0.040.4 ± 0.111.9 ± 0.011.8 ± 0.013.2 ± 0.014.0 ± 0.0
9.4 ± 0.018.7 ± 0.013.9 ± 0.013.8 ± 0.015.0 ± 0.015.6 ± 0.0
10.2 ± 0.09.9 ± 0.015.0 ± 0.014.9 ± 0.016.0 ± 0.016.6 ± 0.0

Interpretation

  • Low overhead (<10%): System operating efficiently, minimal contention
  • Medium overhead (10-30%): Moderate contention, acceptable performance
  • High overhead (30-50%): High contention, commit protocol becoming significant
  • Very high overhead (>50%): Commit protocol dominates, system saturated

Values shown as mean ± standard deviation across multiple seeds. At saturation, overhead can exceed 50%, meaning more time is spent retrying commits than executing transactions!