Commit Overhead vs Throughput

Commit Overhead vs Throughput

Analysis of commit protocol overhead as percentage of total transaction time.

Overhead = (commit_latency / total_latency) × 100

This represents time spent in retries, exponential backoff, and manifest I/O.

Values shown as mean ± standard deviation across seeds.

real_conflict_probability = 0.0

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.3 ± 0.00.3 ± 0.00.5 ± 0.00.6 ± 0.0
0.5 ± 0.0100.0 ± 0.00.8 ± 0.00.8 ± 0.01.0 ± 0.01.2 ± 0.1
1.0 ± 0.0100.0 ± 0.01.4 ± 0.01.4 ± 0.01.7 ± 0.01.9 ± 0.1
2.0 ± 0.0100.0 ± 0.02.8 ± 0.02.8 ± 0.03.2 ± 0.13.5 ± 0.1
5.0 ± 0.0100.0 ± 0.07.0 ± 0.16.9 ± 0.17.5 ± 0.17.8 ± 0.1
9.8 ± 0.1100.0 ± 0.013.7 ± 0.113.7 ± 0.114.4 ± 0.114.8 ± 0.2
19.7 ± 0.199.8 ± 0.027.3 ± 0.227.3 ± 0.228.1 ± 0.228.6 ± 0.2
30.9 ± 0.062.4 ± 0.242.8 ± 0.042.7 ± 0.043.1 ± 0.043.3 ± 0.0
33.3 ± 0.032.9 ± 0.146.1 ± 0.046.1 ± 0.046.4 ± 0.046.5 ± 0.0

real_conflict_probability = 0.1

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.4 ± 0.00.3 ± 0.00.7 ± 0.11.1 ± 0.1
0.5 ± 0.0100.0 ± 0.00.8 ± 0.00.8 ± 0.01.1 ± 0.01.5 ± 0.1
1.0 ± 0.0100.0 ± 0.01.5 ± 0.01.5 ± 0.01.9 ± 0.12.3 ± 0.1
2.0 ± 0.0100.0 ± 0.02.9 ± 0.02.8 ± 0.03.3 ± 0.13.7 ± 0.1
4.9 ± 0.0100.0 ± 0.06.9 ± 0.16.8 ± 0.17.6 ± 0.18.1 ± 0.1
9.8 ± 0.1100.0 ± 0.013.8 ± 0.113.7 ± 0.114.6 ± 0.115.2 ± 0.1
19.5 ± 0.199.2 ± 0.027.2 ± 0.127.2 ± 0.128.2 ± 0.228.8 ± 0.2
29.9 ± 0.060.2 ± 0.241.5 ± 0.041.5 ± 0.042.1 ± 0.042.5 ± 0.0
32.5 ± 0.032.1 ± 0.045.1 ± 0.045.1 ± 0.045.7 ± 0.046.0 ± 0.0

real_conflict_probability = 0.3

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.4 ± 0.00.3 ± 0.00.9 ± 0.11.2 ± 0.0
0.5 ± 0.0100.0 ± 0.00.9 ± 0.00.8 ± 0.01.4 ± 0.01.8 ± 0.0
1.0 ± 0.0100.0 ± 0.01.6 ± 0.01.5 ± 0.02.2 ± 0.12.6 ± 0.1
2.0 ± 0.0100.0 ± 0.03.0 ± 0.12.9 ± 0.13.7 ± 0.14.2 ± 0.1
4.9 ± 0.1100.0 ± 0.07.1 ± 0.17.0 ± 0.18.0 ± 0.18.6 ± 0.1
9.9 ± 0.0100.0 ± 0.014.1 ± 0.114.0 ± 0.115.2 ± 0.115.9 ± 0.2
19.0 ± 0.196.5 ± 0.126.7 ± 0.126.6 ± 0.128.0 ± 0.128.8 ± 0.1
27.6 ± 0.055.7 ± 0.138.8 ± 0.038.7 ± 0.039.8 ± 0.040.3 ± 0.0
30.6 ± 0.030.1 ± 0.142.8 ± 0.042.7 ± 0.043.7 ± 0.044.1 ± 0.0

real_conflict_probability = 0.5

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.4 ± 0.00.4 ± 0.01.0 ± 0.11.4 ± 0.1
0.5 ± 0.0100.0 ± 0.00.9 ± 0.00.9 ± 0.01.6 ± 0.01.9 ± 0.1
1.0 ± 0.0100.0 ± 0.01.6 ± 0.01.5 ± 0.02.3 ± 0.02.8 ± 0.0
2.0 ± 0.0100.0 ± 0.03.1 ± 0.13.0 ± 0.13.9 ± 0.14.5 ± 0.1
4.9 ± 0.1100.0 ± 0.07.3 ± 0.17.2 ± 0.18.4 ± 0.19.1 ± 0.1
9.9 ± 0.199.9 ± 0.014.3 ± 0.114.1 ± 0.115.7 ± 0.216.6 ± 0.2
18.1 ± 0.091.5 ± 0.325.8 ± 0.125.6 ± 0.127.3 ± 0.128.2 ± 0.1
25.2 ± 0.050.4 ± 0.235.8 ± 0.035.6 ± 0.037.1 ± 0.037.7 ± 0.0
28.2 ± 0.027.7 ± 0.139.8 ± 0.039.7 ± 0.041.0 ± 0.041.6 ± 0.0

Interpretation

  • Low overhead (<10%): System operating efficiently, minimal contention
  • Medium overhead (10-30%): Moderate contention, acceptable performance
  • High overhead (30-50%): High contention, commit protocol becoming significant
  • Very high overhead (>50%): Commit protocol dominates, system saturated

Values shown as mean ± standard deviation across multiple seeds. At saturation, overhead can exceed 50%, meaning more time is spent retrying commits than executing transactions!