Commit Overhead vs Throughput

Commit Overhead vs Throughput

Analysis of commit protocol overhead as percentage of total transaction time.

Overhead = (commit_latency / total_latency) × 100

This represents time spent in retries, exponential backoff, and manifest I/O.

Values shown as mean ± standard deviation across seeds.

num_tables = 1

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.8 ± 0.00.8 ± 0.11.5 ± 0.01.8 ± 0.1
0.5 ± 0.0100.0 ± 0.01.4 ± 0.01.3 ± 0.02.3 ± 0.12.9 ± 0.1
1.0 ± 0.0100.0 ± 0.02.2 ± 0.02.1 ± 0.03.5 ± 0.14.4 ± 0.1
2.0 ± 0.099.2 ± 0.23.9 ± 0.03.7 ± 0.05.9 ± 0.17.5 ± 0.1
3.2 ± 0.065.1 ± 0.66.3 ± 0.05.9 ± 0.09.4 ± 0.010.8 ± 0.1
3.7 ± 0.036.9 ± 0.27.1 ± 0.06.7 ± 0.010.1 ± 0.111.4 ± 0.0
4.0 ± 0.020.1 ± 0.17.6 ± 0.07.3 ± 0.010.8 ± 0.012.0 ± 0.1
4.2 ± 0.08.3 ± 0.07.9 ± 0.07.6 ± 0.011.1 ± 0.012.3 ± 0.1
4.3 ± 0.04.1 ± 0.08.1 ± 0.07.7 ± 0.011.2 ± 0.112.4 ± 0.0

num_tables = 5

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.7 ± 0.00.6 ± 0.01.4 ± 0.11.6 ± 0.0
0.5 ± 0.0100.0 ± 0.01.2 ± 0.01.2 ± 0.02.0 ± 0.12.3 ± 0.1
1.0 ± 0.0100.0 ± 0.01.9 ± 0.01.9 ± 0.02.8 ± 0.13.3 ± 0.1
2.0 ± 0.0100.0 ± 0.03.4 ± 0.13.3 ± 0.14.5 ± 0.15.0 ± 0.1
4.9 ± 0.1100.0 ± 0.07.7 ± 0.17.5 ± 0.19.1 ± 0.110.0 ± 0.1
9.7 ± 0.197.9 ± 0.114.8 ± 0.114.5 ± 0.116.8 ± 0.118.0 ± 0.1
13.7 ± 0.168.9 ± 0.320.8 ± 0.020.6 ± 0.023.1 ± 0.024.1 ± 0.0
15.5 ± 0.030.7 ± 0.123.3 ± 0.023.1 ± 0.025.6 ± 0.026.5 ± 0.0
16.4 ± 0.015.9 ± 0.124.6 ± 0.024.4 ± 0.026.9 ± 0.027.7 ± 0.0

num_tables = 20

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.6 ± 0.00.5 ± 0.01.5 ± 0.01.6 ± 0.0
0.5 ± 0.0100.0 ± 0.00.9 ± 0.00.9 ± 0.01.8 ± 0.12.1 ± 0.1
1.0 ± 0.0100.0 ± 0.01.6 ± 0.01.7 ± 0.02.5 ± 0.02.9 ± 0.0
2.0 ± 0.0100.0 ± 0.03.2 ± 0.13.1 ± 0.14.1 ± 0.14.6 ± 0.1
4.9 ± 0.0100.0 ± 0.07.4 ± 0.17.3 ± 0.18.6 ± 0.09.2 ± 0.1
9.9 ± 0.1100.0 ± 0.014.5 ± 0.114.3 ± 0.115.9 ± 0.116.6 ± 0.1
19.7 ± 0.199.6 ± 0.028.2 ± 0.228.1 ± 0.129.9 ± 0.230.7 ± 0.2
30.4 ± 0.061.3 ± 0.143.6 ± 0.043.5 ± 0.045.1 ± 0.045.6 ± 0.0
32.6 ± 0.032.2 ± 0.146.8 ± 0.046.8 ± 0.048.2 ± 0.048.5 ± 0.0

num_tables = 50

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.7 ± 0.00.7 ± 0.01.5 ± 0.01.7 ± 0.0
0.5 ± 0.0100.0 ± 0.00.9 ± 0.00.9 ± 0.01.9 ± 0.12.1 ± 0.1
1.0 ± 0.0100.0 ± 0.01.3 ± 0.01.5 ± 0.02.5 ± 0.12.8 ± 0.0
1.9 ± 0.0100.0 ± 0.02.5 ± 0.02.9 ± 0.13.8 ± 0.14.2 ± 0.1
4.9 ± 0.0100.0 ± 0.06.9 ± 0.17.0 ± 0.18.2 ± 0.18.8 ± 0.1
9.9 ± 0.1100.0 ± 0.014.0 ± 0.114.0 ± 0.115.4 ± 0.216.0 ± 0.2
19.7 ± 0.2100.0 ± 0.027.9 ± 0.227.8 ± 0.229.4 ± 0.230.2 ± 0.2
36.6 ± 0.074.5 ± 0.251.6 ± 0.051.5 ± 0.052.8 ± 0.153.2 ± 0.1
40.1 ± 0.040.2 ± 0.156.7 ± 0.056.6 ± 0.057.6 ± 0.057.9 ± 0.0

Interpretation

  • Low overhead (<10%): System operating efficiently, minimal contention
  • Medium overhead (10-30%): Moderate contention, acceptable performance
  • High overhead (30-50%): High contention, commit protocol becoming significant
  • Very high overhead (>50%): Commit protocol dominates, system saturated

Values shown as mean ± standard deviation across multiple seeds. At saturation, overhead can exceed 50%, meaning more time is spent retrying commits than executing transactions!