Commit Overhead vs Throughput

Commit Overhead vs Throughput

Analysis of commit protocol overhead as percentage of total transaction time.

Overhead = (commit_latency / total_latency) × 100

This represents time spent in retries, exponential backoff, and manifest I/O.

Values shown as mean ± standard deviation across seeds.

t_cas_mean = 15

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.4 ± 0.00.4 ± 0.00.7 ± 0.00.8 ± 0.1
0.5 ± 0.0100.0 ± 0.00.9 ± 0.00.8 ± 0.01.2 ± 0.11.4 ± 0.0
1.0 ± 0.0100.0 ± 0.01.6 ± 0.01.5 ± 0.02.0 ± 0.02.3 ± 0.1
1.9 ± 0.0100.0 ± 0.02.9 ± 0.02.9 ± 0.03.5 ± 0.03.8 ± 0.1
4.9 ± 0.199.8 ± 0.07.1 ± 0.17.1 ± 0.17.9 ± 0.18.3 ± 0.1
8.8 ± 0.188.8 ± 0.312.6 ± 0.112.5 ± 0.113.4 ± 0.113.9 ± 0.1
10.5 ± 0.053.2 ± 0.115.1 ± 0.015.0 ± 0.015.8 ± 0.016.2 ± 0.0
11.7 ± 0.023.3 ± 0.016.7 ± 0.016.6 ± 0.017.4 ± 0.017.7 ± 0.0
12.5 ± 0.012.1 ± 0.017.8 ± 0.017.8 ± 0.018.5 ± 0.018.8 ± 0.0

t_cas_mean = 50

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.6 ± 0.00.6 ± 0.01.0 ± 0.11.3 ± 0.2
0.5 ± 0.0100.0 ± 0.01.1 ± 0.11.0 ± 0.01.6 ± 0.12.0 ± 0.1
1.0 ± 0.0100.0 ± 0.01.8 ± 0.01.7 ± 0.02.5 ± 0.02.9 ± 0.1
2.0 ± 0.0100.0 ± 0.03.3 ± 0.03.2 ± 0.04.2 ± 0.04.8 ± 0.1
4.5 ± 0.091.0 ± 0.47.2 ± 0.07.0 ± 0.08.7 ± 0.09.6 ± 0.1
5.5 ± 0.055.7 ± 0.28.7 ± 0.08.5 ± 0.010.4 ± 0.011.2 ± 0.1
6.2 ± 0.031.2 ± 0.19.7 ± 0.09.5 ± 0.011.4 ± 0.012.2 ± 0.0
6.8 ± 0.013.4 ± 0.010.6 ± 0.010.4 ± 0.012.3 ± 0.012.9 ± 0.0
7.0 ± 0.06.7 ± 0.010.9 ± 0.010.7 ± 0.012.5 ± 0.013.2 ± 0.0

t_cas_mean = 100

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.8 ± 0.00.8 ± 0.01.5 ± 0.01.8 ± 0.1
0.5 ± 0.0100.0 ± 0.01.4 ± 0.01.3 ± 0.02.2 ± 0.12.9 ± 0.2
1.0 ± 0.0100.0 ± 0.02.2 ± 0.02.1 ± 0.03.5 ± 0.14.4 ± 0.1
2.0 ± 0.099.1 ± 0.14.0 ± 0.13.7 ± 0.15.9 ± 0.17.5 ± 0.2
3.2 ± 0.064.7 ± 0.36.3 ± 0.05.9 ± 0.09.4 ± 0.010.8 ± 0.1
3.7 ± 0.037.4 ± 0.17.1 ± 0.06.7 ± 0.010.2 ± 0.111.5 ± 0.1
4.0 ± 0.020.2 ± 0.17.6 ± 0.07.3 ± 0.010.7 ± 0.112.0 ± 0.1
4.2 ± 0.08.3 ± 0.07.9 ± 0.07.6 ± 0.011.1 ± 0.012.3 ± 0.0
4.3 ± 0.04.1 ± 0.08.1 ± 0.07.7 ± 0.011.2 ± 0.012.4 ± 0.1

t_cas_mean = 200

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.01.4 ± 0.01.3 ± 0.12.7 ± 0.03.6 ± 0.1
0.5 ± 0.0100.0 ± 0.02.0 ± 0.11.8 ± 0.14.0 ± 0.25.6 ± 0.3
1.0 ± 0.099.7 ± 0.23.4 ± 0.12.9 ± 0.16.7 ± 0.29.1 ± 0.4
1.6 ± 0.082.9 ± 0.45.3 ± 0.04.6 ± 0.010.5 ± 0.113.3 ± 0.1
2.1 ± 0.041.1 ± 0.56.3 ± 0.05.6 ± 0.011.9 ± 0.214.3 ± 0.2
2.2 ± 0.022.3 ± 0.16.9 ± 0.06.2 ± 0.012.5 ± 0.114.8 ± 0.2
2.3 ± 0.011.5 ± 0.07.1 ± 0.06.4 ± 0.012.7 ± 0.114.8 ± 0.1
2.4 ± 0.04.8 ± 0.07.2 ± 0.06.6 ± 0.113.0 ± 0.115.1 ± 0.1
2.5 ± 0.02.4 ± 0.07.3 ± 0.06.7 ± 0.013.0 ± 0.115.1 ± 0.1

t_cas_mean = 500

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.03.0 ± 0.12.6 ± 0.16.7 ± 0.39.6 ± 0.6
0.5 ± 0.098.8 ± 0.35.2 ± 0.24.2 ± 0.213.4 ± 0.919.4 ± 1.1
0.7 ± 0.074.3 ± 0.97.8 ± 0.16.2 ± 0.119.0 ± 0.424.2 ± 0.4
0.9 ± 0.044.0 ± 0.58.9 ± 0.27.3 ± 0.321.0 ± 0.525.3 ± 0.3
1.0 ± 0.019.7 ± 0.39.6 ± 0.18.2 ± 0.221.5 ± 0.325.9 ± 0.3
1.0 ± 0.010.1 ± 0.19.7 ± 0.18.3 ± 0.221.5 ± 0.426.0 ± 0.2
1.0 ± 0.05.1 ± 0.09.8 ± 0.48.4 ± 0.421.8 ± 0.925.7 ± 0.8
1.1 ± 0.02.1 ± 0.09.8 ± 0.18.4 ± 0.221.7 ± 0.125.8 ± 0.4
1.1 ± 0.01.1 ± 0.09.9 ± 0.28.5 ± 0.321.7 ± 0.725.8 ± 0.5

t_cas_mean = 1000

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.099.9 ± 0.16.4 ± 0.45.3 ± 0.516.1 ± 1.423.8 ± 2.9
0.4 ± 0.075.1 ± 1.412.3 ± 0.29.7 ± 0.331.3 ± 1.138.0 ± 0.8
0.4 ± 0.044.5 ± 0.414.3 ± 0.412.1 ± 0.433.1 ± 0.439.3 ± 0.8
0.5 ± 0.024.7 ± 0.315.2 ± 0.513.5 ± 0.634.0 ± 1.139.6 ± 0.4
0.5 ± 0.010.4 ± 0.115.3 ± 0.413.5 ± 0.533.8 ± 0.740.0 ± 0.8
0.5 ± 0.05.4 ± 0.115.4 ± 0.513.3 ± 0.534.4 ± 1.239.6 ± 0.7
0.5 ± 0.02.7 ± 0.015.6 ± 0.413.9 ± 0.634.4 ± 1.140.0 ± 0.7
0.6 ± 0.01.1 ± 0.015.2 ± 0.313.4 ± 0.533.8 ± 0.639.4 ± 0.6
0.6 ± 0.00.6 ± 0.015.4 ± 0.413.5 ± 0.634.2 ± 0.339.6 ± 0.8

Interpretation

  • Low overhead (<10%): System operating efficiently, minimal contention
  • Medium overhead (10-30%): Moderate contention, acceptable performance
  • High overhead (30-50%): High contention, commit protocol becoming significant
  • Very high overhead (>50%): Commit protocol dominates, system saturated

Values shown as mean ± standard deviation across multiple seeds. At saturation, overhead can exceed 50%, meaning more time is spent retrying commits than executing transactions!