Commit Overhead vs Throughput

Commit Overhead vs Throughput

Analysis of commit protocol overhead as percentage of total transaction time.

Overhead = (commit_latency / total_latency) × 100

This represents time spent in retries, exponential backoff, and manifest I/O.

Values shown as mean ± standard deviation across seeds.

real_conflict_probability = 0.0

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.4 ± 0.00.4 ± 0.00.6 ± 0.00.7 ± 0.1
0.5 ± 0.0100.0 ± 0.00.8 ± 0.00.8 ± 0.01.1 ± 0.01.3 ± 0.0
1.0 ± 0.0100.0 ± 0.01.5 ± 0.01.5 ± 0.01.9 ± 0.12.1 ± 0.1
2.0 ± 0.099.8 ± 0.12.9 ± 0.12.9 ± 0.13.4 ± 0.13.7 ± 0.1
4.3 ± 0.087.2 ± 0.46.2 ± 0.06.2 ± 0.06.8 ± 0.07.2 ± 0.0
5.7 ± 0.058.3 ± 0.58.3 ± 0.08.2 ± 0.08.7 ± 0.09.0 ± 0.0
6.6 ± 0.033.3 ± 0.19.5 ± 0.09.4 ± 0.09.9 ± 0.010.1 ± 0.0
7.4 ± 0.014.6 ± 0.010.5 ± 0.010.5 ± 0.010.9 ± 0.011.0 ± 0.0
7.8 ± 0.07.5 ± 0.011.1 ± 0.011.1 ± 0.011.4 ± 0.011.5 ± 0.0

real_conflict_probability = 0.1

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.4 ± 0.00.4 ± 0.00.7 ± 0.11.2 ± 0.1
0.5 ± 0.0100.0 ± 0.00.8 ± 0.00.8 ± 0.01.2 ± 0.01.7 ± 0.1
1.0 ± 0.0100.0 ± 0.01.6 ± 0.01.5 ± 0.02.1 ± 0.02.6 ± 0.1
2.0 ± 0.099.6 ± 0.13.0 ± 0.02.9 ± 0.03.7 ± 0.04.3 ± 0.1
4.2 ± 0.085.4 ± 0.66.2 ± 0.06.1 ± 0.07.0 ± 0.07.6 ± 0.1
5.6 ± 0.056.4 ± 0.58.1 ± 0.08.0 ± 0.08.8 ± 0.09.4 ± 0.0
6.5 ± 0.032.5 ± 0.19.3 ± 0.09.3 ± 0.010.0 ± 0.010.4 ± 0.0
7.2 ± 0.014.3 ± 0.010.4 ± 0.010.4 ± 0.011.0 ± 0.011.4 ± 0.0
7.7 ± 0.07.4 ± 0.011.0 ± 0.011.0 ± 0.011.6 ± 0.012.0 ± 0.0

real_conflict_probability = 0.3

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.5 ± 0.00.4 ± 0.01.1 ± 0.01.4 ± 0.1
0.5 ± 0.0100.0 ± 0.01.0 ± 0.00.9 ± 0.01.6 ± 0.12.1 ± 0.2
1.0 ± 0.0100.0 ± 0.01.7 ± 0.01.6 ± 0.02.5 ± 0.13.1 ± 0.2
1.9 ± 0.099.0 ± 0.13.1 ± 0.03.0 ± 0.04.1 ± 0.15.0 ± 0.1
3.9 ± 0.080.2 ± 0.56.0 ± 0.05.8 ± 0.07.1 ± 0.08.0 ± 0.1
5.2 ± 0.052.7 ± 0.27.8 ± 0.07.6 ± 0.08.8 ± 0.09.5 ± 0.0
6.1 ± 0.030.9 ± 0.19.0 ± 0.08.9 ± 0.010.0 ± 0.010.5 ± 0.0
7.0 ± 0.013.8 ± 0.010.2 ± 0.010.1 ± 0.011.0 ± 0.011.6 ± 0.0
7.4 ± 0.07.2 ± 0.010.8 ± 0.010.7 ± 0.011.6 ± 0.012.2 ± 0.0

real_conflict_probability = 0.5

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.6 ± 0.00.5 ± 0.01.2 ± 0.01.5 ± 0.1
0.5 ± 0.0100.0 ± 0.01.0 ± 0.00.9 ± 0.01.8 ± 0.12.4 ± 0.1
1.0 ± 0.0100.0 ± 0.01.8 ± 0.01.7 ± 0.02.8 ± 0.03.5 ± 0.1
1.9 ± 0.098.0 ± 0.23.2 ± 0.13.1 ± 0.04.5 ± 0.15.6 ± 0.2
3.6 ± 0.073.2 ± 0.35.7 ± 0.05.5 ± 0.07.1 ± 0.08.2 ± 0.1
4.7 ± 0.047.5 ± 0.37.3 ± 0.07.1 ± 0.08.5 ± 0.09.4 ± 0.1
5.7 ± 0.028.7 ± 0.28.6 ± 0.08.5 ± 0.09.7 ± 0.010.4 ± 0.0
6.6 ± 0.013.1 ± 0.09.9 ± 0.09.8 ± 0.010.9 ± 0.011.5 ± 0.0
7.1 ± 0.06.9 ± 0.010.6 ± 0.010.5 ± 0.011.6 ± 0.012.1 ± 0.0

Interpretation

  • Low overhead (<10%): System operating efficiently, minimal contention
  • Medium overhead (10-30%): Moderate contention, acceptable performance
  • High overhead (30-50%): High contention, commit protocol becoming significant
  • Very high overhead (>50%): Commit protocol dominates, system saturated

Values shown as mean ± standard deviation across multiple seeds. At saturation, overhead can exceed 50%, meaning more time is spent retrying commits than executing transactions!