Commit Overhead vs Throughput

Commit Overhead vs Throughput

Analysis of commit protocol overhead as percentage of total transaction time.

Overhead = (commit_latency / total_latency) × 100

This represents time spent in retries, exponential backoff, and manifest I/O.

Values shown as mean ± standard deviation across seeds.

real_conflict_probability = 0.0

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.3 ± 0.00.3 ± 0.00.5 ± 0.00.7 ± 0.0
0.5 ± 0.0100.0 ± 0.00.6 ± 0.00.7 ± 0.01.0 ± 0.01.1 ± 0.0
1.0 ± 0.0100.0 ± 0.01.2 ± 0.11.3 ± 0.01.7 ± 0.11.9 ± 0.1
2.0 ± 0.0100.0 ± 0.02.7 ± 0.02.8 ± 0.03.2 ± 0.13.4 ± 0.1
4.9 ± 0.1100.0 ± 0.06.8 ± 0.16.8 ± 0.17.4 ± 0.17.7 ± 0.1
9.8 ± 0.1100.0 ± 0.013.6 ± 0.113.6 ± 0.114.3 ± 0.114.6 ± 0.1
19.7 ± 0.2100.0 ± 0.027.2 ± 0.227.2 ± 0.328.0 ± 0.228.5 ± 0.1
35.8 ± 0.072.9 ± 0.249.5 ± 0.049.4 ± 0.049.8 ± 0.050.0 ± 0.0
39.3 ± 0.039.2 ± 0.154.2 ± 0.054.2 ± 0.054.5 ± 0.054.6 ± 0.0

real_conflict_probability = 0.1

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.3 ± 0.00.3 ± 0.00.6 ± 0.01.0 ± 0.1
0.5 ± 0.0100.0 ± 0.00.6 ± 0.00.7 ± 0.01.1 ± 0.01.4 ± 0.1
1.0 ± 0.0100.0 ± 0.01.2 ± 0.01.4 ± 0.01.8 ± 0.12.2 ± 0.1
2.0 ± 0.0100.0 ± 0.02.7 ± 0.12.7 ± 0.13.3 ± 0.03.6 ± 0.0
4.9 ± 0.1100.0 ± 0.06.9 ± 0.16.9 ± 0.27.5 ± 0.27.9 ± 0.2
9.9 ± 0.1100.0 ± 0.013.7 ± 0.113.7 ± 0.114.5 ± 0.115.0 ± 0.1
19.8 ± 0.1100.0 ± 0.027.3 ± 0.127.4 ± 0.128.3 ± 0.128.8 ± 0.2
35.4 ± 0.171.9 ± 0.148.9 ± 0.048.9 ± 0.049.5 ± 0.049.8 ± 0.0
38.7 ± 0.038.6 ± 0.153.6 ± 0.053.6 ± 0.054.1 ± 0.054.4 ± 0.0

real_conflict_probability = 0.3

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.3 ± 0.00.3 ± 0.00.9 ± 0.11.3 ± 0.1
0.5 ± 0.0100.0 ± 0.00.6 ± 0.00.7 ± 0.01.3 ± 0.11.6 ± 0.1
1.0 ± 0.0100.0 ± 0.01.3 ± 0.01.4 ± 0.02.0 ± 0.02.4 ± 0.0
2.0 ± 0.0100.0 ± 0.02.8 ± 0.02.8 ± 0.03.5 ± 0.13.9 ± 0.1
4.9 ± 0.0100.0 ± 0.07.0 ± 0.06.9 ± 0.07.8 ± 0.18.3 ± 0.1
9.8 ± 0.0100.0 ± 0.013.8 ± 0.113.7 ± 0.014.8 ± 0.115.4 ± 0.1
19.6 ± 0.2100.0 ± 0.027.4 ± 0.227.3 ± 0.228.5 ± 0.329.1 ± 0.3
34.3 ± 0.169.5 ± 0.247.8 ± 0.047.7 ± 0.048.6 ± 0.049.1 ± 0.0
37.6 ± 0.037.4 ± 0.152.3 ± 0.052.3 ± 0.053.1 ± 0.053.5 ± 0.0

real_conflict_probability = 0.5

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.4 ± 0.00.3 ± 0.01.1 ± 0.01.4 ± 0.1
0.5 ± 0.0100.0 ± 0.00.7 ± 0.00.8 ± 0.01.5 ± 0.11.8 ± 0.1
1.0 ± 0.0100.0 ± 0.01.4 ± 0.01.5 ± 0.02.1 ± 0.02.5 ± 0.0
2.0 ± 0.0100.0 ± 0.02.9 ± 0.12.9 ± 0.13.6 ± 0.14.1 ± 0.1
4.9 ± 0.1100.0 ± 0.07.1 ± 0.17.0 ± 0.18.0 ± 0.18.6 ± 0.1
9.9 ± 0.0100.0 ± 0.014.0 ± 0.113.9 ± 0.115.1 ± 0.115.8 ± 0.1
19.6 ± 0.199.9 ± 0.027.6 ± 0.127.5 ± 0.128.9 ± 0.129.7 ± 0.1
33.1 ± 0.067.2 ± 0.246.5 ± 0.046.4 ± 0.047.6 ± 0.048.1 ± 0.0
36.2 ± 0.036.0 ± 0.150.9 ± 0.050.8 ± 0.051.8 ± 0.052.3 ± 0.0

Interpretation

  • Low overhead (<10%): System operating efficiently, minimal contention
  • Medium overhead (10-30%): Moderate contention, acceptable performance
  • High overhead (30-50%): High contention, commit protocol becoming significant
  • Very high overhead (>50%): Commit protocol dominates, system saturated

Values shown as mean ± standard deviation across multiple seeds. At saturation, overhead can exceed 50%, meaning more time is spent retrying commits than executing transactions!