Commit Overhead vs Throughput

Commit Overhead vs Throughput

Analysis of commit protocol overhead as percentage of total transaction time.

Overhead = (commit_latency / total_latency) × 100

This represents time spent in retries, exponential backoff, and manifest I/O.

Values shown as mean ± standard deviation across seeds.

real_conflict_probability = 0.0

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.3 ± 0.00.3 ± 0.00.5 ± 0.00.7 ± 0.0
0.5 ± 0.0100.0 ± 0.00.7 ± 0.00.7 ± 0.01.0 ± 0.01.2 ± 0.1
1.0 ± 0.0100.0 ± 0.01.4 ± 0.01.4 ± 0.01.8 ± 0.02.0 ± 0.0
2.0 ± 0.0100.0 ± 0.02.8 ± 0.02.8 ± 0.03.2 ± 0.03.4 ± 0.0
4.9 ± 0.0100.0 ± 0.06.9 ± 0.06.9 ± 0.07.5 ± 0.17.8 ± 0.1
9.8 ± 0.099.8 ± 0.013.7 ± 0.013.7 ± 0.114.5 ± 0.115.0 ± 0.1
16.7 ± 0.084.5 ± 0.323.4 ± 0.123.3 ± 0.124.1 ± 0.124.5 ± 0.1
20.4 ± 0.040.9 ± 0.228.7 ± 0.028.6 ± 0.029.3 ± 0.029.7 ± 0.0
21.7 ± 0.021.2 ± 0.030.6 ± 0.030.5 ± 0.031.2 ± 0.031.5 ± 0.0

real_conflict_probability = 0.1

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.3 ± 0.00.3 ± 0.00.6 ± 0.11.0 ± 0.1
0.5 ± 0.0100.0 ± 0.00.7 ± 0.00.8 ± 0.01.1 ± 0.01.5 ± 0.1
1.0 ± 0.0100.0 ± 0.01.5 ± 0.01.5 ± 0.01.9 ± 0.02.3 ± 0.1
1.9 ± 0.0100.0 ± 0.02.8 ± 0.12.8 ± 0.13.3 ± 0.13.7 ± 0.1
5.0 ± 0.1100.0 ± 0.07.0 ± 0.16.9 ± 0.17.7 ± 0.18.2 ± 0.0
9.8 ± 0.199.6 ± 0.113.8 ± 0.113.8 ± 0.114.7 ± 0.115.3 ± 0.1
16.4 ± 0.182.9 ± 0.123.1 ± 0.123.0 ± 0.024.0 ± 0.124.7 ± 0.1
20.1 ± 0.040.1 ± 0.128.3 ± 0.028.3 ± 0.029.2 ± 0.029.7 ± 0.0
21.4 ± 0.020.9 ± 0.030.2 ± 0.030.2 ± 0.031.0 ± 0.031.5 ± 0.0

real_conflict_probability = 0.3

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.3 ± 0.00.3 ± 0.00.8 ± 0.11.2 ± 0.1
0.5 ± 0.0100.0 ± 0.00.7 ± 0.00.8 ± 0.01.3 ± 0.01.7 ± 0.1
1.0 ± 0.0100.0 ± 0.01.5 ± 0.01.5 ± 0.02.2 ± 0.02.6 ± 0.1
1.9 ± 0.1100.0 ± 0.02.9 ± 0.12.8 ± 0.13.6 ± 0.14.1 ± 0.1
4.9 ± 0.0100.0 ± 0.07.1 ± 0.17.0 ± 0.18.0 ± 0.18.6 ± 0.1
9.9 ± 0.199.3 ± 0.114.0 ± 0.113.9 ± 0.115.1 ± 0.115.9 ± 0.1
15.9 ± 0.179.9 ± 0.222.6 ± 0.122.4 ± 0.123.8 ± 0.124.6 ± 0.1
19.3 ± 0.038.6 ± 0.227.5 ± 0.027.4 ± 0.028.6 ± 0.029.3 ± 0.0
20.7 ± 0.020.2 ± 0.029.5 ± 0.029.4 ± 0.030.5 ± 0.031.1 ± 0.0

real_conflict_probability = 0.5

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.4 ± 0.00.3 ± 0.01.1 ± 0.01.4 ± 0.1
0.5 ± 0.0100.0 ± 0.00.8 ± 0.00.8 ± 0.01.5 ± 0.01.8 ± 0.1
1.0 ± 0.0100.0 ± 0.01.6 ± 0.01.5 ± 0.02.3 ± 0.02.7 ± 0.1
2.0 ± 0.0100.0 ± 0.03.0 ± 0.12.9 ± 0.03.8 ± 0.14.3 ± 0.1
4.9 ± 0.1100.0 ± 0.07.2 ± 0.17.1 ± 0.18.2 ± 0.19.0 ± 0.1
9.7 ± 0.098.9 ± 0.014.1 ± 0.113.9 ± 0.115.3 ± 0.116.3 ± 0.1
15.2 ± 0.076.8 ± 0.221.9 ± 0.021.7 ± 0.023.4 ± 0.024.4 ± 0.1
18.4 ± 0.036.7 ± 0.126.5 ± 0.026.4 ± 0.027.8 ± 0.028.6 ± 0.0
19.9 ± 0.019.3 ± 0.028.6 ± 0.028.4 ± 0.029.8 ± 0.030.4 ± 0.0

Interpretation

  • Low overhead (<10%): System operating efficiently, minimal contention
  • Medium overhead (10-30%): Moderate contention, acceptable performance
  • High overhead (30-50%): High contention, commit protocol becoming significant
  • Very high overhead (>50%): Commit protocol dominates, system saturated

Values shown as mean ± standard deviation across multiple seeds. At saturation, overhead can exceed 50%, meaning more time is spent retrying commits than executing transactions!