Commit Overhead vs Throughput

Commit Overhead vs Throughput

Analysis of commit protocol overhead as percentage of total transaction time.

Overhead = (commit_latency / total_latency) × 100

This represents time spent in retries, exponential backoff, and manifest I/O.

Values shown as mean ± standard deviation across seeds.

num_tables = 1

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.6 ± 0.00.6 ± 0.01.1 ± 0.01.3 ± 0.1
0.5 ± 0.0100.0 ± 0.01.1 ± 0.01.0 ± 0.01.6 ± 0.11.9 ± 0.1
1.0 ± 0.0100.0 ± 0.01.8 ± 0.01.7 ± 0.02.5 ± 0.02.9 ± 0.1
2.0 ± 0.0100.0 ± 0.03.3 ± 0.13.2 ± 0.14.2 ± 0.14.8 ± 0.2
4.5 ± 0.091.6 ± 0.87.1 ± 0.06.9 ± 0.08.7 ± 0.09.6 ± 0.0
5.5 ± 0.056.0 ± 0.48.7 ± 0.08.5 ± 0.010.4 ± 0.011.2 ± 0.0
6.2 ± 0.031.2 ± 0.29.7 ± 0.09.5 ± 0.011.4 ± 0.012.2 ± 0.0
6.8 ± 0.013.4 ± 0.010.6 ± 0.010.4 ± 0.012.3 ± 0.012.9 ± 0.0
7.0 ± 0.06.7 ± 0.010.9 ± 0.010.7 ± 0.012.5 ± 0.013.2 ± 0.0

num_tables = 5

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.5 ± 0.00.5 ± 0.01.0 ± 0.01.1 ± 0.0
0.5 ± 0.0100.0 ± 0.01.0 ± 0.00.9 ± 0.01.5 ± 0.01.7 ± 0.0
1.0 ± 0.0100.0 ± 0.01.7 ± 0.01.6 ± 0.02.3 ± 0.02.5 ± 0.0
2.0 ± 0.0100.0 ± 0.03.1 ± 0.13.0 ± 0.13.8 ± 0.14.1 ± 0.0
4.9 ± 0.1100.0 ± 0.07.3 ± 0.17.2 ± 0.18.2 ± 0.18.7 ± 0.2
9.9 ± 0.199.9 ± 0.014.3 ± 0.114.2 ± 0.215.5 ± 0.216.1 ± 0.2
17.8 ± 0.189.9 ± 0.425.6 ± 0.125.4 ± 0.126.8 ± 0.127.4 ± 0.1
22.0 ± 0.044.1 ± 0.131.4 ± 0.031.4 ± 0.032.6 ± 0.033.0 ± 0.0
23.4 ± 0.122.8 ± 0.133.4 ± 0.033.3 ± 0.034.4 ± 0.034.8 ± 0.0

num_tables = 20

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.5 ± 0.00.4 ± 0.01.0 ± 0.01.1 ± 0.0
0.5 ± 0.0100.0 ± 0.00.7 ± 0.00.8 ± 0.01.4 ± 0.01.6 ± 0.1
1.0 ± 0.0100.0 ± 0.01.4 ± 0.01.5 ± 0.02.1 ± 0.12.4 ± 0.1
2.0 ± 0.0100.0 ± 0.02.9 ± 0.02.9 ± 0.03.6 ± 0.04.0 ± 0.0
4.9 ± 0.0100.0 ± 0.07.1 ± 0.17.1 ± 0.18.0 ± 0.18.4 ± 0.2
9.9 ± 0.0100.0 ± 0.014.0 ± 0.114.0 ± 0.115.0 ± 0.115.5 ± 0.1
19.7 ± 0.1100.0 ± 0.027.8 ± 0.127.7 ± 0.128.9 ± 0.229.5 ± 0.3
33.4 ± 0.067.7 ± 0.146.9 ± 0.046.9 ± 0.047.7 ± 0.048.0 ± 0.0
36.2 ± 0.035.9 ± 0.050.9 ± 0.050.9 ± 0.051.6 ± 0.051.8 ± 0.0

num_tables = 50

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.00.5 ± 0.00.5 ± 0.01.0 ± 0.01.1 ± 0.1
0.5 ± 0.0100.0 ± 0.00.7 ± 0.00.8 ± 0.01.4 ± 0.01.6 ± 0.0
1.0 ± 0.0100.0 ± 0.01.2 ± 0.01.5 ± 0.02.1 ± 0.12.4 ± 0.1
2.0 ± 0.1100.0 ± 0.02.3 ± 0.12.8 ± 0.13.4 ± 0.13.8 ± 0.1
4.9 ± 0.1100.0 ± 0.06.8 ± 0.16.9 ± 0.17.7 ± 0.18.2 ± 0.1
9.9 ± 0.1100.0 ± 0.013.7 ± 0.113.8 ± 0.114.8 ± 0.115.3 ± 0.1
19.6 ± 0.1100.0 ± 0.027.3 ± 0.127.3 ± 0.128.4 ± 0.229.0 ± 0.2
37.8 ± 0.177.2 ± 0.252.6 ± 0.052.5 ± 0.053.3 ± 0.153.6 ± 0.1
41.8 ± 0.041.9 ± 0.058.1 ± 0.058.1 ± 0.058.7 ± 0.058.9 ± 0.0

Interpretation

  • Low overhead (<10%): System operating efficiently, minimal contention
  • Medium overhead (10-30%): Moderate contention, acceptable performance
  • High overhead (30-50%): High contention, commit protocol becoming significant
  • Very high overhead (>50%): Commit protocol dominates, system saturated

Values shown as mean ± standard deviation across multiple seeds. At saturation, overhead can exceed 50%, meaning more time is spent retrying commits than executing transactions!