Commit Overhead vs Throughput

Commit Overhead vs Throughput

Analysis of commit protocol overhead as percentage of total transaction time.

Overhead = (commit_latency / total_latency) × 100

This represents time spent in retries, exponential backoff, and manifest I/O.

Values shown as mean ± standard deviation across seeds.

num_tables = 1

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.01.3 ± 0.01.2 ± 0.12.6 ± 0.13.4 ± 0.3
0.5 ± 0.0100.0 ± 0.02.0 ± 0.11.8 ± 0.14.0 ± 0.25.4 ± 0.4
1.0 ± 0.099.4 ± 0.23.4 ± 0.12.9 ± 0.16.7 ± 0.39.4 ± 1.0
1.6 ± 0.083.5 ± 0.75.3 ± 0.04.6 ± 0.010.4 ± 0.113.3 ± 0.1
2.0 ± 0.041.4 ± 0.36.3 ± 0.15.6 ± 0.111.9 ± 0.214.4 ± 0.2
2.2 ± 0.022.3 ± 0.26.9 ± 0.06.2 ± 0.112.6 ± 0.114.9 ± 0.1
2.3 ± 0.011.6 ± 0.07.1 ± 0.16.4 ± 0.112.7 ± 0.114.9 ± 0.1
2.4 ± 0.04.8 ± 0.07.2 ± 0.06.6 ± 0.012.9 ± 0.115.2 ± 0.2
2.5 ± 0.02.4 ± 0.07.3 ± 0.06.7 ± 0.112.9 ± 0.115.0 ± 0.1

num_tables = 5

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.01.0 ± 0.00.8 ± 0.12.4 ± 0.12.7 ± 0.1
0.5 ± 0.0100.0 ± 0.01.7 ± 0.01.5 ± 0.02.9 ± 0.03.6 ± 0.3
1.0 ± 0.0100.0 ± 0.02.5 ± 0.02.4 ± 0.04.0 ± 0.14.9 ± 0.1
2.0 ± 0.0100.0 ± 0.04.1 ± 0.03.9 ± 0.16.1 ± 0.17.3 ± 0.1
4.9 ± 0.099.3 ± 0.19.0 ± 0.18.6 ± 0.012.2 ± 0.114.5 ± 0.1
7.8 ± 0.078.1 ± 0.414.0 ± 0.013.5 ± 0.118.6 ± 0.120.8 ± 0.1
8.8 ± 0.044.3 ± 0.215.7 ± 0.015.2 ± 0.020.4 ± 0.122.4 ± 0.1
9.9 ± 0.019.6 ± 0.117.5 ± 0.017.0 ± 0.022.3 ± 0.024.0 ± 0.0
10.2 ± 0.09.9 ± 0.018.0 ± 0.017.5 ± 0.022.8 ± 0.024.4 ± 0.0

num_tables = 20

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.01.0 ± 0.00.7 ± 0.02.4 ± 0.02.6 ± 0.1
0.5 ± 0.0100.0 ± 0.01.2 ± 0.01.0 ± 0.02.7 ± 0.13.1 ± 0.1
1.0 ± 0.0100.0 ± 0.02.0 ± 0.11.9 ± 0.13.4 ± 0.13.9 ± 0.1
2.0 ± 0.0100.0 ± 0.03.6 ± 0.13.5 ± 0.15.1 ± 0.16.0 ± 0.1
4.9 ± 0.0100.0 ± 0.08.1 ± 0.07.9 ± 0.110.1 ± 0.111.1 ± 0.1
9.9 ± 0.1100.0 ± 0.015.4 ± 0.115.2 ± 0.117.9 ± 0.119.2 ± 0.1
18.6 ± 0.094.7 ± 0.128.3 ± 0.028.0 ± 0.031.6 ± 0.033.2 ± 0.0
24.1 ± 0.048.3 ± 0.136.5 ± 0.036.3 ± 0.039.8 ± 0.040.9 ± 0.0
25.7 ± 0.125.1 ± 0.138.8 ± 0.038.6 ± 0.041.9 ± 0.042.9 ± 0.0

num_tables = 50

Throughput (c/s)Success Rate (%)Mean Overhead (%)P50 Overhead (%)P95 Overhead (%)P99 Overhead (%)
0.2 ± 0.0100.0 ± 0.01.1 ± 0.01.0 ± 0.12.4 ± 0.02.7 ± 0.1
0.5 ± 0.0100.0 ± 0.01.2 ± 0.01.0 ± 0.02.8 ± 0.03.1 ± 0.0
1.0 ± 0.0100.0 ± 0.01.7 ± 0.01.7 ± 0.03.4 ± 0.13.8 ± 0.1
2.0 ± 0.0100.0 ± 0.02.9 ± 0.03.1 ± 0.04.7 ± 0.05.3 ± 0.1
4.9 ± 0.0100.0 ± 0.07.5 ± 0.17.5 ± 0.09.3 ± 0.010.3 ± 0.1
9.9 ± 0.1100.0 ± 0.014.8 ± 0.114.6 ± 0.116.8 ± 0.117.8 ± 0.2
19.7 ± 0.299.9 ± 0.028.7 ± 0.228.5 ± 0.131.1 ± 0.232.4 ± 0.2
33.8 ± 0.168.5 ± 0.249.2 ± 0.149.1 ± 0.151.5 ± 0.152.3 ± 0.1
36.5 ± 0.036.2 ± 0.153.3 ± 0.053.2 ± 0.055.3 ± 0.055.8 ± 0.0

Interpretation

  • Low overhead (<10%): System operating efficiently, minimal contention
  • Medium overhead (10-30%): Moderate contention, acceptable performance
  • High overhead (30-50%): High contention, commit protocol becoming significant
  • Very high overhead (>50%): Commit protocol dominates, system saturated

Values shown as mean ± standard deviation across multiple seeds. At saturation, overhead can exceed 50%, meaning more time is spent retrying commits than executing transactions!