๐ Cross-Version Performance History
Historical performance across minor releases. Each data point is the latest patchlevel of a minor version, benchmarked against the current performance test sites. This provides like-for-like comparisons: only the binary changes, not the workload.
Sites that fail with an older binary are dropped from that version's results (new features or changed config syntax may make a site incompatible with older versions). When no sites succeed for a version, the history stops there. A value of 0 indicates the site was not compatible with that version.
Simple Site โ All Versions
xychart
x-axis [0.201.11, 0.202.58, 0.203.61, 0.204.97, 0.205.8, 0.206.0, 0.207.91, 0.208.76, 0.209.18, 0.211.1, 0.212.8, 0.213.3, 0.214.16, 0.217.67, 0.218.26, 0.219.30, 0.220.18, 0.221.73, 0.222.1, 0.223.55, 0.224.85, 0.225.8, 0.226.6, 0.229.7, 0.230.6, 0.232.1, 0.233.1, 0.234.9, 0.238.29, 0.239.62, 0.240.117, 0.241.635, 0.242.101, 0.243.0, 0.244.25]
y-axis "Time (ms)" 0 --> 10
line [9.18, 9.03, 6.95, 6.94, 6.97, 7.12, 6.81, 6.64, 6.45, 6.84, 6.63, 6.74, 6.43, 6.83, 6.43, 6.88, 6.77, 6.76, 6.47, 6.63, 5.76, 5.75, 5.92, 5.90, 5.83, 5.92, 5.94, 5.90, 6.01, 6.08, 5.92, 6.19, 5.97, 6.05, 6.05]
๐ Complex Sites โ Normalized Performance (1x)
Each line shows per-site performance relative to its own starting point in each era (first non-zero data point = 1.0). Values below 1.0 are faster; above 1.0 are slower. Sites not available in an era are shown at 0. The dramatic improvement at 0.230 prompted splitting into separate eras for readability.
Era 1 โ Before 0.230 (normalized)
xychart
x-axis [0.201.11, 0.202.58, 0.203.61, 0.204.97, 0.205.8, 0.206.0, 0.207.91, 0.208.76, 0.209.18, 0.211.1, 0.212.8, 0.213.3, 0.214.16, 0.217.67, 0.218.26, 0.219.30, 0.220.18, 0.221.73, 0.222.1, 0.223.55, 0.224.85, 0.225.8, 0.226.6, 0.229.7]
y-axis "Relative to first (1.0 = baseline)" 0 --> 10
line [1.00, 1.13, 0.63, 0.61, 0.60, 0.62, 0.60, 0.51, 0.51, 0.52, 0.52, 0.52, 0.48, 0.50, 0.50, 0.52, 0.49, 0.51, 0.49, 0.49, 0.39, 0.39, 0.43, 0.43]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 1.06, 1.07, 1.14, 1.21]
line [1.00, 2.22, 0.99, 1.04, 0.92, 1.17, 0.64, 0.76, 0.69, 0.92, 0.87, 0.87, 0.58, 0.67, 0.71, 0.93, 0.70, 0.86, 0.75, 0.69, 0.41, 0.35, 0.41, 0.07]
line [0.00, 1.00, 0.60, 0.59, 0.61, 0.61, 0.61, 0.59, 0.59, 0.59, 0.59, 0.59, 0.60, 0.59, 0.60, 0.61, 0.61, 0.60, 0.60, 0.60, 0.52, 0.52, 0.52, 0.52]
line [1.00, 1.05, 0.58, 0.56, 0.55, 0.57, 0.56, 0.45, 0.45, 0.44, 0.44, 0.44, 0.42, 0.43, 0.43, 0.44, 0.42, 0.43, 0.41, 0.42, 0.37, 0.37, 0.40, 0.39]
line [1.00, 1.13, 0.69, 0.75, 0.64, 0.87, 0.64, 0.78, 0.72, 0.94, 0.89, 0.89, 0.61, 0.67, 0.73, 0.95, 0.73, 0.88, 0.77, 0.71, 0.38, 0.33, 0.38, 0.06]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 0.84, 0.83, 0.85, 1.00]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 0.91, 0.89, 0.90, 0.89, 0.89, 0.91, 0.93, 0.90, 0.97, 0.82, 0.87, 0.82, 0.86, 8.80, 8.03, 8.80, 8.78]
line [1.00, 1.00, 0.70, 0.72, 0.67, 0.81, 0.68, 0.77, 0.73, 0.88, 0.84, 0.84, 0.69, 0.71, 0.95, 1.03, 0.93, 0.81, 0.82, 0.79, 0.47, 0.52, 0.47, 0.47]
line [1.00, 0.98, 0.69, 0.70, 0.65, 0.79, 0.66, 0.73, 0.68, 0.82, 0.81, 0.80, 0.65, 0.69, 0.71, 0.85, 0.71, 0.81, 0.79, 0.78, 0.45, 0.42, 0.45, 0.19]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 0.73, 0.78, 0.71, 0.74]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 1.03, 1.03, 0.96]
line [1.00, 1.24, 0.65, 0.68, 0.70, 0.72, 0.70, 0.60, 0.60, 0.58, 0.57, 0.57, 0.33, 0.33, 0.35, 0.35, 0.34, 0.35, 0.33, 0.33, 0.29, 0.29, 0.29, 0.36]
line [1.00, 1.26, 0.68, 0.71, 0.71, 0.72, 0.71, 0.61, 0.60, 0.58, 0.57, 0.57, 0.43, 0.43, 0.44, 0.45, 0.44, 0.44, 0.43, 0.43, 0.36, 0.36, 0.36, 0.42]
line [1.00, 1.27, 0.69, 0.72, 0.77, 0.75, 0.72, 0.63, 0.62, 0.59, 0.59, 0.59, 0.33, 0.33, 0.34, 0.35, 0.34, 0.35, 0.34, 0.34, 0.30, 0.30, 0.30, 0.38]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 0.90, 0.89, 0.95, 0.97]
line [1.00, 1.15, 0.81, 0.92, 0.76, 1.05, 0.76, 0.95, 0.86, 1.16, 1.10, 1.09, 0.75, 0.83, 0.88, 1.18, 0.87, 1.01, 0.95, 0.88, 0.07, 0.06, 0.06, 0.03]
line [1.00, 1.50, 1.11, 1.16, 1.09, 1.23, 0.96, 0.86, 0.84, 0.93, 0.91, 0.93, 0.79, 0.77, 0.83, 0.91, 0.74, 0.74, 0.70, 0.66, 0.31, 0.31, 0.31, 0.41]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 0.99, 1.04, 1.09]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 1.08, 1.09]
line [1.00, 1.00, 0.52, 0.52, 0.50, 0.53, 0.54, 0.46, 0.45, 0.45, 0.44, 0.44, 0.38, 0.39, 0.41, 0.42, 0.41, 0.41, 0.39, 0.39, 0.31, 0.31, 0.31, 0.32]
line [1.00, 1.65, 1.19, 1.22, 1.19, 1.27, 1.05, 0.84, 0.83, 0.84, 0.84, 0.86, 0.79, 0.70, 0.74, 0.75, 0.63, 0.61, 0.59, 0.58, 0.35, 0.35, 0.36, 0.39]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00]
Era 2 โ 0.230 Onward (normalized)
xychart
x-axis [0.230.6, 0.232.1, 0.233.1, 0.234.9, 0.238.29, 0.239.62, 0.240.117, 0.241.635, 0.242.101, 0.243.0, 0.244.25]
y-axis "Relative to first (1.0 = baseline)" 0 --> 2
line [1.00, 1.01, 1.01, 1.01, 1.02, 1.04, 1.00, 1.05, 1.00, 1.01, 1.00]
line [1.00, 1.01, 1.01, 1.01, 1.03, 1.05, 1.00, 1.01, 0.99, 1.07, 1.14]
line [1.00, 1.00, 1.00, 1.01, 1.05, 1.05, 1.04, 1.00, 1.04, 1.03, 1.03]
line [1.00, 1.00, 1.01, 1.03, 1.01, 1.03, 1.03, 1.03, 1.01, 0.99, 1.01]
line [1.00, 1.00, 1.02, 1.01, 1.02, 1.03, 1.01, 1.03, 1.01, 1.03, 1.02]
line [1.00, 1.00, 1.02, 1.01, 1.05, 1.04, 1.01, 0.96, 0.98, 1.03, 1.00]
line [1.00, 1.02, 1.01, 1.01, 0.92, 0.92, 0.88, 0.82, 0.90, 0.91, 0.93]
line [1.00, 1.09, 1.00, 1.00, 1.13, 1.14, 1.02, 0.87, 1.10, 1.14, 1.21]
line [1.00, 1.03, 1.01, 1.00, 1.08, 1.07, 1.07, 0.95, 1.05, 1.07, 1.07]
line [1.00, 0.99, 1.00, 0.99, 1.05, 1.07, 1.05, 0.83, 0.98, 1.00, 1.02]
line [1.00, 1.01, 1.00, 1.00, 1.04, 1.08, 1.05, 1.04, 1.04, 1.04, 1.08]
line [1.00, 1.01, 1.00, 1.01, 1.03, 1.02, 0.99, 0.97, 0.99, 1.01, 1.00]
line [1.00, 1.00, 1.00, 1.00, 0.84, 0.84, 0.83, 0.82, 0.81, 0.81, 0.80]
line [1.00, 0.99, 1.00, 1.00, 0.89, 0.90, 0.88, 0.88, 0.85, 0.87, 0.85]
line [1.00, 1.00, 1.00, 1.00, 0.83, 0.83, 0.81, 0.81, 0.80, 0.81, 0.79]
line [1.00, 1.01, 0.99, 1.00, 1.00, 1.01, 0.98, 1.01, 1.00, 1.01, 1.00]
line [1.00, 1.02, 1.00, 1.01, 1.03, 1.05, 1.01, 0.83, 1.00, 1.02, 1.03]
line [1.00, 1.03, 1.00, 1.02, 0.87, 0.88, 0.86, 0.86, 0.86, 0.87, 0.88]
line [1.00, 1.01, 1.01, 1.00, 1.01, 1.02, 0.99, 0.97, 0.99, 1.00, 0.99]
line [1.00, 1.00, 1.01, 1.01, 1.02, 1.03, 1.00, 0.99, 0.99, 1.00, 0.99]
line [1.00, 1.00, 0.99, 1.01, 1.03, 1.04, 1.00, 0.95, 1.01, 1.02, 1.01]
line [1.00, 1.03, 1.01, 1.03, 1.01, 1.04, 1.01, 0.98, 1.03, 1.04, 1.05]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 1.09, 1.10, 1.10]
Era 3 โ 1.x (coming soon)
Data will appear here when 1.x versions are benchmarked.
๐ Performance by Version and Site
Median deploy time (ms) for each benchmark site across minor versions. A dash (โ) indicates the site was not compatible with that version.
| Site | 0.201.11 | 0.202.58 | 0.203.61 | 0.204.97 | 0.205.8 | 0.206.0 | 0.207.91 | 0.208.76 | 0.209.18 | 0.211.1 | 0.212.8 | 0.213.3 | 0.214.16 | 0.217.67 | 0.218.26 | 0.219.30 | 0.220.18 | 0.221.73 | 0.222.1 | 0.223.55 | 0.224.85 | 0.225.8 | 0.226.6 | 0.229.7 | 0.230.6 | 0.232.1 | 0.233.1 | 0.234.9 | 0.238.29 | 0.239.62 | 0.240.117 | 0.241.635 | 0.242.101 | 0.243.0 | 0.244.25 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Performance Test | 9.2 | 9.0 | 7.0 | 6.9 | 7.0 | 7.1 | 6.8 | 6.6 | 6.5 | 6.8 | 6.6 | 6.7 | 6.4 | 6.8 | 6.4 | 6.9 | 6.8 | 6.8 | 6.5 | 6.6 | 5.8 | 5.8 | 5.9 | 5.9 | 5.8 | 5.9 | 5.9 | 5.9 | 6.0 | 6.1 | 5.9 | 6.2 | 6.0 | 6.0 | 6.0 |
| Big Bad Html | 132.1 | 149.3 | 83.4 | 80.3 | 79.2 | 82.5 | 79.5 | 67.2 | 67.5 | 69.0 | 68.0 | 68.2 | 63.8 | 65.5 | 66.0 | 68.5 | 65.2 | 67.1 | 64.7 | 64.6 | 52.0 | 51.4 | 56.2 | 56.5 | 56.2 | 56.7 | 56.7 | 56.6 | 57.3 | 58.3 | 56.4 | 58.8 | 56.5 | 57.0 | 56.0 |
| Builtin Sources | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | 45.9 | 48.9 | 49.0 | 52.5 | 55.6 | 55.1 | 55.9 | 55.9 | 55.6 | 56.9 | 57.8 | 55.2 | 55.9 | 54.9 | 59.1 | 62.6 |
| Chain Reaction | 815.3 | 1807.6 | 805.0 | 845.5 | 748.7 | 951.0 | 523.0 | 618.3 | 566.5 | 750.6 | 709.2 | 713.3 | 475.6 | 546.0 | 579.0 | 760.1 | 574.2 | 705.2 | 609.7 | 564.7 | 333.5 | 288.5 | 336.0 | 57.6 | 56.3 | 56.4 | 56.5 | 56.7 | 59.2 | 59.2 | 58.3 | 56.1 | 58.3 | 58.1 | 57.9 |
| Checksum Copy | โ | 111.4 | 67.3 | 65.9 | 67.8 | 67.5 | 67.8 | 66.0 | 65.7 | 65.9 | 65.7 | 65.3 | 66.5 | 65.7 | 66.3 | 68.0 | 67.7 | 66.7 | 66.8 | 67.0 | 57.8 | 58.1 | 57.8 | 57.9 | 57.0 | 57.0 | 57.6 | 58.7 | 57.7 | 58.6 | 58.5 | 59.0 | 57.8 | 56.5 | 57.4 |
| Context Resolution | 142.1 | 149.6 | 82.3 | 79.6 | 78.6 | 80.8 | 79.3 | 63.4 | 63.5 | 61.8 | 62.0 | 61.9 | 60.3 | 60.9 | 61.5 | 62.2 | 60.2 | 60.4 | 58.9 | 59.4 | 53.0 | 52.5 | 56.7 | 55.9 | 55.7 | 55.9 | 56.5 | 56.0 | 56.7 | 57.5 | 56.3 | 57.2 | 56.2 | 57.1 | 56.6 |
| Deep Pipeline | 1005.2 | 1138.6 | 693.4 | 752.9 | 644.9 | 875.8 | 642.2 | 779.5 | 719.8 | 947.9 | 891.3 | 894.5 | 613.7 | 677.8 | 734.4 | 958.7 | 729.1 | 888.0 | 770.3 | 714.0 | 384.4 | 331.6 | 386.3 | 57.2 | 56.5 | 56.7 | 57.4 | 56.8 | 59.2 | 58.7 | 57.2 | 54.0 | 55.3 | 58.4 | 56.4 |
| External Sources | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | 62.8 | 53.0 | 52.2 | 53.1 | 62.5 | 62.3 | 63.7 | 63.2 | 63.1 | 57.1 | 57.4 | 55.1 | 51.4 | 56.3 | 57.0 | 57.8 |
| Inline Templates | โ | โ | โ | โ | โ | โ | 5.8 | 5.3 | 5.2 | 5.3 | 5.2 | 5.2 | 5.3 | 5.5 | 5.3 | 5.7 | 4.8 | 5.1 | 4.8 | 5.0 | 51.4 | 46.9 | 51.4 | 51.3 | 50.9 | 55.8 | 50.8 | 51.0 | 57.4 | 57.9 | 51.7 | 44.5 | 55.9 | 58.1 | 61.6 |
| Large Content | 116.1 | 115.9 | 81.6 | 83.5 | 78.2 | 93.5 | 79.3 | 89.1 | 84.3 | 101.6 | 98.0 | 97.8 | 79.6 | 82.6 | 110.5 | 119.9 | 107.7 | 94.5 | 95.2 | 91.4 | 54.8 | 60.1 | 54.1 | 54.5 | 54.0 | 55.7 | 54.2 | 53.9 | 58.4 | 57.5 | 57.6 | 51.2 | 56.6 | 57.6 | 57.5 |
| Large Inline | 307.2 | 301.0 | 212.4 | 216.5 | 200.9 | 241.5 | 203.7 | 225.5 | 208.7 | 253.4 | 248.8 | 247.0 | 198.6 | 213.0 | 218.1 | 261.0 | 217.2 | 249.8 | 244.1 | 238.7 | 139.2 | 127.9 | 137.3 | 57.1 | 57.3 | 56.8 | 57.4 | 56.9 | 59.9 | 61.2 | 59.9 | 47.6 | 55.9 | 57.4 | 58.4 |
| Large Template | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | 75.7 | 55.1 | 59.0 | 54.0 | 55.6 | 55.2 | 55.9 | 55.2 | 55.1 | 57.6 | 59.7 | 57.8 | 57.5 | 57.3 | 57.5 | 59.8 |
| Manipulation | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | 58.1 | 59.8 | 59.8 | 56.0 | 56.3 | 56.9 | 56.1 | 56.6 | 58.1 | 57.7 | 55.5 | 54.6 | 55.5 | 57.0 | 56.2 |
| Many Blocks | 190.6 | 237.0 | 124.7 | 129.1 | 134.4 | 136.6 | 132.8 | 115.2 | 114.0 | 110.4 | 108.1 | 108.6 | 62.6 | 62.1 | 67.0 | 67.5 | 65.6 | 65.9 | 63.3 | 63.6 | 55.4 | 55.4 | 55.8 | 69.1 | 69.3 | 69.0 | 69.2 | 69.5 | 57.9 | 58.4 | 57.5 | 57.1 | 56.0 | 56.4 | 55.5 |
| Many Excerpts | 156.5 | 197.3 | 106.6 | 110.8 | 111.1 | 112.0 | 111.5 | 95.6 | 94.5 | 91.1 | 89.5 | 89.8 | 67.3 | 67.2 | 68.6 | 69.7 | 69.0 | 68.9 | 66.9 | 67.5 | 55.6 | 56.0 | 56.4 | 65.5 | 65.3 | 64.7 | 65.2 | 65.1 | 58.2 | 58.5 | 57.5 | 57.2 | 55.8 | 56.6 | 55.7 |
| Many Files | 186.1 | 236.5 | 127.6 | 133.7 | 142.9 | 139.8 | 134.7 | 117.1 | 116.0 | 110.0 | 109.8 | 110.2 | 61.9 | 61.3 | 64.2 | 64.5 | 63.0 | 64.5 | 63.1 | 62.8 | 56.0 | 55.8 | 56.5 | 70.6 | 70.2 | 70.3 | 70.3 | 70.2 | 58.3 | 58.2 | 56.8 | 56.9 | 56.5 | 56.9 | 55.6 |
| Many Pages | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | 58.1 | 52.1 | 51.9 | 55.1 | 56.3 | 56.8 | 57.2 | 56.5 | 56.8 | 56.8 | 57.1 | 55.9 | 57.4 | 56.7 | 57.3 | 56.8 |
| Many Steps | 1760.7 | 2020.8 | 1434.5 | 1613.1 | 1336.8 | 1850.4 | 1336.3 | 1666.0 | 1516.3 | 2049.4 | 1929.9 | 1918.4 | 1315.5 | 1468.6 | 1549.7 | 2085.6 | 1525.9 | 1775.0 | 1669.6 | 1541.7 | 115.3 | 103.9 | 113.5 | 55.2 | 55.5 | 56.8 | 55.5 | 56.3 | 57.1 | 58.3 | 56.3 | 46.0 | 55.8 | 56.6 | 57.0 |
| Many Variables | 161.5 | 242.8 | 178.9 | 188.0 | 176.5 | 198.5 | 155.6 | 139.4 | 135.9 | 150.2 | 146.4 | 150.0 | 127.2 | 124.7 | 134.1 | 147.3 | 119.8 | 119.2 | 112.5 | 107.2 | 49.7 | 49.9 | 49.9 | 66.9 | 65.8 | 67.7 | 66.0 | 67.4 | 57.2 | 58.2 | 56.4 | 56.3 | 56.5 | 57.0 | 58.2 |
| Mixed Load | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | 53.1 | 52.6 | 55.5 | 58.0 | 57.9 | 58.4 | 58.2 | 57.8 | 58.2 | 59.0 | 57.3 | 56.2 | 57.1 | 57.8 | 57.3 |
| Nested Configs | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | 52.2 | 56.2 | 57.1 | 57.0 | 57.0 | 57.4 | 57.6 | 58.1 | 58.9 | 56.9 | 56.2 | 56.4 | 57.1 | 56.5 |
| Template Generation | 174.6 | 175.0 | 90.3 | 90.4 | 88.0 | 91.9 | 94.0 | 79.5 | 79.0 | 77.8 | 77.4 | 77.4 | 67.0 | 67.9 | 72.3 | 73.9 | 72.1 | 70.8 | 68.4 | 68.7 | 54.6 | 54.0 | 54.4 | 56.3 | 55.8 | 55.9 | 55.4 | 56.2 | 57.4 | 58.1 | 55.8 | 53.2 | 56.1 | 56.8 | 56.5 |
| Token Density | 146.6 | 241.6 | 173.9 | 179.6 | 175.1 | 186.4 | 153.4 | 123.6 | 121.5 | 123.8 | 122.9 | 126.2 | 116.3 | 102.8 | 108.1 | 109.6 | 92.9 | 89.1 | 87.2 | 84.7 | 51.9 | 51.5 | 52.2 | 56.9 | 55.0 | 56.4 | 55.6 | 56.6 | 55.8 | 57.0 | 55.8 | 54.0 | 56.6 | 57.0 | 57.8 |
| Unicode Content | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | โ | 51.2 | 55.9 | 56.3 | 56.2 |
๐ 8x Workload Performance History (Normalized)
Same sites as above, measured at 8x scale โ eight times the workload. Values are normalized so each site's first non-zero data point is 1.0. A value of 0 indicates the site was not compatible with that version or 8x data was not collected.
8x Workload โ Era 1 (normalized)
xychart
x-axis [0.201.11, 0.202.58, 0.203.61, 0.204.97, 0.205.8, 0.206.0, 0.207.91, 0.208.76, 0.209.18, 0.211.1, 0.212.8, 0.213.3, 0.214.16, 0.217.67, 0.218.26, 0.219.30, 0.220.18, 0.221.73, 0.222.1, 0.223.55, 0.224.85, 0.225.8, 0.226.6, 0.229.7]
y-axis "Relative to first (1.0 = baseline)" 0 --> 50
line [1.00, 1.14, 0.65, 0.63, 0.61, 0.65, 0.61, 0.52, 0.52, 0.53, 0.53, 0.53, 0.49, 0.51, 0.51, 0.53, 0.51, 0.52, 0.50, 0.50, 0.40, 0.40, 0.42, 0.36]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 0.96, 0.96, 1.01, 1.06]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.97, 1.01, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.27, 0.23, 0.27, 0.06]
line [0.00, 1.00, 0.59, 0.58, 0.59, 0.59, 0.58, 0.56, 0.57, 0.56, 0.56, 0.56, 0.56, 0.56, 0.58, 0.59, 0.57, 0.59, 0.57, 0.57, 0.48, 0.48, 0.48, 0.49]
line [1.00, 1.06, 0.60, 0.58, 0.57, 0.60, 0.57, 0.49, 0.48, 0.50, 0.48, 0.49, 0.45, 0.46, 0.47, 0.49, 0.46, 0.49, 0.46, 0.45, 0.34, 0.34, 0.36, 0.37]
line [1.00, 1.05, 0.73, 0.80, 0.71, 0.92, 0.72, 0.82, 0.75, 1.04, 0.97, 0.99, 0.70, 0.74, 0.77, 0.99, 0.77, 0.89, 0.82, 0.77, 0.11, 0.10, 0.11, 0.03]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 0.71, 0.70, 0.71, 0.88]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 0.92, 0.86, 0.90, 0.88, 0.86, 0.83, 0.86, 0.85, 0.89, 0.65, 0.66, 0.62, 0.63, 44.25, 39.89, 43.94, 43.72]
line [1.00, 1.00, 0.71, 0.73, 0.70, 0.85, 0.70, 0.79, 0.73, 0.94, 0.87, 0.88, 0.71, 0.72, 0.97, 1.03, 0.97, 0.83, 0.81, 0.80, 0.30, 0.34, 0.31, 0.31]
line [1.00, 0.99, 0.69, 0.70, 0.68, 0.80, 0.70, 0.76, 0.69, 0.89, 0.85, 0.84, 0.69, 0.76, 0.79, 0.90, 0.79, 0.92, 0.89, 0.87, 0.36, 0.34, 0.35, 0.17]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 0.69, 0.74, 0.68, 0.24]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 1.02, 1.03, 0.59]
line [1.00, 1.84, 1.06, 1.10, 1.25, 1.28, 1.16, 1.04, 1.02, 1.00, 0.99, 0.99, 0.33, 0.32, 0.34, 0.35, 0.34, 0.34, 0.33, 0.33, 0.28, 0.28, 0.29, 0.27]
line [1.00, 1.61, 0.91, 0.95, 1.04, 1.05, 0.96, 0.88, 0.87, 0.85, 0.83, 0.82, 0.37, 0.36, 0.38, 0.38, 0.38, 0.38, 0.37, 0.37, 0.29, 0.29, 0.29, 0.38]
line [1.00, 2.04, 1.21, 1.27, 1.48, 1.48, 1.28, 1.21, 1.19, 1.16, 1.15, 1.16, 0.33, 0.33, 0.35, 0.35, 0.34, 0.35, 0.35, 0.34, 0.29, 0.29, 0.29, 0.39]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 0.90, 0.90, 0.96, 0.72]
line [1.00, 1.10, 0.80, 0.91, 0.77, 1.04, 0.76, 0.91, 0.85, 1.14, 1.08, 1.07, 0.74, 0.83, 0.85, 1.15, 0.83, 1.00, 0.92, 0.85, 0.07, 0.07, 0.07, 0.06]
line [0.00, 0.00, 0.00, 1.00, 0.91, 1.13, 0.85, 0.90, 0.84, 1.04, 0.99, 1.10, 0.75, 0.79, 0.88, 1.03, 0.84, 0.90, 0.84, 0.80, 0.13, 0.14, 0.14, 0.19]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 1.00, 0.99, 1.04, 1.11]
line [1.00, 1.01, 0.51, 0.64, 0.62, 0.68, 0.66, 0.60, 0.58, 0.61, 0.60, 0.60, 0.46, 0.48, 0.53, 0.55, 0.53, 0.52, 0.52, 0.50, 0.30, 0.30, 0.30, 0.29]
line [0.00, 0.00, 0.00, 1.00, 0.95, 1.09, 0.88, 0.86, 0.82, 0.95, 0.91, 0.96, 0.74, 0.74, 0.84, 0.91, 0.80, 0.81, 0.79, 0.75, 0.24, 0.24, 0.25, 0.30]
8x Workload โ Era 2 (normalized)
xychart
x-axis [0.230.6, 0.232.1, 0.233.1, 0.234.9, 0.238.29, 0.239.62, 0.240.117, 0.241.635, 0.242.101, 0.243.0, 0.244.25]
y-axis "Relative to first (1.0 = baseline)" 0 --> 2
line [1.00, 0.99, 0.99, 0.99, 0.00, 0.00, 0.00, 0.99, 0.97, 0.96, 0.96]
line [1.00, 1.00, 1.00, 1.00, 0.00, 0.00, 0.00, 0.99, 0.98, 0.99, 0.93]
line [1.00, 1.07, 1.07, 1.07, 0.00, 0.00, 0.00, 0.22, 0.23, 0.23, 0.23]
line [1.00, 1.01, 1.00, 1.01, 0.00, 0.00, 0.00, 1.04, 1.01, 1.01, 1.00]
line [1.00, 1.00, 1.01, 1.00, 0.00, 0.00, 0.00, 0.99, 0.98, 1.00, 1.00]
line [1.00, 1.00, 1.00, 1.00, 0.00, 0.00, 0.00, 0.75, 0.71, 0.72, 0.73]
line [1.00, 1.02, 1.01, 1.01, 0.00, 0.00, 0.00, 0.76, 0.75, 0.85, 0.86]
line [1.00, 1.11, 1.01, 1.01, 0.00, 0.00, 0.00, 0.80, 0.80, 0.49, 0.54]
line [1.00, 1.00, 0.99, 0.99, 0.00, 0.00, 0.00, 1.72, 0.92, 0.49, 0.57]
line [1.00, 0.95, 0.96, 0.96, 0.00, 0.00, 0.00, 1.07, 0.65, 0.47, 0.49]
line [1.00, 0.99, 0.98, 0.96, 0.00, 0.00, 0.00, 1.07, 1.01, 1.17, 1.18]
line [1.00, 0.98, 0.97, 0.97, 0.00, 0.00, 0.00, 0.98, 0.97, 1.52, 1.56]
line [1.00, 0.99, 0.99, 0.99, 0.00, 0.00, 0.00, 0.63, 0.63, 0.62, 0.62]
line [1.00, 0.99, 1.00, 0.99, 0.00, 0.00, 0.00, 0.74, 0.75, 0.73, 0.74]
line [1.00, 1.00, 1.00, 1.01, 0.00, 0.00, 0.00, 0.74, 0.75, 0.72, 0.72]
line [1.00, 1.00, 1.00, 1.00, 0.00, 0.00, 0.00, 1.00, 0.99, 0.99, 0.99]
line [1.00, 1.10, 0.99, 1.04, 0.00, 0.00, 0.00, 0.79, 0.75, 0.81, 0.87]
line [1.00, 1.02, 1.00, 1.03, 0.00, 0.00, 0.00, 0.88, 0.87, 0.90, 0.94]
line [1.00, 1.00, 1.00, 0.99, 0.00, 0.00, 0.00, 0.97, 0.98, 0.00, 1.00]
line [1.00, 1.01, 1.00, 1.00, 0.00, 0.00, 0.00, 0.90, 0.90, 0.97, 0.97]
line [1.00, 1.03, 0.99, 1.02, 0.00, 0.00, 0.00, 0.98, 0.90, 0.91, 0.94]
Era 3 โ 1.x 8x (coming soon)
Data will appear here when 1.x versions are benchmarked.
8x:1x Scaling Ratio โ All Versions
xychart
x-axis [0.201.11, 0.202.58, 0.203.61, 0.204.97, 0.205.8, 0.206.0, 0.207.91, 0.208.76, 0.209.18, 0.211.1, 0.212.8, 0.213.3, 0.214.16, 0.217.67, 0.218.26, 0.219.30, 0.220.18, 0.221.73, 0.222.1, 0.223.55, 0.224.85, 0.225.8, 0.226.6, 0.229.7, 0.230.6, 0.232.1, 0.233.1, 0.234.9, 0.238.29, 0.239.62, 0.240.117, 0.241.635, 0.242.101, 0.243.0, 0.244.25]
y-axis "8x time / 1x time" 0 --> 70
line [7.58, 7.65, 7.76, 7.87, 7.74, 7.86, 7.63, 7.78, 7.71, 7.73, 7.74, 7.80, 7.74, 7.72, 7.71, 7.76, 7.76, 7.77, 7.76, 7.76, 7.66, 7.69, 7.55, 6.38, 6.42, 6.33, 6.31, 6.31, 0.00, 0.00, 0.00, 6.05, 6.22, 6.09, 6.18]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 8.36, 7.57, 7.55, 7.37, 7.30, 7.33, 7.25, 7.22, 7.24, 0.00, 0.00, 0.00, 7.13, 7.23, 6.77, 6.00]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 55.06, 0.00, 0.00, 0.00, 0.00, 0.00, 58.73, 53.33, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 22.94, 23.36, 23.02, 27.77, 26.93, 28.70, 28.75, 28.52, 0.00, 0.00, 0.00, 5.89, 5.94, 5.99, 5.97]
line [0.00, 7.59, 7.43, 7.45, 7.36, 7.36, 7.18, 7.24, 7.34, 7.20, 7.22, 7.24, 7.17, 7.15, 7.45, 7.30, 7.11, 7.52, 7.23, 7.18, 7.00, 6.97, 7.09, 7.14, 7.09, 7.15, 7.02, 6.97, 0.00, 0.00, 0.00, 7.15, 7.08, 7.25, 7.06]
line [8.34, 8.44, 8.62, 8.68, 8.62, 8.83, 8.60, 9.12, 8.90, 9.56, 9.27, 9.44, 8.85, 8.94, 9.09, 9.42, 9.09, 9.54, 9.26, 9.07, 7.65, 7.72, 7.61, 7.83, 7.84, 7.85, 7.77, 7.82, 0.00, 0.00, 0.00, 7.56, 7.64, 7.65, 7.71]
line [20.43, 18.94, 21.56, 21.73, 22.75, 21.49, 23.03, 21.72, 21.40, 22.51, 22.37, 22.68, 23.46, 22.38, 21.52, 21.24, 21.73, 20.52, 21.97, 22.00, 6.07, 6.09, 5.93, 11.75, 11.88, 11.83, 11.68, 11.76, 0.00, 0.00, 0.00, 9.29, 8.63, 8.23, 8.67]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 6.62, 5.58, 5.58, 5.58, 5.85, 5.87, 5.87, 5.84, 5.85, 0.00, 0.00, 0.00, 5.41, 4.88, 5.45, 5.42]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 3.30, 3.32, 3.22, 3.29, 3.30, 3.21, 3.01, 3.04, 3.11, 3.02, 2.61, 2.49, 2.50, 2.44, 16.61, 16.40, 16.49, 16.44, 16.40, 16.64, 16.58, 16.59, 0.00, 0.00, 0.00, 15.00, 11.94, 7.04, 7.33]
line [17.09, 17.20, 17.35, 17.34, 17.70, 17.98, 17.52, 17.60, 17.21, 18.26, 17.64, 17.89, 17.78, 17.18, 17.50, 17.10, 17.80, 17.42, 16.95, 17.45, 11.04, 11.23, 11.23, 11.19, 11.30, 10.95, 11.14, 11.18, 0.00, 0.00, 0.00, 20.46, 9.92, 5.21, 6.03]
line [18.16, 18.37, 18.17, 18.09, 18.93, 18.42, 19.08, 18.72, 18.32, 19.59, 19.01, 19.02, 19.32, 19.92, 20.22, 19.31, 20.31, 20.63, 20.43, 20.26, 14.50, 14.75, 14.17, 16.19, 16.68, 16.01, 16.07, 16.06, 0.00, 0.00, 0.00, 21.38, 11.08, 7.85, 8.01]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 7.10, 6.78, 6.78, 6.77, 2.29, 2.33, 2.27, 2.30, 2.26, 0.00, 0.00, 0.00, 2.40, 2.27, 2.62, 2.56]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 3.66, 3.63, 3.65, 2.24, 2.28, 2.21, 2.23, 2.21, 0.00, 0.00, 0.00, 2.31, 2.24, 3.42, 3.56]
line [8.18, 12.11, 13.31, 13.34, 14.51, 14.61, 13.64, 14.10, 14.00, 14.15, 14.26, 14.27, 8.18, 8.07, 7.99, 8.00, 8.05, 8.00, 8.24, 8.06, 8.01, 8.02, 8.09, 6.04, 6.08, 6.07, 6.04, 6.04, 0.00, 0.00, 0.00, 4.67, 4.71, 4.66, 4.71]
line [8.32, 10.64, 11.07, 11.15, 12.21, 12.16, 11.26, 11.97, 12.01, 12.11, 12.07, 11.94, 7.06, 6.89, 7.26, 7.17, 7.13, 7.08, 7.29, 7.10, 6.75, 6.76, 6.75, 7.49, 7.57, 7.59, 7.58, 7.55, 0.00, 0.00, 0.00, 6.43, 6.61, 6.34, 6.60]
line [8.49, 13.64, 14.98, 15.05, 16.33, 16.76, 14.99, 16.34, 16.14, 16.60, 16.50, 16.60, 8.51, 8.60, 8.56, 8.63, 8.51, 8.60, 8.74, 8.67, 8.12, 8.15, 8.18, 8.64, 8.67, 8.64, 8.67, 8.72, 0.00, 0.00, 0.00, 7.89, 8.10, 7.71, 7.85]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 7.73, 7.78, 7.80, 7.79, 5.74, 5.67, 5.63, 5.71, 5.69, 0.00, 0.00, 0.00, 5.59, 5.60, 5.54, 5.60]
line [2.52, 2.42, 2.46, 2.49, 2.54, 2.50, 2.50, 2.42, 2.48, 2.48, 2.48, 2.48, 2.50, 2.50, 2.42, 2.45, 2.40, 2.50, 2.44, 2.46, 2.77, 2.78, 2.72, 4.58, 4.54, 4.90, 4.49, 4.65, 0.00, 0.00, 0.00, 4.32, 3.38, 3.61, 3.85]
line [0.00, 0.00, 0.00, 11.75, 11.38, 12.57, 12.08, 14.25, 13.66, 15.31, 14.98, 16.21, 12.98, 13.99, 14.47, 15.48, 15.49, 16.67, 16.49, 16.47, 5.96, 6.07, 6.11, 6.24, 6.20, 6.18, 6.16, 6.21, 0.00, 0.00, 0.00, 6.34, 6.31, 6.47, 6.61]
line [0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 0.00, 10.75, 10.80, 10.68, 10.91, 10.88, 10.74, 10.79, 10.80, 0.00, 0.00, 0.00, 10.91, 10.82, 0.00, 11.03]
line [8.09, 8.15, 7.96, 10.00, 9.94, 10.41, 9.87, 10.58, 10.42, 11.01, 10.90, 10.96, 9.63, 9.90, 10.31, 10.46, 10.35, 10.47, 10.78, 10.36, 7.68, 7.78, 7.73, 7.27, 7.33, 7.41, 7.37, 7.30, 0.00, 0.00, 0.00, 6.90, 6.54, 6.95, 7.00]
line [0.00, 0.00, 0.00, 2.88, 2.80, 3.04, 2.97, 3.59, 3.48, 3.99, 3.85, 3.94, 3.31, 3.75, 4.00, 4.29, 4.44, 4.68, 4.67, 4.56, 2.38, 2.40, 2.49, 2.72, 2.80, 2.82, 2.75, 2.78, 0.00, 0.00, 0.00, 2.79, 2.44, 2.48, 2.51]
The ratio is 8x deploy time รท 1x deploy time. Linear scaling gives a ratio of 8. A lower ratio indicates that SSI amortizes per-site overhead across more work. A value of 0 means 8x data was not collected for that version.