📈 Validate Performance History
Track performance trends across versions for complex site validation using ssi validate deploy.
Simple Site (typical real-world)
xychart x-axis [0.244.0, 0.244.2, 0.244.10, 0.244.17, 0.244.19, 0.244.24, 0.244.25] y-axis "Time (ms)" 0 --> 15 line [9.43, 9.14, 10.01, 9.82, 9.32, 9.63, 9.51] line [8.89, 8.72, 9.41, 9.27, 8.86, 9.20, 9.06] line [8.42, 8.31, 8.83, 8.74, 8.43, 8.76, 8.62]
Complex Sites 1x (stress tests)
xychart x-axis [0.244.0, 0.244.2, 0.244.10, 0.244.17, 0.244.19, 0.244.24, 0.244.25] y-axis "Time (ms)" 0 --> 800 line [90.31, 87.20, 90.12, 89.77, 87.60, 87.68, 87.74] line [93.54, 94.15, 100.81, 96.60, 102.47, 96.31, 97.08] line [194.43, 189.68, 197.15, 191.02, 190.23, 186.87, 188.06] line [16.03, 15.64, 16.07, 15.69, 15.75, 15.47, 16.14] line [73.61, 70.24, 73.30, 71.96, 71.83, 71.79, 71.90] line [113.54, 110.70, 115.92, 109.74, 107.31, 107.05, 110.44] line [111.11, 111.48, 114.52, 115.32, 112.78, 112.07, 115.55] line [584.09, 556.23, 566.79, 562.98, 565.80, 559.26, 581.79] line [251.03, 250.66, 252.60, 250.79, 250.09, 250.46, 249.53] line [682.89, 684.50, 683.51, 688.34, 677.77, 679.90, 682.78] line [359.46, 356.16, 361.00, 348.90, 348.33, 355.69, 349.36] line [85.77, 84.40, 87.40, 85.36, 85.25, 84.54, 85.33] line [122.05, 118.28, 123.46, 120.02, 118.15, 118.79, 118.60] line [110.41, 108.51, 113.89, 112.16, 108.26, 110.54, 106.93] line [119.17, 115.53, 123.31, 120.33, 117.42, 114.80, 113.60] line [70.72, 69.96, 70.29, 70.51, 70.25, 69.19, 69.86] line [88.02, 84.29, 86.72, 85.55, 85.22, 84.50, 85.36] line [165.03, 163.87, 167.02, 162.82, 164.14, 164.22, 161.68] line [105.83, 106.01, 107.89, 106.78, 106.43, 105.50, 105.48] line [59.88, 60.37, 60.89, 60.94, 60.43, 59.95, 59.67] line [95.17, 93.80, 95.02, 93.79, 92.57, 92.15, 92.25] line [133.57, 129.82, 132.26, 132.14, 129.99, 131.62, 129.47] line [185.77, 181.98, 185.47, 190.54, 183.25, 179.87, 181.19]
Complex Sites 1x — Normalized trend
xychart x-axis [0.244.0, 0.244.2, 0.244.10, 0.244.17, 0.244.19, 0.244.24, 0.244.25] y-axis "Relative to first non-zero (1.0 = baseline)" 0 --> 2 line [1.00, 0.97, 1.00, 0.99, 0.97, 0.97, 0.97] line [1.00, 1.01, 1.08, 1.03, 1.10, 1.03, 1.04] line [1.00, 0.98, 1.01, 0.98, 0.98, 0.96, 0.97] line [1.00, 0.98, 1.00, 0.98, 0.98, 0.97, 1.01] line [1.00, 0.95, 1.00, 0.98, 0.98, 0.98, 0.98] line [1.00, 0.97, 1.02, 0.97, 0.95, 0.94, 0.97] line [1.00, 1.00, 1.03, 1.04, 1.02, 1.01, 1.04] line [1.00, 0.95, 0.97, 0.96, 0.97, 0.96, 1.00] line [1.00, 1.00, 1.01, 1.00, 1.00, 1.00, 0.99] line [1.00, 1.00, 1.00, 1.01, 0.99, 1.00, 1.00] line [1.00, 0.99, 1.00, 0.97, 0.97, 0.99, 0.97] line [1.00, 0.98, 1.02, 1.00, 0.99, 0.99, 0.99] line [1.00, 0.97, 1.01, 0.98, 0.97, 0.97, 0.97] line [1.00, 0.98, 1.03, 1.02, 0.98, 1.00, 0.97] line [1.00, 0.97, 1.03, 1.01, 0.99, 0.96, 0.95] line [1.00, 0.99, 0.99, 1.00, 0.99, 0.98, 0.99] line [1.00, 0.96, 0.99, 0.97, 0.97, 0.96, 0.97] line [1.00, 0.99, 1.01, 0.99, 0.99, 1.00, 0.98] line [1.00, 1.00, 1.02, 1.01, 1.01, 1.00, 1.00] line [1.00, 1.01, 1.02, 1.02, 1.01, 1.00, 1.00] line [1.00, 0.99, 1.00, 0.99, 0.97, 0.97, 0.97] line [1.00, 0.97, 0.99, 0.99, 0.97, 0.99, 0.97] line [1.00, 0.98, 1.00, 1.03, 0.99, 0.97, 0.98]
Complex Sites 8x (stress tests)
23 sites
xychart x-axis [0.244.0, 0.244.2, 0.244.10, 0.244.17, 0.244.19, 0.244.24, 0.244.25] y-axis "Time (ms)" 0 --> 7400 line [569.77, 550.36, 566.70, 578.27, 555.26, 564.21, 563.17] line [622.98, 561.04, 597.87, 569.60, 589.78, 558.22, 571.08] line [1227.78, 1197.63, 1235.08, 1208.58, 1179.65, 1187.99, 1187.56] line [80.56, 77.30, 80.38, 273.52, 79.79, 78.99, 78.28] line [661.11, 642.65, 658.85, 669.26, 642.48, 666.04, 648.73] line [2354.63, 2380.62, 2425.92, 2290.84, 2328.49, 2286.94, 2392.49] line [794.91, 815.85, 823.43, 860.60, 816.23, 854.28, 884.29] line [4570.45, 4429.44, 4511.02, 4536.58, 4498.26, 4391.38, 4574.07] line [1927.53, 1932.88, 1942.11, 1920.24, 1916.64, 1923.19, 1919.30] line [5612.30, 5779.95, 5705.65, 6395.67, 5983.74, 5684.28, 5708.37] line [1738.79, 1757.63, 1788.50, 1724.63, 1702.17, 1764.47, 1687.16] line [380.27, 380.28, 386.50, 390.75, 373.39, 387.81, 376.94] line [840.94, 829.53, 856.82, 913.22, 840.73, 906.32, 888.84] line [808.23, 792.26, 799.66, 858.54, 806.55, 860.86, 836.21] line [965.92, 961.87, 979.63, 1055.21, 964.44, 1040.50, 1007.88] line [390.07, 385.85, 398.29, 403.37, 383.41, 401.69, 398.98] line [292.42, 282.28, 290.60, 286.64, 287.29, 287.35, 300.03] line [1127.71, 1131.23, 1129.17, 1122.26, 1115.51, 1134.98, 1104.10] line [1218.30, 1218.23, 1212.73, 1246.14, 1207.83, 1202.05, 1219.77] line [434.46, 428.07, 446.37, 439.92, 430.94, 428.24, 429.06] line [729.99, 717.52, 722.10, 758.88, 717.97, 741.56, 731.66] line [405.11, 392.62, 404.01, 407.65, 396.64, 400.46, 396.40] line [1510.88, 1488.65, 1500.50, 1518.07, 1493.66, 1476.79, 1506.68]
Complex Sites 8x — Normalized trend
xychart x-axis [0.244.0, 0.244.2, 0.244.10, 0.244.17, 0.244.19, 0.244.24, 0.244.25] y-axis "Relative to first non-zero (1.0 = baseline)" 0 --> 4 line [1.00, 0.97, 0.99, 1.01, 0.97, 0.99, 0.99] line [1.00, 0.90, 0.96, 0.91, 0.95, 0.90, 0.92] line [1.00, 0.98, 1.01, 0.98, 0.96, 0.97, 0.97] line [1.00, 0.96, 1.00, 3.40, 0.99, 0.98, 0.97] line [1.00, 0.97, 1.00, 1.01, 0.97, 1.01, 0.98] line [1.00, 1.01, 1.03, 0.97, 0.99, 0.97, 1.02] line [1.00, 1.03, 1.04, 1.08, 1.03, 1.07, 1.11] line [1.00, 0.97, 0.99, 0.99, 0.98, 0.96, 1.00] line [1.00, 1.00, 1.01, 1.00, 0.99, 1.00, 1.00] line [1.00, 1.03, 1.02, 1.14, 1.07, 1.01, 1.02] line [1.00, 1.01, 1.03, 0.99, 0.98, 1.01, 0.97] line [1.00, 1.00, 1.02, 1.03, 0.98, 1.02, 0.99] line [1.00, 0.99, 1.02, 1.09, 1.00, 1.08, 1.06] line [1.00, 0.98, 0.99, 1.06, 1.00, 1.07, 1.03] line [1.00, 1.00, 1.01, 1.09, 1.00, 1.08, 1.04] line [1.00, 0.99, 1.02, 1.03, 0.98, 1.03, 1.02] line [1.00, 0.97, 0.99, 0.98, 0.98, 0.98, 1.03] line [1.00, 1.00, 1.00, 1.00, 0.99, 1.01, 0.98] line [1.00, 1.00, 1.00, 1.02, 0.99, 0.99, 1.00] line [1.00, 0.99, 1.03, 1.01, 0.99, 0.99, 0.99] line [1.00, 0.98, 0.99, 1.04, 0.98, 1.02, 1.00] line [1.00, 0.97, 1.00, 1.01, 0.98, 0.99, 0.98] line [1.00, 0.99, 0.99, 1.00, 0.99, 0.98, 1.00]
📊 Validate Performance Results
Basic Performance
Version: 0.244.25 | Generated: 2026-06-09T20:02:48.175753
| Test | Mean (ms) | Median (ms) | ± Std Dev | CV% | Outliers | Range | Peak Mem (MB) | Trend | Base | Status |
|---|---|---|---|---|---|---|---|---|---|---|
| Basic Performance | 9.06 | 9.06 | ± 0.22 | 2.4% | 138 (13.8%) | 8.62-9.51 | 26.60 | 🟢🟢🟢 | 🟩 | — |
Stress Tests
| Test | Mean (ms) | Median (ms) | ± Std Dev | CV% | Outliers | Range | Peak Mem (MB) | Trend | Base | Status |
|---|---|---|---|---|---|---|---|---|---|---|
| Big Bad HTML | 87.74 | 87.87 | ± 0.38 | 0.4% | 3 (25.0%) | 87.12-88.19 | 31.00 | 🟢🟢🟢 | 🟩 | — |
| Builtin Sources | 97.08 | 97.69 | ± 1.38 | 1.4% | 1 (8.3%) | 95.01-98.98 | 38.70 | 🟡🔵🟢 | 🟩 | — |
| Chain Reaction | 188.06 | 187.47 | ± 1.69 | 0.9% | 0 (0.0%) | 185.59-190.52 | 48.80 | 🟢🟢🟢 | 🟩 | — |
| Checksum Copy | 16.14 | 16.24 | ± 0.62 | 3.8% | 0 (0.0%) | 15.17-16.90 | 38.70 | 🟢🟢🟢 | 🟩 | — |
| Context Resolution | 71.90 | 71.67 | ± 0.80 | 1.1% | 1 (8.3%) | 70.93-73.02 | 38.70 | 🟢🟢🟢 | 🟩 | — |
| Deep Pipeline | 110.44 | 110.38 | ± 0.43 | 0.4% | 5 (41.7%) | 109.95-111.04 | 38.70 | 🟢🟢🟢 | 🟩 | — |
| External Sources | 115.55 | 115.41 | ± 0.96 | 0.8% | 1 (8.3%) | 114.26-116.88 | 38.70 | 🟢🟢🟢 | 🟩 | — |
| Inline Templates | 581.79 | 581.88 | ± 0.40 | 0.1% | 5 (41.7%) | 581.06-582.33 | 64.60 | 🟢🟢🟢 | 🟩 | — |
| Large Content | 249.53 | 249.54 | ± 0.70 | 0.3% | 1 (8.3%) | 248.40-250.57 | 70.90 | 🟢🟢🟢 | 🟩 | — |
| Large Inline Content | 682.78 | 682.54 | ± 2.24 | 0.3% | 0 (0.0%) | 679.42-685.80 | 105.00 | 🟢🟢🟢 | 🟩 | — |
| Large Template | 349.36 | 349.16 | ± 1.51 | 0.4% | 2 (16.7%) | 347.49-352.04 | 127.00 | 🟢🟢🟢 | 🟩 | — |
| Content Manipulation | 85.33 | 85.50 | ± 0.59 | 0.7% | 1 (8.3%) | 84.47-86.08 | 38.70 | 🟢🟢🟢 | 🟩 | — |
| Many Blocks | 118.60 | 118.67 | ± 1.34 | 1.1% | 1 (8.3%) | 117.32-121.13 | 38.70 | 🟢🟢🟢 | 🟩 | — |
| Many Excerpts | 106.93 | 106.72 | ± 1.38 | 1.3% | 1 (8.3%) | 105.34-109.26 | 41.50 | 🟢🟢🟢 | 🟩 | — |
| Many Files | 113.60 | 113.21 | ± 1.03 | 0.9% | 1 (8.3%) | 112.37-115.21 | 41.50 | 🟢🟢🟢 | 🟩 | — |
| Many Pages | 69.86 | 69.88 | ± 0.44 | 0.6% | 4 (33.3%) | 69.24-70.52 | 41.50 | 🟢🟢🟢 | 🟩 | — |
| Many Steps (Inception) | 85.36 | 85.40 | ± 0.39 | 0.5% | 3 (25.0%) | 84.73-85.83 | 42.70 | 🟢🟢🟢 | 🟩 | — |
| Many Variables | 161.68 | 161.70 | ± 0.56 | 0.3% | 2 (16.7%) | 161.03-162.75 | 58.90 | 🟢🟢🟢 | 🟩 | — |
| Mixed Load | 105.48 | 105.47 | ± 0.41 | 0.4% | 3 (25.0%) | 104.97-106.12 | 41.70 | 🟢🟢🟢 | 🟩 | — |
| Nested Configs | 59.67 | 59.55 | ± 0.49 | 0.8% | 1 (8.3%) | 58.94-60.42 | 41.70 | 🟢🟢🟢 | 🟩 | — |
| Template Generation | 92.25 | 92.15 | ± 0.51 | 0.5% | 1 (8.3%) | 91.67-93.09 | 41.90 | 🟢🟢🟢 | 🟩 | — |
| Token Density | 129.47 | 129.52 | ± 0.16 | 0.1% | 6 (50.0%) | 129.18-129.63 | 59.00 | 🟢🟢🟢 | 🟩 | — |
| Unicode Content | 181.19 | 180.72 | ± 1.28 | 0.7% | 2 (16.7%) | 179.70-183.23 | 50.90 | 🟢🟢🟢 | 🟩 | — |
Summary
Average of Complex Sites: 167.82 ms mean, 167.75 ms median (± 162.58 ms)
➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖➖🟢⚪🟢🟢🟢🟢🟢
⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜⬜🟩🟩🟩🟩🟩🟩🟩
Methodology
- Outlier Detection: IQR method (Q1 - 1.5×IQR to Q3 + 1.5×IQR) removes system noise
- Statistics Reported: Cleaned data after outlier removal
- Primary Metrics: Mean (cleaned), Median (outlier-resistant), CV% (quality indicator)
- Iterations: 12 runs per site
- Measurement Method: Wall-clock timing with subprocess overhead