A.R. Alameldeen and D.A. Wood,, "Variability in Architectural Simulations of Multi-threaded Workloads," HPCA 2003. IEEE Xplore |
Space Variation
two runs exhibit different performance characteristics (OS scheduling decision, lock orders, measurement interval etc.,)
Time variability
workloads exhibit different performance char over time
Accounting for space v
confidence interval : +/- 1 sigma
enuf sample size : n : CLT application
Hypothesis testing
Accounting for Time V
start at different points
ANOVA : analysis of variance (start at same point go to n, n+x n+2x and see if variance changes) and then do some dagajchi