Introduction
Essential Information
- Tests are not parallelized
- Run order is deterministic
- Tests are run in-process
Sailfish applies outlier detection and overhead estimation to run results. It does not perform any optimizations that would result in the tests needing to be run out-of-process.
Confidence Intervals
Sailfish reports 95% and 99% confidence intervals by default for the mean runtime. See Confidence Intervals for details.
Adaptive Sampling
Automatically stop collecting samples when results are stable using CV and CI width thresholds. See Adaptive Sampling for configuration and best practices.