benchbuild.statistics module

Handle all statsitic related classes and methods.

class benchbuild.statistics.Statistics(project, experiment, *extensions, config=None)[source]

Bases: benchbuild.extensions.base.Extension

Extend a run to be repeated until it reaches a statistically significance specified by the user.

An example on how to use this extension can be found in the Pollytest Experiment.

t_test(*results, significance=0.95)[source]

Runs a t-test on a given set of results.

Returns:True if the null hypothesis that the result was not significant was rejected, False otherwise.