Feature request: Configurable regression detection threshold to reduce noise in asv publish
Feature request: Configurable regression detection threshold to reduce noise in asv publish: a task in LegoFlow-SWE (Harbor dataset). When publishing benchmark results with asv publish , the regression reporting is overly noisy because every detected performance regression is listed, regardless of…
The task
When publishing benchmark results with `asv publish`, the regression reporting is overly noisy because every detected performance regression is listed, regardless of magnitude. Even a 0.1% slowdown appears as a regression, making it difficult to identify meaningful degradations.
Part of Lego-X/LegoFlow-SWE.