Several stats calculations in the benchmark reporter are completely broken. The stddev is being computed…
Several stats calculations in the benchmark reporter are completely broken. The stddev is being computed…: a task in rh-swe-bench (Harbor dataset). What the agent is asked, how it is graded, what it runs in, and its files.
Part of rounakbende/rh-swe-bench.