Feature Request: Smooth Expected Calibration Error Metric
Feature Request: Smooth Expected Calibration Error Metric: a task in LegoFlow-SWE (Harbor dataset). We need a new metric, SmoothCalibrationError , that computes the smooth expected calibration error (ECE) for classification models. This metric should replace the traditional binning‑based approach…
The task
We need a new metric, `SmoothCalibrationError`, that computes the smooth expected calibration error (ECE) for classification models. This metric should replace the traditional binning‑based approach with a kernel density estimation method, as described in the Smooth ECE paper (Blasiok & Nakkiran, ICLR 2024). The…
Part of Lego-X/LegoFlow-SWE.