We are experiencing significant performance degradation and excessive memory usage when validating large…
We are experiencing significant performance degradation and excessive memory usage when validating large…: a task in LegoFlow-SWE (Harbor dataset). We need to optimize the MultiIndex validation path so that for checks whose outcome depends only on the unique values present in the data, the backend…
The task
We need to optimize the MultiIndex validation path so that for checks whose outcome depends only on the *unique* values present in the data, the backend uses the pre‑computed unique level values (the `levels` attribute of the MultiIndex) instead of the full materialized array. This should dramatically reduce both…
Part of Lego-X/LegoFlow-SWE.