Target validation hardcoded, preventing custom benchmarks from specifying valid targets
Target validation hardcoded, preventing custom benchmarks from specifying valid targets: a task in LegoFlow-SWE (Harbor dataset). This happens because the logic that determines which targets are valid for a given benchmark version is hardcoded inside the source code . The code knows only about a…
The task
This happens because the logic that determines which targets are valid for a given benchmark version is **hardcoded inside the source code**. The code knows only about a fixed set of benchmark versions (e.g., `cis-1.4`, `cis-1.5`, `eks-1.0`) and returns an empty list of valid targets for any version not explicitly…
Part of Lego-X/LegoFlow-SWE.