Filter account-download source data with a single reusable predicate
Filter account-download source data with a single reusable predicate: a task in MiMo-V2.6-RL-harbor-code: MiMo-V2.6-RL Code (Harbor) (Harbor dataset). Our Spark-based account downloads parse an incoming request into a small validated filter object (the model with fields like fy , submission types…
The task
Our Spark-based account downloads parse an incoming request into a small validated filter object (the model with fields like `fy`, `submission_types`, `period`, `quarter`, `budget_function`, `budget_subfunction`, and `def_codes`). Right now the logic that turns those filters into the actual row-level filtering of the…
Part of FineEnvs/MiMo-V2.6-RL-harbor-code.