A data processing pipeline in /opt/pipeline/ is supposed to sort, deduplicate, and normalize several CSV…
A data processing pipeline in /opt/pipeline/ is supposed to sort, deduplicate, and normalize several CSV…: a task in repo2rlenv-seta-seed2synth (Harbor dataset). Fix all the scripts so the pipeline works correctly: each data file should be sorted (lexicographically by full line), deduplicated, and…
The task
Fix all the scripts so the pipeline works correctly: each data file should be sorted (lexicographically by full line), deduplicated, and have its CSV header preserved at the top (line 1), all while maintaining original file permissions.
Part of FineEnvs/repo2rlenv-seta-seed2synth.