Feature Request: Remote Environment Packing for SlurmPipesClient
Feature Request: Remote Environment Packing for SlurmPipesClient: a task in LegoFlow-SWE (Harbor dataset). When using SlurmPipesClient to run jobs on a Slurm cluster, environment packing currently happens locally and the resulting packed environment is then uploaded to the edge node. This approach…
The task
When using `SlurmPipesClient` to run jobs on a Slurm cluster, environment packing currently happens **locally** and the resulting packed environment is then uploaded to the edge node. This approach causes severe slowdowns in two common scenarios:
Part of Lego-X/LegoFlow-SWE.