HF RL Explorer

Issue: gym.vector environments raise NotImplementedError when a custom gym.Space subclass is used as…

Issue: gym.vector environments raise NotImplementedError when a custom gym.Space subclass is used as…: a task in LegoFlow-SWE (Harbor dataset). When using SyncVectorEnv or AsyncVectorEnv with environments whose observation or action space is a custom subclass of gym.Space (i.e., not one of the…

The task

When using `SyncVectorEnv` or `AsyncVectorEnv` with environments whose observation or action space is a custom subclass of `gym.Space` (i.e., not one of the built-in types like `Box`, `Discrete`, `Tuple`, `Dict`, etc.), the vector environment creation crashes with a `NotImplementedError`. The same error occurs during…

Part of Lego-X/LegoFlow-SWE.