HF RL Explorer

Bug: Dataset.map ignores existing cache files when num proc differs

Bug: Dataset.map ignores existing cache files when num proc differs: a task in LegoFlow-SWE (Harbor dataset). When calling Dataset.map with a specific cache file name that was previously generated using a different num proc , the dataset is re-mapped entirely instead of reusing the existing cache.

The task

When calling `Dataset.map` with a specific `cache_file_name` that was previously generated using a different `num_proc`, the dataset is re-mapped entirely instead of reusing the existing cache.

Part of Lego-X/LegoFlow-SWE.