HF RL Explorer

Task: Solve Memory Issues in Multiprocessing with Pool.map()

Task: Solve Memory Issues in Multiprocessing with Pool.map(): a task in Terminal-Lego-15k (Harbor dataset). You need to fix a Python script that processes a large CSV file using multiprocessing. The current implementation has severe memory issues when processing large datasets - memory consumption…

The task

You need to fix a Python script that processes a large CSV file using multiprocessing. The current implementation has severe memory issues when processing large datasets - memory consumption grows exponentially instead of staying bounded, causing the process to be killed or freeze the system.

Part of PrimeIntellect/Terminal-Lego-15k.