HF RL Explorer

Task: Memory-Efficient Large CSV File Processing

Task: Memory-Efficient Large CSV File Processing: a task in Terminal-Lego-15k (Harbor dataset). You are working with very large CSV files (potentially hundreds of MB to several GB) containing up to 1 million rows and 200 columns. The current implementation loads too much data into memory, causing…

The task

You are working with very large CSV files (potentially hundreds of MB to several GB) containing up to 1 million rows and 200 columns. The current implementation loads too much data into memory, causing memory errors when processing files with more than 300,000 rows.

Part of PrimeIntellect/Terminal-Lego-15k.