HF RL Explorer

Task: Compare Feather and Parquet File Formats for Pandas DataFrames

Task: Compare Feather and Parquet File Formats for Pandas DataFrames: a task in Terminal-Lego-15k (Harbor dataset). Write a Python script that comprehensively compares the Feather and Parquet columnar storage formats by benchmarking their performance (write speed, read speed, and file size) across…

The task

Write a Python script that comprehensively compares the Feather and Parquet columnar storage formats by benchmarking their performance (write speed, read speed, and file size) across different DataFrame sizes and compositions. The script should produce a structured comparison report.

Part of PrimeIntellect/Terminal-Lego-15k.