HF RL Explorer

Improve sparse file handling in Borg chunker

Improve sparse file handling in Borg chunker: a task in LegoFlow-SWE (Harbor dataset). When borg create --sparse is used, the chunker reads all‑zero data from files (sparse files, fallocated unused space, or genuine zero data written to disk) and processes them identically to regular data chunks…

The task

When `borg create --sparse` is used, the chunker reads all‑zero data from files (sparse files, fallocated unused space, or genuine zero data written to disk) and processes them identically to regular data chunks. This causes severe performance degradation:

Part of Lego-X/LegoFlow-SWE.