HF RL Explorer

OCI layer extraction: redundant fsync calls make operations extremely slow

OCI layer extraction: redundant fsync calls make operations extremely slow: a task in LegoFlow-SWE (Harbor dataset). When writing OCI image layers to disk (e.g. during image warmup or pull), the operation can take several minutes instead of seconds. The root cause is that every path written…

The task

When writing OCI image layers to disk (e.g. during image warmup or pull), the operation can take several minutes instead of seconds. The root cause is that every path written triggers an `fsync` on every intermediate directory up to the layer root. This means the same directories are repeatedly flushed, causing…

Part of Lego-X/LegoFlow-SWE.