Feature Request: Add filesystem check operation to repair Delta tables with missing data files
Feature Request: Add filesystem check operation to repair Delta tables with missing data files: a task in LegoFlow-SWE (Harbor dataset). Delta Lake tables can become inconsistent when data files referenced by the transaction log are deleted or corrupted externally (e.g., manual removal from object…
The task
Delta Lake tables can become inconsistent when data files referenced by the transaction log are deleted or corrupted externally (e.g., manual removal from object storage). The log still contains `add` actions for these files, but the files themselves no longer exist. This leads to errors when readers try to scan the…
Part of Lego-X/LegoFlow-SWE.