Memory consumption issue when exporting large record sets
Memory consumption issue when exporting large record sets: a task in LegoFlow-SWE (Harbor dataset). When exporting records (e.g., 10,000 records), the tool consumes over 500 MiB of memory because all records are loaded into memory before being converted to CSV. Memory usage grows linearly with the…
The task
When exporting records (e.g., 10,000 records), the tool consumes over 500 MiB of memory because all records are loaded into memory before being converted to CSV. Memory usage grows linearly with the number of records exported.
Part of Lego-X/LegoFlow-SWE.