Report Download Causes Memory Exhaustion and Server Crash for Large Datasets
Report Download Causes Memory Exhaustion and Server Crash for Large Datasets: a task in LegoFlow-SWE (Harbor dataset). When downloading a report that contains a very large number of results (e.g., from a DAM instance with millions of assets, especially when filtering with only an end date), the…
The task
When downloading a report that contains a very large number of results (e.g., from a DAM instance with millions of assets, especially when filtering with only an end date), the server’s heap memory is completely exhausted—even with 40GB allocated—and the process becomes unresponsive. This eventually leads to a server…
Part of Lego-X/LegoFlow-SWE.