Performance Issue: Oplog Archive Listing Causes Excessive I/O and Memory Usage in Large-Scale MongoDB…
Performance Issue: Oplog Archive Listing Causes Excessive I/O and Memory Usage in Large-Scale MongoDB…: a task in LegoFlow-SWE (Harbor dataset). When operating on MongoDB clusters with extensive oplog history stored in S3 (or compatible storage), the oplog push and oplog replay commands exhibit…
The task
When operating on MongoDB clusters with extensive oplog history stored in S3 (or compatible storage), the `oplog_push` and `oplog_replay` commands exhibit severe performance degradation. The current implementation unconditionally lists **all** oplog archives in the storage prefix before filtering for the required…
Part of Lego-X/LegoFlow-SWE.