When running the MySQL CDC source against tables that contain many rows or when many tables are captured…
When running the MySQL CDC source against tables that contain many rows or when many tables are captured…: a task in LegoFlow-SWE (Harbor dataset). The source should reduce JobManager memory consumption by avoiding per‑split duplication of table schemas. Instead, table schemas should be stored…
The task
The source should reduce JobManager memory consumption by avoiding per‑split duplication of table schemas. Instead, table schemas should be stored once per table (keyed by TableId) and shared across all splits belonging to that table. Snapshot splits should be representable in a schema‑less form (for example, using…
Part of Lego-X/LegoFlow-SWE.