Feature Request: Implement optimizer rule RewriteBucketedSemiJoinToJoin to avoid shuffling when both sides…
Feature Request: Implement optimizer rule RewriteBucketedSemiJoinToJoin to avoid shuffling when both sides…: a task in LegoFlow-SWE (Harbor dataset). When a semiJoin operation is performed on tables that are already bucketed by the join key, the current optimizer still introduces data shuffling…
The task
When a `semiJoin` operation is performed on tables that are already bucketed by the join key, the current optimizer still introduces data shuffling. This is unnecessary because the data is already co-located. The result is a suboptimal plan that wastes resources.
Part of Lego-X/LegoFlow-SWE.