Issue: Direct Avro encoding in Foundation 's encoding module to bypass GenericDatum overhead
Issue: Direct Avro encoding in Foundation 's encoding module to bypass GenericDatum overhead: a task in LegoFlow-SWE (Harbor dataset). Problem When writing Arrow datasets to Avro files, the current Encoder implementation (inside Foundation ’s encoding namespace) converts Arrow data into…
The task
**Problem** When writing Arrow datasets to Avro files, the current `Encoder` implementation (inside `Foundation`’s `encoding` namespace) converts Arrow data into intermediate `GenericDatum` objects before producing Avro binary. This adds substantial object-allocation overhead and limits performance. Meanwhile, the…
Part of Lego-X/LegoFlow-SWE.