Feature Request: Chunk Overlapping and Entry Content Retrieval
Feature Request: Chunk Overlapping and Entry Content Retrieval: a task in LegoFlow-SWE (Harbor dataset). Currently, the text chunking functionality ( SplitParagraphIntoChunks ) produces fixed-size non-overlapping chunks based on maxChunkSize . This can lead to loss of context at chunk boundaries…
The task
Currently, the text chunking functionality (`SplitParagraphIntoChunks`) produces fixed-size non-overlapping chunks based on `maxChunkSize`. This can lead to loss of context at chunk boundaries, especially when processing documents where adjacent sentences need to be understood together. There is no way to control the…
Part of Lego-X/LegoFlow-SWE.