Feature Request: Expose Trace/Callback Information in EvaluationResult
Feature Request: Expose Trace/Callback Information in EvaluationResult: a task in LegoFlow-SWE (Harbor dataset). When using evaluate() on a dataset, the returned EvaluationResult object provides scores but completely hides the intermediate reasoning steps that metrics performed during evaluation…
The task
When using `evaluate()` on a dataset, the returned `EvaluationResult` object provides scores but completely hides the intermediate reasoning steps that metrics performed during evaluation. There is no way for users to inspect LLM calls, prompt–response pairs, tool calls, or the internal chain of operations that led…
Part of Lego-X/LegoFlow-SWE.