You are working on the microsoft/sammo repository. The source code is checked out at /testbed at commit…
You are working on the microsoft/sammo repository. The source code is checked out at /testbed at commit…: a task in SWE-Lego-RL-2699 (Harbor dataset). This change is motivated by the need to run portions of a prompt in different runners. For instance, a prompt may run a generation in a different…
The task
This change is motivated by the need to run portions of a prompt in different runners. For instance, a prompt may run a generation in a different model than an evaluation. This may be used when migrating from one model to another, when comparing two different models and when limiting the use of a more-expensive model.
Part of Lego-X/Lego-RL-2699.