Inconsistent generation behavior when do sample=False and temperature 0 across HuggingFace / vLLM backends
Inconsistent generation behavior when do sample=False and temperature 0 across HuggingFace / vLLM backends: a task in LegoFlow-SWE (Harbor dataset). A common utility function normalize gen kwargs must be implemented that takes a dictionary of generation kwargs and returns a normalized version…
The task
A common utility function **`normalize_gen_kwargs`** must be implemented that takes a dictionary of generation kwargs and returns a normalized version following the table above. Specifically: - If `do_sample` is `False`, `temperature` must be forced to `0.0` regardless of any supplied value. - If `do_sample` is…
Part of Lego-X/LegoFlow-SWE.