You are working on the instructlab/instructlab repository. The source code is checked out at /testbed at…
You are working on the instructlab/instructlab repository. The source code is checked out at /testbed at…: a task in SWE-Lego-RL-2699 (Harbor dataset). To Reproduce ilab model serve --model-family granite --model-path models/granite-7b-lab-Q4 K M.gguf INFO 2024-06-15 14:25:31,252 serve.py:51…
The task
**To Reproduce** ``` ilab model serve --model-family granite --model-path models/granite-7b-lab-Q4_K_M.gguf INFO 2024-06-15 14:25:31,252 serve.py:51: serve Using model 'models/granite-7b-lab-Q4_K_M.gguf' with -1 gpu-layers and 4096 max context size. ERROR 2024-06-15 14:25:40,704 llama_cpp:0: flush Traceback (most…
Part of Lego-X/Lego-RL-2699.