In this task you will implement an LLM inference batching scheduler (shape‑aware)
In this task you will implement an LLM inference batching scheduler (shape‑aware): a task in terminal-bench-2.0 (Harbor dataset). Goal Your goal is to read a set of incoming requests from /app/task file/input data/requests bucket 1.jsonl /app/task file/input data/requests bucket 2.jsonl and…
Part of introvoyz041/terminal-bench-2.0.