In this task you will implement an LLM inference batching scheduler (shape‑aware)
In this task you will implement an LLM inference batching scheduler (shape‑aware): a task in Task Alignment Bench (TAB) (Harbor dataset). Goal Your goal is to read a set of incoming requests from /app/task file/input data/requests bucket 1.jsonl /app/task file/input data/requests bucket 2.jsonl…
The task
**Goal** Your goal is to read a set of incoming requests from ``/app/task_file/input_data/requests_bucket_1.jsonl`` ``/app/task_file/input_data/requests_bucket_2.jsonl`` and produce a plan in ``/app/task_file/output_data/plan_b1.jsonl`` ``/app/task_file/output_data/plan_b2.jsonl`` that assigns every request to a…
Part of anonymous98570239854/tab.