We need to add optional concurrency limiting to the provider rate limiter. Currently, the rate limiter…
We need to add optional concurrency limiting to the provider rate limiter. Currently, the rate limiter…: a task in LegoFlow-SWE (Harbor dataset). We want an environment variable, PROVIDER MAX CONCURRENCY , that sets a per‑provider concurrent stream cap. When this variable is set (integer), the…
The task
We want an environment variable, `PROVIDER_MAX_CONCURRENCY`, that sets a per‑provider concurrent stream cap. When this variable is set (integer), the system should ensure that no more than that many streaming requests are active at the same time. Additional requests must wait for a slot to become available before…
Part of Lego-X/LegoFlow-SWE.