You are working on the ai-robots-txt/ai.robots.txt repository. The source code is checked out at /testbed at…
You are working on the ai-robots-txt/ai.robots.txt repository. The source code is checked out at /testbed at…: a task in SWE-Lego-RL-2699 (Harbor dataset). It looks like this would prevent the matches user agents from accessing /robots.txt , which is maybe not ideal? Should there be a RewriteCond…
The task
It looks like this would prevent the matches user agents from accessing `/robots.txt`, which is maybe not ideal? Should there be a `RewriteCond` that adds an exception for that path?
Part of Lego-X/Lego-RL-2699.