AI crawler policy reader
Paste a robots.txt file. The tool identifies explicit or inherited groups and flags broad blocking rules.
Everything runs in your browser. Pasted text, results and choices are not sent to the site. These tools do not replace testing from official IP ranges or reading publisher documentation.