robots.txt Path Tester
Ask one question of any robots.txt: would Googlebot — or Bingbot, or GPTBot — fetch this path?
Server-processed
- Public data only
- No logs, nothing stored
- Free forever
This tool processes data online
It fetches the public /robots.txt of the website you enter — the same file any search engine downloads. All rule matching happens in your browser.
- No logs, nothing stored. What you submit is processed in memory and discarded — never saved, never used for marketing, never shared.
- Public data only. The tool fetches what anyone can already see in a browser — no logins, no private pages, no bypassing paywalls.
- Fair use. Ten checks per minute per visitor — each one is a real network request on our side.