Free SEO Tool
Robots.txt Tester
Fetch a website’s robots.txt file, edit the rules, choose a crawler, and test whether a URL is allowed or blocked.
Tip: paste the full robots.txt URL, for example https://example.com/robots.txt
Robots.txt Content
Edit the rules before testing if you want to simulate changes.
1
Allowed
URL is allowed
No matching blocking rule was found.
CrawlerGooglebot
Path tested/
Matched ruleNone