Free Robots.txt & Sitemap Checker
Make sure you're not accidentally blocking Google from crawling your site, and that your sitemap is reachable and valid. A single wrong line in robots.txt can hide your entire website from search.
Free · No signup required · Results in seconds
Checking …
Couldn't Check That Site
Something went wrong.
Two Files That Control How Google Crawls Your Site
robots.txt and your sitemap work together to tell search engines what to crawl and index.
robots.txt Rules
Checks whether your site accidentally blocks all search engines, and lists what's disallowed for each crawler.
Sitemap Validity
Confirms your sitemap is reachable, is valid XML, and counts how many URLs it lists.
Live URL Sampling
Spot-checks a sample of URLs from your sitemap to confirm they actually load, not just that they're listed.
Frequently Asked Questions
Yes. There's no signup, no email required, and no limit on how many sites you can check.
robots.txt is a file at the root of your domain (yoursite.com/robots.txt) that tells search engine crawlers which parts of your site they're allowed to visit.
A line like "Disallow: /" under "User-agent: *" tells every search engine not to crawl any page on your site. This sometimes gets left in place after a staging site goes live, hiding the entire site from Google.
A sitemap (usually sitemap.xml) lists the URLs on your site you want search engines to know about, helping them discover and index your pages more efficiently.
We check up to 10 URLs from your sitemap to confirm they actually load. A sitemap listing pages that return errors sends bad signals to search engines.
No. We fetch robots.txt and your sitemap, check them, and don't save the results anywhere.
Want a Full Technical SEO Audit?
Robots.txt and sitemap issues are just one piece of technical SEO. Our team can audit your entire site's crawlability, indexing, and search visibility.