Build a valid robots.txt with User-agent groups, an XML sitemap with lastmod/changefreq/priority, or an llms.txt file for AI crawlers — live preview, copy or download, all in your browser.
Set this once. The Sitemap.xml and llms.txt tabs below only need paths (e.g. /about/), and the Sitemap: line on the Robots.txt tab fills in automatically.
{{ robotsImportError }}
{{ robotsImportMessage }}
Custom User-agent groups{{ finding.line ? 'Line ' + finding.line + ': ' : '' }}{{ finding.message }}
No syntax findings in the generated rules.
Tests the current local rules using RFC 9309 matching. Crawl-delay, network failures, server restrictions and indexing decisions are outside this test.
Showing the first {{visibleSitemapUrls.length.toLocaleString()}} of {{sitemapUrls.length.toLocaleString()}} URLs — the rest are still part of the generated file below, just not rendered as editable rows here. Re-paste to replace them, or use Clear all to start over.
Reads a sitemap.xml file from your computer and replaces the URL list above with its <url> entries — nothing is uploaded. Fetching an existing sitemap from a live URL isn't supported here (that needs a server to bypass CORS); use SEO & GEO Site Audit to validate a sitemap that's already live instead.
⚠ {{ importError }}
{{sitemapUrls.length.toLocaleString()}} URL{{sitemapUrls.length===1?'':'s'}} · {{sitemapSizeLabel}} rendered
⚠ {{ w }}
This sitemap needs to be split across {{chunkedSitemaps.length}} files per the sitemaps.org protocol (50,000 URLs or 50MB uncompressed per file, whichever comes first) plus one sitemap-index.xml referencing them.
Groups the URLs from the Sitemap.xml tab by their first path segment and replaces the sections below. Still fully editable after.
Build a robots.txt file to control which crawlers can access which paths, an XML sitemap to help search engines discover your pages, or an llms.txt file — a newer convention that gives AI crawlers and LLM-based tools a curated, markdown summary of your site's most useful pages.
Already have these files live and want to check they're actually valid and being picked up? SEO & GEO Site Audit fetches and validates your site's real robots.txt, sitemap.xml and llms.txt over the network.
A sitemap over 50,000 URLs or 50MB uncompressed — the sitemaps.org protocol's actual per-file limits, checked here by rendered byte size and not just URL count — needs splitting into several sitemap files plus one sitemap-index.xml that lists them; the Sitemap.xml tab does that split and packages the result as a ZIP once your list is large enough to need it.
Privacy: 100% client-side. Nothing you type here is sent anywhere.
