Build a valid robots.txt with User-agent groups, an XML sitemap with lastmod/changefreq/priority, or an llms.txt file for AI crawlers — live preview, copy or download, all in your browser.
Set this once. The Sitemap.xml and llms.txt tabs below only need paths (e.g. /about/), and the Sitemap: line on the Robots.txt tab fills in automatically.
⚠ {{ w }}
Groups the URLs from the Sitemap.xml tab by their first path segment and replaces the sections below. Still fully editable after.
Build a robots.txt file to control which crawlers can access which paths, an XML sitemap to help search engines discover your pages, or an llms.txt file — a newer convention that gives AI crawlers and LLM-based tools a curated, markdown summary of your site's most useful pages.
Already have these files live and want to check they're actually valid and being picked up? SEO & GEO Site Audit fetches and validates your site's real robots.txt, sitemap.xml and llms.txt over the network.
Privacy: 100% client-side. Nothing you type here is sent anywhere.
