Robots.txt generator

Create a robots.txt file with user agents, allowed or blocked paths and sitemap URLs. Review the rules before copying or downloading the file.

Processed in your browser: your data are not uploaded.

Set your data

User-agent

Allow paths (one per line)

Disallow paths (one per line)

Sitemap URL (optional)

Fill one User-agent group with Allow/Disallow paths, one per line, and optional Sitemap. Download and review before replacing an existing file.

Your result will appear here.

We count which tools are used most, without including entered values or file contents in the statistics. Privacy

You can enter the domain with or without www and include a path and query. HTTPS is used when the scheme is omitted.
Fill one User-agent group with Allow/Disallow paths, one per line, and optional Sitemap.
Download and review before replacing an existing file.

robots.txt controls crawling: it does not protect data or guarantee removal from search.

Install at the domain root and review the rules.

Input

Result

User-agent: * Allow: / Disallow: /private/ Sitemap: https://example.com/sitemap.xml

Limits and checks
Parameter	Value
Allow paths (one per line)	≤ 5000000 characters
Disallow paths (one per line)	≤ 5000000 characters