robots.txt Generator
Create a robots.txt with allow/disallow rules and a sitemap reference.
Output
Daily limit for this tool reached. An account or Premium unlocks higher limits.
How it works
- Enter user-agent, allow/disallow and sitemap
- Copy the robots.txt