← Back
Online Toolbox
robots.txt Generator
Visually edit robots.txt crawl rules, supports multiple User-agent groups, Sitemap configuration, and presets
Quick Presets
Allow All
Disallow All
Standard Website
Block AI Crawlers
Import from robots.txt
Import
Cancel
User-agent Groups
Sitemap
+ Add Sitemap
Generated Result
Copy
Download robots.txt