Robots.txt & Sitemap Generator
Robots.txt
Sitemap.xml
Site URL
Disallowed Paths (one per line)
Allow all other crawlers
URLs (one per line)
Output
Download File