# robotstxt.org/ User-agent: * Allow: / Crawl-delay: 10