User-agent: * Disallow: /cgi-bin/ Disallow: /internal/ Disallow: /source/ Disallow: /Templates/ Disallow: /utilities/ Disallow: /protected/ User-agent: Slurp Crawl-delay: 200