User-agent: Slurp Disallow: /awstats/ Disallow: /cgi-bin/ Disallow: /cp/ Disallow: /include/ Disallow: /site1/ Disallow: /webalizer/