User-agent: * Disallow: /cgi-bin/ Disallow: /stylesheets/ # I have little use for user level crawlers. # Particularly undocumented ones. User-agent: MSIECrawler Disallow: /