#Rules for Google User-agent: googlebot Disallow: /classes/ Disallow: /error/ Disallow: /cgi-bin/ #Rules for DMOZ Checker User-agent: robozilla Disallow: /classes/ Disallow: /error/ Disallow: /cgi-bin/ #Rules for Yahoo User-agent: yahoo-slurp Disallow: /classes/ Disallow: /error/ Disallow: /cgi-bin/ #Rules for Yahoo MM User-agent: yahoo-mmcrawler Disallow: /classes/ Disallow: /error/ Disallow: /cgi-bin/ #Rules for Yahoo Blogs User-agent: yahoo-blogs/v3.9 Disallow: /classes/ Disallow: /error/ Disallow: /cgi-bin/ #Rules for MSN Search User-agent: msnbot Disallow: /classes/ Disallow: /error/ Disallow: /cgi-bin/ #Rules for Scrub The Web User-agent: scrubby Disallow: /classes/ Disallow: /error/ Disallow: /cgi-bin/ #Rules for GigaBlast User-agent: gigabot Disallow: /classes/ Disallow: /error/ Disallow: /cgi-bin/ #Rules for Ask/Teoma User-agent: teoma Disallow: /classes/ Disallow: /error/ Disallow: /cgi-bin/ #Rules for Alexa/Wayback User-agent: ia_archiver Disallow: /classes/ Disallow: /error/ Disallow: /cgi-bin/ #Rules for All Other Engines User-agent: * Disallow: /classes/ Disallow: /error/ Disallow: /cgi-bin/