#Googlebot: http://www.google.com/bot.html #The Web Robots FAQ: http://www.robotstxt.org/wc/faq.html#indexing #Last updated by Adeesha Wickremasinghe on September 10,2004 User-agent: * Disallow: /admin Disallow: /cgi-bin Disallow: /conf Disallow: /cert Disallow: /error_docs Disallow: /images Disallow: /lib Disallow: /logs Disallow: /pd Disallow: /styles Disallow: /web_users Disallow: /webstat Disallow: /webstat-ssl Disallow: /website User-agent: Mozilla/3.01 (hotwired-test/0.1) Disallow: /admin Disallow: /cgi-bin Disallow: /conf Disallow: /cert Disallow: /error_docs Disallow: /images Disallow: /lib Disallow: /logs Disallow: /pd Disallow: /styles Disallow: /web_users Disallow: /webstat Disallow: /webstat-ssl Disallow: /website User-agent: Slurp Disallow: /admin Disallow: /cgi-bin Disallow: /conf Disallow: /cert Disallow: /error_docs Disallow: /images Disallow: /lib Disallow: /logs Disallow: /pd Disallow: /styles Disallow: /web_users Disallow: /webstat Disallow: /webstat-ssl Disallow: /website User-agent: Scooter Disallow: /admin Disallow: /cgi-bin Disallow: /conf Disallow: /cert Disallow: /error_docs Disallow: /images Disallow: /lib Disallow: /logs Disallow: /pd Disallow: /styles Disallow: /web_users Disallow: /webstat Disallow: /webstat-ssl Disallow: /website User-agent: Ultraseek Disallow: /admin Disallow: /cgi-bin Disallow: /conf Disallow: /cert Disallow: /error_docs Disallow: /images Disallow: /lib Disallow: /logs Disallow: /pd Disallow: /styles Disallow: /web_users Disallow: /webstat Disallow: /webstat-ssl Disallow: /website User-agent: smallbear Disallow: /admin Disallow: /cgi-bin Disallow: /conf Disallow: /cert Disallow: /error_docs Disallow: /images Disallow: /lib Disallow: /logs Disallow: /pd Disallow: /styles Disallow: /web_users Disallow: /webstat Disallow: /webstat-ssl Disallow: /website User-agent: GoogleBot Disallow: /admin Disallow: /cgi-bin Disallow: /conf Disallow: /cert Disallow: /error_docs Disallow: /images Disallow: /lib Disallow: /logs Disallow: /pd Disallow: /styles Disallow: /web_users Disallow: /webstat Disallow: /webstat-ssl Disallow: /website