User-agent: * # directed to all spiders Disallow: /demo Disallow: /webstats Disallow: /guest Disallow: /cgi-bin Disallow: /stats Disallow: /guests Disallow: /wwwboard Disallow: /_private Disallow: /vti_bin Disallow: /vti_cnf Disallow: /vti_log Disallow: /vti_pvt Disallow: /vti_txt Disallow: /admin