User-agent: * Disallow: /logfiles/ Disallow: /private/ Disallow: /htdocs/cgi-bin/ Disallow: /htdocs/index_files/ Disallow: /htdocs/index/