User-agent: * Disallow: /admin.php Disallow: /404.php Disallow: /403.php Disallow: /install.php Disallow: /cgi-bin/ User-agent: msnbot Disallow: / User-agent: autohttp Disallow: / User-agent: BaiDuSpider Disallow: / User-Agent: Yahoo! Slurp Disallow: / User-agent: Aport Disallow: / User-Agent: turtle Disallow: / User-Agent: teleport Disallow: / User-Agent: Offline Explorer Enterprise Disallow: / User-agent: Webalta Disallow: /