#User-agent: wget #Disallow: / User-agent: webzip Disallow: / User-agent: webmirror Disallow: / User-agent: webcopy Disallow: / User-agent: Xenu Disallow: / User-agent: ia_archiver Disallow: / User-agent: EmailCollector Disallow: / User-agent: GagaRobot Disallow: / User-agent: * Disallow: /logs/ Disallow: /cr/ Disallow: /sms/ Disallow: /temp/ Disallow: /tmp/ User-agent: * Disallow: /error.html