# site reapers User-agent: wget User-agent: webzip User-agent: webmirror User-agent: webcopy User-agent: NewsGatorOnline User-agent: Blockiert von Norton User-agent: Anonymisiert durch Steganos Internet Anonym 2006 User-agent: IRLbot User-agent: gonzo2[P] User-agent: gonzo1[D] User-agent: Aberja Checkomat User-agent: Jakarta Commons-HttpClient Disallow: / User-agent: * # directed to all robots Disallow: /cgi-bin/ Disallow: /cgi-data/ Disallow: /counter/ Disallow: /dealers/ Disallow: /downloads/ Disallow: /gaestebuch/ Disallow: /images/ Disallow: /js/ Disallow: /php/ Disallow: /rss/ Disallow: /sg/ Disallow: /special/ Disallow: /styles/ Disallow: /test/ Disallow: /cart.html Disallow: /new/