# GIDS -- http://www.gids.nl # Robot Exclusion File -- robots.txt # Author: J.P van Oyen # Last Updated: 29-06-02 20:00:19 User-agent: ia_archiver Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: * Disallow: /cgi-bin Disallow: /stats Disallow: /admin Disallow: /nokia Disallow: /neomail Disallow: /anal Disallow: /snort Disallow: /mrtg Disallow: /wus Disallow: /utils Disallow: /napster Disallow: /jip-janneke Disallow: /axs Disallow: /w3perl Disallow: /phpsql Disallow: /gsm Disallow: /wap Disallow: /webftp Disallow: /flyusa Disallow: /sydney/temp/ Disallow: /sydney/big/ Disallow: /sydney/brdg-img/ Disallow: /sydney/medium/ Disallow: /travel/spic/ Disallow: /travel/npic/ Disallow: /travel/Thumb/ Disallow: /dido/thumb/ Disallow: /post/img/ Disallow: /tokyo/thumb/