# robots.txt for http://www.warren.usyd.edu.au/ User-agent: * Disallow: /cgi-bin/ # This is the cgi-bin directory Disallow: /bulletin/pages Disallow: /warren Disallow: /bulletin/pages Disallow: /database/pages Disallow: /images Disallow: /projects/pages Disallow: /projects/energy/pages Disallow: /projects/photonics/pages Disallow: /projects/smartcards/pages Disallow: /projects/images Disallow: /register/pages Disallow: /warren # Rover is a bad dog User-agent: Roverbot Disallow: /