User-agent: * # directed to all spiders, not just Scooter Disallow: /cgi-bin/sources Disallow: /access_stats Disallow: /index.htm