# All robots will spider the domain User-agent: /* Disallow: /Architext/ Disallow: /bin/ Disallow: /cgi/ Disallow: /includes/ Disallow: /tmp/ Disallow: /cgi-bin/ Disallow: /images/ Disallow: /~/ Disallow: /stats/ Disallow: /awstats/ Disallow: /control/ Disallow: /.jpeg/ Disallow: /.gif/ Disallow: /www.webalta.net/ # Google Image User-agent: Googlebot-Image Allow: /* User-agent: Yanga WorldSearch Bot v1.1/beta Allow: /*