# robots.txt for http://www.xgray.org # general usage User-agent: * Disallow: /beta/data/ Disallow: /beta/phpx/ Disallow: /beta/templates/ Disallow: /cgi-bin/ Disallow: /download/ Disallow: /images/ Disallow: /includes/ Disallow: /php/ Disallow: /sounds/ Disallow: /test/ # image bots User-agent: DittoSpyder User-agent: Googlebot Disallow: /*.gif$ Disallow: /*.jpg$