# # This file is used to allow crawlers to index our site. # # List of all web robots: http://www.robotstxt.org/wc/active/html/index.html # # Check robots.txt at: # http://www.searchengineworld.com/cgi-bin/robotcheck.cgi # # Details about Googlebot available at: http://www.google.com/bot.html # The Google search engine can see everything # #This robots.txt borrowed / modified from macromedia.com User-agent: Googlebot Disallow: /includes/ Disallow: /css/ Disallow: /gr/ Disallow: /js/ Disallow: /data/ Disallow: /install/ Disallow: /pages/ User-agent: Googlebot-Image Disallow: / # All other robots will be restricted from accessing the following files User-agent: * Disallow: /includes/ Disallow: /css/ Disallow: /gr/ Disallow: /js/ Disallow: /data/ Disallow: /install/ Disallow: /pages/