# robots.txt file created 01/27/1999 # # robots.txt is a file retrieved by search engine spiders that conforms # to standards set forth by the Internet Engineering Task Force (IETF) # # For further guidance, please refer to: # # 1) http://info.webcrawler.com/mak/projects/robots/robots.html # 2) http:/info.webcrawler.com/mak/projects/robots/norobots-rfc.html # # A most helpful robots.txt "syntax checker" is located at: # # http://www.tardis.ed.ac.uk/~sxw/robots/check/ # # site developed by The Arcadia GlassHouse, Resource PArk, Inc & Websitement(R) Comm Corp # using Websitement(R) QueryMaster(TM) technology # # Webmaster: Greg Weiland - gw@websitement-tm.com, gw@querymaster.com # # NOTES: # # 07/25/1999 - Syntax is case sensitive: # carriage returns are not allowed between lines # # 09/12/1999 - The "*" following "User-agent:" prevents access by # ALL spiders # to directories listed as: "Disallow: /xxxxxx" # # ------------------------------------------------------------------------- User-agent: * Disallow: /_private Disallow: /_vti_bin Disallow: /_vti_cnf Disallow: /_vti_log Disallow: /_vti_pvt Disallow: /_vti_txt Disallow: /igneus Disallow: /image Disallow: /images Disallow: /work Disallow: /DirOnlyFoundInRobotsTxt