# Robots.txt file from http://www.csswebs.org # All robots will spider the domain User-Agent: * Disallow: /login.asp Disallow: /DATA Disallow: /db/template Disallow: /bbs/Data Disallow: /db/admin Allow: / Disallow: /zongg Disallow: /xyl/data