# Robots.txt file for www.ccstalbans.org.uk # All robots will spider the domain, except for members area, user login # and search User-agent: * Disallow: /members_area Disallow: /user/ Disallow: /content/search Disallow: /content/advancedsearch