# Robots.txt Structure Copyright 2009 file All rights reserved For domain: http://www.millag5cleaningagency.co.uk/ # All robots will spider the domain User-agent: * Allow: / Disallow: /sitemap-text/ Disallow: