User-Agent: * Disallow: /admin/ Disallow: /cronjob/ Disallow: /data/ Disallow: /site/ Disallow: /templates/ Disallow: /vcore/ #Block out things that are secure or login oriented Disallow: /registration.html