User-Agent: * Disallow: /files Disallow: /assets Disallow: /cgi-bin Disallow: /protected Sitemap: /sitemap.xml