User-agent: Screaming Frog SEO Spider Allow: / User-agent: * Crawl-delay: 10 # Directories User-agent: * Disallow: /wp-admin Sitemap: http://www.byronyoga.com/sitemap_index.xml