User-Agent: * Allow: /wp-admin/admin-ajax.php Disallow: /wp-admin Crawl-delay: 5 Disallow: /*? Disallow: /rssfeed.asp Disallow: /comments/ User-agent: Rogerbot Disallow: / User-agent: Exabot Disallow: / User-agent: Dotbot Disallow: / User-agent: Gigabot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / Sitemap: https://www.pills4ever.com/sitemap_index.xml