User-agent: * Disallow: /wp-admin/ Disallow: /newsevents/ Disallow: /feed/ Allow: /wp-admin/admin-ajax.php Sitemap: https://cmoe.com/sitemap_index.xml User-agent: ChatGPT-User Disallow: / User-agent: GPTBot Disallow: / ## Majestic SEO ## User-Agent: MJ12bot Crawl-Delay: 5 ## ahrefs bot ## User-agent: AhrefsBot Crawl-Delay: 5 User-agent: SemrushBot Crawl-delay: 5 ## SemrushBot for different SEO and technical issues ## User-agent: SiteAuditBot Crawl-Delay: 5 ## SemrushBot for Backlink Audit tool ## User-agent: SemrushBot-BA Crawl-Delay: 5 ## SemrushBot for On Page SEO Checker tool and similar tools ## User-agent: SemrushBot-SI Crawl-Delay: 5 ## SemrushBot from checking URLs on your site for SWA tool: User-agent: SemrushBot-SWA Crawl-Delay: 5 ## SemrushBot for Content Analyzer and Post Tracking tools ## User-agent: SemrushBot-CT Crawl-Delay: 5 ## SplitSignalBot for SplitSignal tool ## User-agent: SplitSignalBot Crawl-Delay: 5 ## SemrushBot-COUB for Content Outline Builder tool ## User-agent: SemrushBot-COUB Crawl-Delay: 5 ## https://www.babbar.tech/crawler ## User-agent: barkrowler Crawl-Delay: 5