If you want to run a site audit and monitor your site health using Search Atlas, sometimes our site crawlers get blocked by CDNs.
Content Delivery Networks (CDNs) are a group of servers that help deliver website content faster. If your website relies on a CDN to increase the performance of your website, then it’s possible the CDN’s firewall will block our crawler from accessing your site.
Resolving this issue is fairly straightforward and requires whitelisting the Search Atlas site crawler. This post will explain how to do so on Cloudflare, as it is the most popular CDN provider for webmasters.
If you are using another CDN, the process is similar, and can still be done by following the steps outlined below.
Shivam Kaushik is a Senior Content Strategist at Search Atlas. She has over 5 years of content marketing and SEO experience. She writes about content strategy, SEO software tools, AI, and other digital marketing topics.
The #1 SEO platform for site owners, digital marketers, and SEO professionals.