Why did my site audit fail?

Why did my site audit fail?

Your site audit might fail for several reasons, including:
  1. Bot blocking
  2. File type mismatch
  3. The sitemap URL is inaccessible

Bot Blocking

If your hosting/server provider prevents all but search engines from crawling your website, the audit might fail. If this is the reason, you would see a failed status for your audit or a message about the bot being blocked. e.g.:

Fixes for Bot Blocking

To fix this, you can allow KonvartBot in your robots.txt by adding this line:
  1. User-agent: KonvartBot
  2. Allow: /
If you use Cloudflare or an advanced bot-blocking system, you need to go to that provider to allow KonvartBot. For example, on Cloudflare, go to Security > Security rules > Create rule > Custom Rules

Select "User Agent" in "Field", "Contains" in "Operator" and "KonvartBot" in "Value". Under "Choose action", select "Skip"


Select the WAF componets to skip as seen in the screenshot below.

You could also allow KonvartBot using the WAF settings in Cloudflare or your provider, as long as your settings match:
  1. (http.user_agent contains "KonvartBot")

File Type Mismatch

File type mismatch happens when you select "regular sitemap URL" but your sitemap URL is a sitemap index or vice versa. Start a new site audit for the same project and URL, but select the correct option to fix it.

Sitemap URL is Unaccessible

This happens when your server is down (we get a 5xx error) or your sitemap is not found (a 4xx error). Check your server and sitemap to fix this.

    Access Konvart

      • Related Articles

      • How to change site audit cadence

        By default, all site audits are projects to be audited every week. You can change your cadence from weekly to daily or annually. To do that, click on the three dots on your Technical site audit screen: Select settings, and then change your schedule ...

      • How to use the Site Audit tool

        The Konvart site audit tool lets you get a full audit of all the URLs on your sitemap (XML). This is an automated audit that is repeated every seven days. Video Guide <br> Text Guide Step 1: Search Navigate to "Technical" at the top navigation ...

      • How to use the Page Audit tool

        The Konvart page audit tool lets you see the nitty-gritty about individual pages. This is especially relevant if you are hyper-focused on optimizing one page and need to see technical issues for that page alone. Video Guide <br> Text ...