Your XML sitemap should list the pages you want Google to index, and nothing else. Over time it fills up with URLs that redirect, fail or carry a noindex, and it misses new pages. That sends Google mixed signals.
AD2SPIDER downloads your sitemaps and compares them with what it finds while crawling: which indexable pages are missing, which URLs should not be there and why, which URLs appear in several sitemaps, and whether the sitemaps themselves are valid, reachable and within size limits.
XML sitemaps errors
They stop the page from working or being indexed properly. Fix them first.
Unreachable sitemap
- Why it matters
- The sitemap does not return 200: search engines cannot read it.
- How to fix it
- Fix the sitemap URL or server error, and update robots.txt.
Invalid sitemap
- Why it matters
- The file is not a valid sitemap XML (urlset or sitemapindex).
- How to fix it
- Generate the sitemap following the sitemaps.org protocol.
Sitemap with more than 50,000 URLs
- Why it matters
- The protocol limits each sitemap to 50,000 URLs; the excess may be ignored.
- How to fix it
- Split the sitemap and reference the parts from an index.
Sitemap larger than 50 MB
- Why it matters
- The protocol limits each sitemap to 50 MB uncompressed.
- How to fix it
- Split the sitemap into several files.
XML sitemaps warnings
Real problems worth fixing.
Invalid URL in sitemap
- Why it matters
- A <loc> is not a valid absolute HTTP(S) URL.
- How to fix it
- Use full absolute URLs with scheme and domain.
Other site's URL in sitemap
- Why it matters
- The sitemap includes URLs from another domain or subdomain: Google only accepts those on the sitemap's own host, unless cross-submission is verified, and ignores the rest.
- How to fix it
- Include only the site's own URLs (or verify cross-site ownership).
Sitemap URL not returning 200
- Why it matters
- The sitemap should list final canonical URLs; this one redirects or errors.
- How to fix it
- Replace it with the final URL or remove it from the sitemap.
Non-indexable URL in sitemap
- Why it matters
- You ask to index a URL that is not eligible (e.g. noindex): contradictory signal.
- How to fix it
- Remove it from the sitemap or remove what makes it non-indexable.
Canonicalised URL in sitemap
- Why it matters
- The sitemap includes a URL whose canonical points elsewhere: sitemaps should only contain canonicals.
- How to fix it
- Replace it with the canonical URL.
Sitemap URL blocked by robots.txt
- Why it matters
- You ask to crawl a URL that robots.txt forbids: contradictory signal.
- How to fix it
- Unblock it in robots.txt or remove it from the sitemap.
XML sitemaps opportunities
Improvements with impact, usually based on configurable thresholds.
URL in multiple sitemaps
- Why it matters
- The same URL appears in several sitemaps. Not an error, but it muddles per-sitemap tracking in Search Console and often reveals overlapping sitemaps.
- How to fix it
- List each URL in a single sitemap, organized by section or content type.
Indexable page missing from sitemap
- Why it matters
- The page is eligible for indexing but is not in any of the site's sitemaps.
- How to fix it
- Add it to the sitemap if it should rank.