Sitemaps and Spidering

The great advantage of a sitemap (for SEO purposes) comes from its ability to reduce the number of links that must be followed in order to reach all pages on a site. Sitemaps have a unique ability to garner the attention of search engine spiders and crawlers - making for much faster indexing, and thus, faster rankings.

The boost provided by sitemaps hasn't been measured in full, but many SEOs suspect that bots may have an innate ability and preference for spidering sitemaps. Several rules govern the construction and maintenance of sitemaps to achieve optimal benefits:

  1. Make sure your sitemap is linked to by every page on the site (this ensures even distribution and increases the frequency of spidering.
  2. Don't have more than 200 links on a sitemap page. In Google's ancient recommendations page, this number is 100, but reports from around the SEO community indicate there is no detriment to having up to 200 links on the page.
  3. Try to refrain from external linking on the sitemap page. For both users and spiders, the sitemap has an established purpose as the index of your website's own pages. Externally linking is a detractor.