Skip to content
Searchpedia SEO field notes Callum Bennett Callum

Site ops

What Is a Sitemap

I used to think a sitemap was a mandatory SEO accessory; now I only recommend them for sites where Google cannot find every important page on its own.

Beginner6 min readUpdated 2026-07-27Notes by Callum Bennett

Start here

  • Submit your sitemap in Google Search Console – it is the fastest way to tell Google about new pages.
  • Only include URLs that are indexable: no redirects, no noindex, no blocked pages.
  • Use a plugin if you are on WordPress (Yoast, Rank Math) — they auto-update the sitemap when you publish.
  • Do not confuse an XML sitemap with an HTML sitemap meant for users.

Plain-English take

A sitemap is not a ranking factor. I have met SEOs who believe otherwise, but Google is explicit: it is a crawl hint. Think of it as a list you hand to search engines saying: these are the pages I want you to find. The file itself is usually XML, with each URL wrapped in <url> tags. You can include extra information like when the page was last modified, how often it changes, and its priority relative to other pages. I have seen sitemaps resurrect pages that were buried three levels deep in navigation. I have also seen sitemaps ignored because the site had perfect internal linking. The key is to know when to lean on it and when to leave it alone.

A sitemap becomes useful when your site is large, new, or has orphan pages. For a blog with 50 articles and a well-connected structure, your time is better spent on content. For a product catalogue with 10,000 SKUs, a sitemap is non-negotiable. I once added a sitemap to a client site that had thousands of pages no one had ever linked to. Within two weeks, Google indexed 80% of them. That is the win.

I include a sitemap on every site I build, but I do not assume it will help. I test. I check coverage in Search Console. If the sitemap shows low indexed-to-submitted ratio, I know something is wrong with the included URLs or the site's crawlability. A sitemap is a tool, not a talisman. I often point sitemap beginners towards [Technical SEO](/technical-seo/) to understand the broader crawl picture.

When it actually matters

When does a sitemap earn its keep? When your site has more than a few hundred pages, when you publish frequently, or when important pages are not reachable from the main navigation. I worked on a news site that published 20 articles a day. Without a sitemap, Google found only the front page and the section headers. Adding a sitemap with <lastmod> timestamps cut the time to index new articles from hours to minutes.

For new domains, a sitemap speeds up initial discovery. Googlebot has to start somewhere, and a sitemap gives it a roadmap. I saw a brand-new site have its first crawl within 24 hours of submitting the sitemap. Without one, it might have waited weeks.

But for a small personal site? Skip it. I wasted a Sunday building a sitemap for my 10-page portfolio, and Google had already indexed all of it. The sitemap changed nothing. The rule of thumb: if your internal links cover every significant page, you do not need a sitemap. If they do not, you do.

You can point to your sitemap in your robots.txt file. That is the simplest way to make it discoverable. I always add Sitemap: https://example.com/sitemap.xml to the top of [robots.txt](/robots-txt/). It is a one-line setup that covers every search engine.

How it shows up

A sitemap typically lives at /sitemap.xml on your domain. Open it and you see something like this:

<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
  <url>
    <loc>https://example.com/blog/post</loc>
    <lastmod>2025-03-15</lastmod>
    <changefreq>monthly</changefreq>
    <priority>0.8</priority>
  </url>
</urlset>

Each <url> entry is one page. <loc> is the URL, required. <lastmod> tells the crawler when the content changed. <changefreq> and <priority> are hints, not commands. Search engines largely ignore priority. I rarely include those tags; they add noise.

Sitemaps can also list images, videos, and news articles using extensions. I once ran a news site that used a news sitemap to get articles into Google News quickly. That is a different XML schema but the same idea.

For sites that rely heavily on JavaScript to render content, a sitemap is critical. Google might not execute all the JS to find your links. I have debugged sites where the sitemap was the only way Google discovered pages behind a JavaScript click handler. If that sounds like your site, double-check your sitemap coverage. I cover this more in my [JavaScript SEO](/javascript-seo/) notes.

You can have multiple sitemaps, each dedicated to a section like products or news, and then a single index sitemap that points to all of them. That is useful for very large sites. I manage a site with 50,000 URLs split across 10 sitemaps, all aggregated in one index file.

The tradeoffs

The biggest tradeoff is time vs. return. For a small site, you can spend an hour setting up a sitemap and see zero benefit. I have done that. It is frustrating. For a large site, a sitemap is indispensable. But there is another tradeoff: what you include. I used to submit every URL I could find — tag pages, archive pages, filter pages — but Google then wasted crawl budget on pages with thin or duplicate content. Now I only include URLs that are indexable. That means no redirects, no noindex, no blocked by robots.txt. I audit my sitemap regularly.

A sitemap can also encourage Google to crawl pages you do not want indexed. If you accidentally include a staging environment URL, Google might crawl it. That happened to a colleague when a dev copied the sitemap from production. The fix: always verify the domain and exclude non-production URLs.

Another tradeoff: maintenance. If you have a dynamic site with frequent changes, your sitemap must update often. Plugins do this automatically, but if you manually maintain a sitemap, you will forget to update it. I have. That leads to stale pages in the index.

Ultimately, a sitemap is a promise to search engines about what is important. Keep that promise. If you promise a page exists and it returns a 404, you waste trust. I review sitemap health in my monthly [SEO audit](/seo-audit/). I also keep an eye on [duplicate content](/duplicate-content/) issues that can creep in through included URLs.

What I got wrong

I used to think a sitemap was a ranking factor. It is not. Google says it is a crawl hint, and it can be ignored entirely if internal linking is strong. That was a hard lesson when I saw a site with a perfect sitemap lose rankings because Google chose not to crawl it.

I also included every URL I could find — tag pages, archive pages, even paginated pages. Those pages often had thin content or were noindexed. I was basically telling Google to crawl garbage. It took me a while to realise I should only submit pages I actually want in the index. Now I filter out anything that is low-quality or administrative.

Another mistake: I did not update the sitemap after a site migration. The URLs all changed, but the sitemap still pointed to the old domain. Google tried to crawl those old URLs, got 404s, and dropped those pages. I lost traffic for weeks. Now I always regenerate and resubmit the sitemap after a move. Proper [SEO audits](/seo-audits/) catch this.

Finally, I assumed that submitting a sitemap guarantees indexing. It does not. I had pages in a sitemap that remained unindexed for months because they had no internal links. The sitemap helps, but it does not replace a solid site structure.

Next step

Quick answers

Can a sitemap hurt my SEO?

Yes, it can if you include non-indexable URLs such as redirects or noindex pages. That wastes crawl budget and might cause search engines to devalue your sitemap. I always audit my sitemap to ensure every URL is indexable, and I remove staging or duplicate URLs. A clean sitemap signals trust.

Is an HTML sitemap still necessary for SEO?

Not really. XML sitemaps are the standard for search engines. HTML sitemaps were popular a decade ago to help users navigate, but modern navigation and search have made them less necessary. Still, a well-organised HTML sitemap can improve user experience on large ecommerce sites.

How do I submit a sitemap to Google?

Go to Google Search Console, select your property, click Sitemaps in the left nav, enter the sitemap URL, and click Submit. You can also add the sitemap URL in your robots.txt file for automatic discovery. Google will start crawling it within days.

Sources

Primary documentation is linked directly. Anything commercial is marked nofollow.

Notes from Callum Bennett.