What is XML Sitemap?
An XML sitemap is a file that lists the URLs you want search engines to find and crawl. It sits at your domain root, usually /sitemap.xml, and gets submitted through Google Search Console. It does not force indexing. What it does give you is a clean inventory of your pages plus a last-modified date, which matters most on large sites with weak internal linking.
XML Sitemap File
How a sitemap gets read
The file lists each URL inside a <url> block with an optional <lastmod> timestamp, and Google will trust that timestamp only for as long as you keep it honest, because a system that stamps every date to today on every deploy teaches the crawler to ignore the signal completely.
Limits are 50,000 URLs and 50MB uncompressed per file, past which you split into multiple sitemaps and add a sitemap index pointing at them, though most e-commerce platforms handle the whole arrangement without you touching anything. Shopify generates one for products, one for collections, one for pages.
Submit it in Search Console. Reference it in robots.txt too, on a Sitemap: line, because Bing and the other crawlers pick it up from there.
The errors that keep showing up
Including URLs that redirect, return 404, or carry a noindex tag tells Google something about the care you take with the whole file, and once trust in the file drops the crawler stops treating it as a reliable inventory. Your sitemap should carry only canonical, indexable, 200-status URLs. Nothing else.
Second problem: stale generation. A real estate site in Noida adds twenty new project listings on a Tuesday, the sitemap plugin only regenerates on a weekly cron, and those listings sit uncrawled for days while the sales team wonders why nobody is calling. Set regeneration to fire on publish.
Third, and subtlest, is submitting the sitemap and considering the job finished, when Search Console is right there telling you how many URLs went in against how many came out indexed, and that gap is the actual diagnostic. Read it monthly.
What this looks like in practice
For a Gurugram furniture store on Shopify carrying roughly 900 SKUs, the useful monthly habit is opening the sitemap index and comparing submitted counts against indexed counts, because if 900 go in and 340 come out the file is fine and the product pages are thin. Fix the pages.
The same check catches seasonal drift, since discontinued products linger in the sitemap long after their pages start returning 404s, usually because the export job reads a stale table rather than live inventory. Ten minutes a quarter. Worth it.
Related terms: A/B Testing · AEO (Answer Engine Optimisation) · AI Overviews.
Where this shows up in the work: SEO & AI Search · Full glossary.
XML Sitemap — questions, answered.
A site under fifty pages with solid internal linking will get crawled fine without one. Add it anyway. It costs nothing to generate and it gives you the submitted-versus-indexed data in Search Console, which is genuinely useful diagnostic information.
Whenever content changes. Most content management systems regenerate on publish, which is the right setting. For a store adding products daily, that means daily. For a brochure site, it might be once a quarter, and that is perfectly normal.
Last updated 2026-08-08
Ready to replace guesswork with a growth engine?
Book a 30-minute strategy call. We’ll show you exactly where your funnel is leaking, before you spend a dollar.