The set of URLs on your site that Google can and wants to crawl in a period, shaped by how much your server can handle and how much Google wants your content. Google says it mainly matters for very large or fast-changing sites.
Example
Meera's site has about 600 pages, and new ones are crawled within a day. Crawl budget is not her problem. A marketplace with a million filter URLs would need to manage it.
How you'll hear it
“With five lakh filter URLs, we are wasting crawl budget; block the junk parameters and fix the sitemap.”
Don't confuse it with
- Indexing limit: there is no fixed number of pages Google will index for you. Crawl budget concerns crawling, which comes before indexing.
Related terms
Want to use this at work? AI-led SEO Excellence is aFactor's 16-week program for SEO work.
Sources
- Crawl budget management for large sites, Google Search Central