SEO Glossary

Crawl Budget

Definition

The number of pages a search engine will crawl on your site within a given timeframe.

Crawl budget is the number of URLs search-engine bots are willing and able to crawl on your site in a given period. It matters most for large sites — wasting it on low-value or duplicate URLs means important pages get crawled and indexed more slowly.

auto_stories
Pillar Guide Crawling & Indexing — Complete Guide
arrow_forward