What is crawl budget?

Crawl budget is the limit on how much and how often Google crawls your site. It has two parts: crawl capacity (how many requests it can make without straining your server; it grows when the site responds quickly and without errors) and crawl demand (how much Google wants to crawl, based on the site's popularity and how often content changes).

#Why it matters

For sites with a few hundred pages, crawl budget is rarely an issue. It does matter for stores with tens of thousands of URLs, sites that generate filter and parameter combinations, and slow servers. If the budget goes to redirect chains, 404s and duplicate parameter URLs, new and updated pages are discovered and indexed late.

#Where you see it in SEOAsist

Crawl budget is Google's concept; SEOAsist doesn't measure it directly, but it shows the problems that waste it:

• Technical Audit: Redirect chain (2+ hops), Broken internal link (4xx), Pages returning a server error (5xx) and Slow response (> 3 s) all directly affect crawl budget.
• Monitors → Index status: the Google last crawl column shows when Google last crawled your important pages.

#Example

/shoes?color=black&size=40&sort=price
/shoes?size=40&color=black&sort=price
/shoes?color=black&size=40&sort=price&page=1

Hundreds of variations of the same content get crawled. Blocking low-value parameters in robots.txt and pointing to the main URL with a canonical steer the budget toward important pages.

#Common mistakes

• Blaming crawl budget for indexing problems on a small site; the cause is usually content quality.
• Listing redirected and 404 URLs in the sitemap.
• Ignoring slow responses and 5xx errors; Google slows crawling when it sees errors.