When crawl budget is worth the effort

Every audit we run turns up some version of this. Crawl budget is not free, and pretending otherwise leads to bad decisions.

Search work compounds slowly, which is why it gets abandoned about two months before it would have paid off. It is the sort of thing that looks like polish right up until it costs you an enquiry.

When it is worth it

Large sites can waste crawling on pages nobody should see. The cost of getting this wrong is rarely visible on the day it happens. If it only works because one person remembers to do something, it does not work yet.

When it is not

If nothing downstream depends on it and nobody is complaining, it can wait. The cost of getting this wrong is rarely visible on the day it happens.

How to decide

Clean internal linking is most of the fix. It is worth being explicit about, because assumptions differ quietly. It is the sort of thing that looks like polish right up until it costs you an enquiry.

How to tell if yours is fine

Technical fixes remove obstacles; content earns the position. Both are needed and they are not interchangeable. Three things worth confirming about crawl budget before you move on:

• Someone can say what the current setup is without going to look
• Clean internal linking is most of the fix — and you know whether that is true here
• There is a way to tell whether the last change to this helped

Pick the one that would hurt most if it failed, and start there.