Google: Noindexed Pages Do Not Effect Crawl Budget Plan

Posted by

Google’s Search Relations group verifies that noindexed pages do not negatively impact a website’s crawl budget, no matter the number of a site has.

This topic is dealt with not when but thrice during the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Browse Advocates John Mueller and Gary Illyes take turns addressing 3 comparable concerns from individuals worried they have too many noindexed pages on their sites.

From Mueller’s and Illyes’ reactions, we learn there’s no such thing as “a lot of” indexed pages. Even more, unless your site has more than a million pages, there’s no requirement to worry about crawl spending plan.

Here’s a fast wrap-up of each concern and answer.

Concern 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a concern asking if an “excessive” number of indexed pages is a concern for discovery or indexed.

Illyes states noindex is a tool to assist websites keep material out of search engines. Google encourages using the noindex tag when necessary, and for that reason, there are no adverse effects connected with it.

“Noindex is a really powerful tool that search engines support to help you, this site owner, keep material out of their indexes. For this factor, it doesn’t carry any unexpected impacts when it pertains to crawling and indexing. For instance, having many pages with noindex will not affect how Google crawls and indexes your website.”

Concern 2: Ratio Of Indexed/Noindexed Pages

The following question comes up at the 10:22 mark:

“Should we keep an eye on the ratio in between indexed and non-indexed pages in Browse Console in order to better recognize potentially wasted crawl spending plan on non-indexed pages?”

Mueller exposes that websites need to attempt to balance their indexed and nonindexed pages.

To that end, crawl budget is a factor that few sites require to consider; Mueller says:

“No, there is no magic ratio to keep an eye out for. Also, for a site that’s not gigantic, with less than a million pages, possibly, you actually don’t need to stress over the crawl budget plan of your site. It’s great to remove unneeded internal links, but for small to medium-sized sites, that’s more of a website hygiene subject than an SEO one.”

Concern 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a concern comes up about no indexed pages that’s slightly different from the previous 2.

The question checks out:

“A lot of SEOs are complaining about having millions of URLs flagged as excluded by noindex in Google Browse Console. All to nonsense internal search pages linked from spammy sites. Is this a problem for crawl spending plan?”

Ilyes reiterates the earlier point about noindex being a tool for websites to utilize as needed.

Presuming the pages are deliberately noindexed, there’s no need to stress over Browse Console flagging them. It doesn’t suggest you’re doing anything incorrect.

Illyes states:

“Noindex is there to help you keep things out of the index, and it doesn’t come with unintended negative effects, as we said formerly. If you wish to guarantee that those pages or their URLs, more specifically, don’t wind up in Google’s index, continue utilizing noindex and don’t stress over crawl budget.”

Source: Google