What Is Google Indexing?

Google indexing is the process of Google storing and organising a page so it can be returned in search results. If a page is not indexed, it cannot rank for anything, at any position, ever.

That is the short answer. The useful answer is that indexing is one of three distinct processes people routinely merge into one, and merging them is why so much SEO effort goes into fixing the wrong thing.

Crawling, indexing and ranking are not the same thing

Crawling is Google fetching your page. A crawler requests the URL and downloads what comes back.

Indexing is Google deciding to keep it. Having fetched the page, Google analyses the content, works out what it is about, checks whether it already holds something equivalent, and makes a judgement about whether to store it.

Ranking is Google deciding where to show it, for a given query, against everything else it holds.

They happen in that order and each one is a filter. A page can be crawled and not indexed. A page can be indexed and never rank. Nothing can rank without first being indexed.

Get the diagnosis wrong at this stage and you can spend six months on content quality for a page that was blocked by a robots.txt rule, or six months on link building for a page carrying a noindex tag.

How Google finds pages

Three routes, in rough order of weight:

Links. Google follows links, internal and external. This is still the primary discovery mechanism and it is why orphan pages struggle regardless of what else you do.

Sitemaps. A file listing the URLs you want indexed. Google reads it when it chooses.

Direct submission. Search Console requests, the Indexing API for supported content types, IndexNow for Bing and partners.

Discovery is only the first filter. Being found is not being crawled, and being crawled is not being kept.

What Google is deciding when it indexes

Roughly four things:

Is this accessible? Not blocked, not noindexed, returns a real status code, renders something.

Is this unique? If Google already holds something substantially the same, from your site or anyone else's, it may keep only one.

Is this useful? Some assessment of whether the page serves a purpose for a searcher.

Is this worth the storage? Google's index is finite and expensive. Not everything on the web earns a slot.

That last one is the least discussed and it explains most of the "Crawled - currently not indexed" cases. The page was not rejected as bad. It was not judged worth keeping.

Crawl budget, honestly

Crawl budget is the amount of crawling Google will do on your site in a given period, determined by how much load your server tolerates and how much demand Google has for your content.

An honest caveat that most articles selling something will skip: Google has said that most sites do not need to think about crawl budget at all. If you have a few thousand pages and they are published at a normal pace, budget is probably not your constraint. Your constraint is selection, which is a content question.

Crawl budget becomes a genuine limiter on large sites, sites with a lot of low-value URLs competing for attention, and sites where crawling is expensive because pages are slow.

Where it matters for everyone is the revisit schedule. Google decides how often to come back and check a page still exists and still deserves its slot. On a low-priority page that interval can stretch to months, which is why a page can silently drop out and stay out long after the underlying reason is gone.

How to check what is indexed

Search Console, Indexing → Pages, is authoritative. It tells you totals and, per URL, exactly why something is excluded.

The site: operator in Google gives a rough count. It is an estimate and it is not the same figure Search Console reports. Useful for a quick look, not for decisions.

Or use our free checker, which lists the URLs rather than just counting them.

What to do if pages are missing

Diagnose first. The fix is entirely different depending on the reason. Google not indexing your pages works through the nine causes and what each one needs, and how to index your website on Google lays out every route into the index.

If the answer turns out to be that your pages are fine and Google simply has not got round to them, that is what we built Daily Indexing for. We keep your sitemap current so Google can discover eligible pages, and send change notifications to Bing and compatible services through IndexNow — every day, so that when Google's priorities shift, your sitemap is already current and waiting. See how long Google takes to index for what to expect in the meantime, or compare daily indexing plans.

From £29 a month, per site, no VAT.