Technical4 min read

How Google crawls vs. indexes vs. ranks websites

“Google isn't ranking my page” can mean three completely different problems, because getting a page into search results is three distinct stages: crawling (finding and fetching it), indexing (understanding and storing it), and ranking (ordering it against competitors for a query). They're constantly conflated, and the confusion sends people fixing the wrong thing. This guide separates the three, shows where each can fail, and maps how site structure influences all three at once.

smart_toy

Run the Can Google Render My Site? on your site — free, no account.

Check what bots can crawl free

The three stages

A page travels through a pipeline, and it can stall at any stage. Diagnosing 'why isn't this ranking?' starts with identifying which stage it's actually stuck at — because the fix for a crawling problem is nothing like the fix for a ranking one.

The pipeline

CRAWL ─────────► INDEX ─────────► RANK
find & fetch     understand &      order vs
the page         store it          competitors
                 (eligible to      for a query
                  appear)

fails if:        fails if:         fails if:
no links in,     noindex, thin/    weak content,
blocked,         duplicate, JS     intent mismatch,
too deep         not rendered      low authority,
                                   strong competition

Three gates in sequence. A page must pass each to reach results. 'Not ranking' could mean it was never crawled, was crawled but not indexed, or is indexed but outranked — three different problems.

Crawling — finding and fetching

Crawling is discovery plus fetching. Googlebot finds pages by following links from pages it already knows (and, secondarily, sitemaps), then fetches them. This is the most structural of the three stages: a page with no inbound internal links is an orphan the crawler may never reach, and a page buried at high crawl depth is fetched rarely. Crawling fails from missing links, robots blocks, or budget exhaustion on large sites — covered in how Google discovers new pages.

Indexing — understanding and storing

Being crawled doesn't mean being indexed. Indexing is where Google renders the page (running JavaScript if needed), understands its content, deduplicates it against canonicals, and decides whether it's eligible to appear in results at all. A page can be crawled and still excluded — by a noindex tag, by being judged thin or duplicate, or because its meaningful content only appears after JavaScript the renderer didn't execute reliably.

info

Index ≠ rank: An indexed page is merely eligible to appear — it's in the library. Whether it shows up for a given search, and where, is the separate ranking stage. 'Indexed, not ranking' is a content/authority problem, not an indexing one.

Ranking — ordering against competitors

Ranking is the stage everyone means when they say 'SEO': for a given query, Google orders the eligible indexed pages by hundreds of signals — relevance to the query and intent, content quality, trust, and authority (both external backlinks and where internal authority flow has concentrated). A page can be perfectly crawled and indexed and still sit on page five because competitors are stronger or its content doesn't match intent. Structure helps here too — by routing authority to the page — but it can't substitute for relevance and quality.

Where structure fits each stage

Internal structure touches all three

STAGE     STRUCTURE'S ROLE
────────  ──────────────────────────────────────────
Crawl     internal links = the crawl path; depth sets
          crawl frequency. No links in → not found.
Index     clean canonical/URL structure prevents
          duplicate dilution; rendered HTML aids
          understanding.
Rank      authority flow concentrates internal equity
          on the page; relevant anchors signal topic.

This is why structural SEO is high-leverage: the same internal link graph influences all three stages. But it's necessary, not sufficient — structure can't make thin content rank or fix a noindex.

Diagnosing which stage failed

chevron_rightNot crawled — the URL isn't in Search Console's crawl data; check for orphan status, robots blocks, and depth. Fix with internal links.
chevron_rightCrawled, not indexed — Search Console says 'Discovered/Crawled — currently not indexed' or 'Excluded'. Check noindex, canonicals, duplication, thin content, and JS rendering.
chevron_rightIndexed, not ranking — the page is in the index (site: search finds it) but ranks poorly. This is a content, intent, authority, or competition problem — not a crawl/index one.

lightbulb

Always identify the stage first: Most wasted SEO effort comes from fixing the wrong stage — rewriting content for a page that was never crawled, or chasing links for a page that's blocked by noindex. Diagnose the stage, then apply the matching fix.

FAQ

What's the difference between crawling, indexing, and ranking?expand_more

Crawling is Google finding and fetching a page by following links. Indexing is Google rendering, understanding, deduplicating, and storing it so it's eligible to appear. Ranking is ordering eligible indexed pages against competitors for a specific query. A page must pass all three in sequence, and it can fail at any one.

My page is indexed but not ranking — why?expand_more

Indexing only makes a page eligible to appear; it doesn't guarantee a position. 'Indexed, not ranking' is a ranking-stage problem — usually weak or off-intent content, low authority (few backlinks or starved internal authority), or simply stronger competitors. It's not an indexing or crawling issue.

Does internal linking affect indexing?expand_more

Indirectly, yes. Internal links drive crawling (a page must be reached to be indexed), and a clean canonical/URL structure helps Google deduplicate correctly so authority consolidates on one indexed page. But a noindex tag or thin content will keep a well-linked page out of the index regardless.