Three things happen in order: a page is found, it is stored in the index, and then it is ranked against other pages for a given search. A failure at any stage produces the same symptom, which is not appearing in results, and the fixes are completely different, so the first job is establishing which stage failed.
The three stages
| Stage | What happens | If it fails |
|---|---|---|
| Crawling | A crawler follows a link and requests the page | The engine does not know the page exists |
| Indexing | The page is read, understood, and stored | The engine has seen it and chosen not to keep it |
| Ranking | The stored page is weighed against others for a search | It is stored and losing to better answers |
People collapse all three into ranking, which is why so much effort gets spent on content and links for a page that was never indexed in the first place.
Crawled but not indexed
The most confusing state, and a common one. The engine visited the page, read it, and decided not to store it.
That is a judgement rather than an error. It generally means the page was assessed as not adding anything: very thin content, near-duplicate of another page, an automatically generated page with little unique text, or one nothing on the site treats as important.
It also affects entire categories of page that businesses create in bulk. Twenty location pages differing only by a place name are frequently crawled and then largely ignored, which is why the advice about writing genuinely distinct pages is practical rather than aesthetic.
Discovered but not crawled
The engine knows the address exists, usually from a sitemap or a link, and has not yet visited.
On a new or small site this is normal and resolves with time. Where it persists across many pages it usually means the site is producing more addresses than its standing justifies, which happens with filters, search results pages, or a calendar generating an address per date.
Indexed and not ranking
The page is stored and does not appear for the searches you expect. This is the only one of the three that is genuinely a ranking problem, and it is the smallest category of the four.
Causes here are ordinary: better pages exist, the page does not match the intent behind the search, the site has little authority in that subject, or two of your own pages are competing for the same term.
The useful check is impressions rather than position. A page with impressions is being shown and losing on selection. A page with none for its target terms is not in the running at all, which points back at the earlier stages.
How to tell which one you have
The inspection tool in the search console answers it directly for a single page, in about thirty seconds. Paste the address and it reports whether the page is indexed, when it was last crawled, and if it is excluded, the reason.
The page indexing report does the same across the whole site, grouping pages by status with a reason for each exclusion. Most reasons are benign, and what matters is finding a page you care about sitting in the excluded list.
This is the check to run before any content work, because everything downstream assumes the page is at least stored. How pages get found in the first place is covered in how search engines find your pages.
The fixes, by stage
Not crawled
Link to it from pages that already perform. Include it in the sitemap. Confirm nothing is blocking crawlers, particularly a leftover instruction from a build.
Crawled, not indexed
Make the page worth storing. More substance, genuinely distinct from your other pages, and something on the site treating it as important through internal links. Where two pages overlap heavily, merging them into one is frequently better than trying to get both indexed.
Indexed, not ranking
Compare against what does rank for that term. Usually the gap is coverage: the pages above answer six questions and yours answers two. Occasionally it is intent, meaning the page type does not match what the search wants.
The excluded reasons that are fine
Worth saying, because the report alarms people unnecessarily.
Pages excluded as redirects, as duplicates where the engine chose a different version, or because you deliberately told it not to index them, are all working as intended. A confirmation page or a thank-you page not being indexed is correct.
The only entries worth acting on are pages you want found sitting in a category you did not intend. Everything else can be left alone, and treating the report as a list of faults to clear is a good way to spend a week achieving nothing.
Frequently asked questions
What is the difference between indexing and ranking?
Indexing is whether a page is stored by the search engine at all. Ranking is how it performs against other pages once stored. A page that is not indexed is not ranking badly, it is not competing.
What does crawled but not indexed mean?
The engine visited the page and decided not to store it, usually because it was assessed as thin, near-duplicate, or not treated as important by anything else on the site.
How do I check whether a page is indexed?
Use the URL inspection tool in the search console, which reports the status of a single page in about thirty seconds including the reason for any exclusion.
Why are my location pages not indexed?
Pages differing only by a place name are frequently crawled and then ignored as near-duplicates. Each needs genuinely distinct content about work you have actually done in that area.
Should I fix everything in the page indexing report?
No. Redirects, duplicates where the engine chose another version, and pages you deliberately excluded are all working as intended. Only act on pages you want found that appear where you did not intend.
How do I tell if a page is ranking poorly or not competing?
Check impressions. A page with impressions is being shown and losing on selection. A page with none for its target terms is not in the running, which points at indexing rather than ranking.
West Coast Media Solutions Inc. provides web design, web development, hosting, digital marketing, and business consulting to organisations across Canada, drawing on more than twenty-five years in the field.
Pages that never appear no matter what you write?
We check which of the three stages is actually failing, because content work on a page that was never indexed changes nothing.
Start a Conversation