15% OFF for Users – Use code: 15off

What is Indexing?

Indexing is the process by which a search engine stores a crawled page in its searchable database. A page that is crawled but not indexed will never appear in search results. Indexing is the second step in the SEO pipeline, after {crawlability} and before ranking, and it's where many SEO problems silently break.

Why Indexing Matters

Indexing problems are far more common than most SEOs realise. A 2024 Onely study of 4 million URLs found that 16% of submitted URLs were excluded from Google's index for reasons including 'crawled, not indexed' and 'discovered, not indexed'. Every excluded URL is content that produces zero impressions and zero organic traffic, regardless of how good the content is.

How Indexing Works

After Googlebot crawls a page, the indexing system processes the HTML, extracts the content, renders any JavaScript, and decides whether the page is worth storing. Pages can fail to index for technical reasons (noindex tags, canonicals pointing elsewhere) or quality reasons (Google's own determination that the content adds no value to the index).

Search Console's Pages report shows the index status of every known URL, broken down by reason. 'Indexed' means the page is eligible to rank. 'Crawled, not indexed' means Google saw the page and chose not to store it, usually a content quality signal. 'Discovered, not indexed' means Google found the URL but hasn't crawled it yet, often a crawl budget signal on large sites.

Common Indexing Problems

How to Improve Indexing

  1. Submit a clean XML sitemap covering all important URLs
  2. Review the Search Console Pages report monthly for excluded URLs
  3. Consolidate duplicate content via canonicals or 301 redirects
  4. Use the URL Inspection tool to request reindexing of high-priority pages
  5. Strengthen thin pages with original content, depth, and internal links
  6. Improve site authority via backlinks so Google prioritises crawling and indexing
  7. Audit canonical tags and noindex directives quarterly to catch accidental misconfigurations

Frequently Asked Questions

Why isn't my new page indexed?

Common reasons: the page is too new (give it 1-3 weeks), it's blocked by robots.txt or noindex, the canonical points elsewhere, or Google judged the content too thin. Use URL Inspection in Search Console to see the exact reason.

How long does Google take to index a new page?

Typically 1-14 days for a healthy domain with a clean sitemap. New domains or low-authority sites can wait 4-8 weeks. You can submit URLs for indexing via Search Console to speed up the process, but submission doesn't guarantee acceptance.

What's the difference between crawled and indexed?

Crawled means Googlebot fetched the page. Indexed means Google decided to store the page in its database, making it eligible to rank. Crawled-but-not-indexed pages have been seen and rejected, usually for content quality or duplication reasons.

Related Terms

Need More Traffic for Your Website?

Organic Visit delivers real visitors from search engines. Boost your rankings and grow your website.

View Pricing Plans