From published to ranked. Every stage, plainly explained.
Each walkthrough follows a single process from beginning to end — no skipped steps, no assumed knowledge.
How Googlebot finds your pages
Discovery is the first step. Before any ranking can happen, Googlebot needs to know your page exists. Here's how that actually works.
The URL queue
Google maintains a massive queue of URLs to crawl. New URLs enter this queue through three main channels: sitemaps submitted via Search Console, links from already-indexed pages, and URLs that were previously crawled and need refreshing. A brand-new page on a site with no inbound links and no submitted sitemap may wait weeks before Googlebot visits.
Checking robots.txt first
Before fetching any page, Googlebot reads your site's robots.txt file. This file can disallow access to specific paths. If your robots.txt accidentally blocks important pages — which happens more often than you'd expect during site migrations — those pages will never be crawled regardless of how good they are.
Fetching the page
Googlebot requests the page like a browser would. It receives the HTML response, then processes any JavaScript required to render the full content. JavaScript rendering is resource-intensive, so Google sometimes delays it — meaning content inside JavaScript frameworks may take longer to be recognized and indexed than static HTML content.
Following links
During a crawl, Googlebot collects all links on the page and adds new ones to the URL queue. This is why internal linking structure matters — pages that are linked from many other pages on your site will be crawled more frequently and treated as more important than orphan pages that nothing links to.
The indexing decision
Crawling and indexing are separate steps. Google crawls far more pages than it indexes. Here's what influences the indexing decision.
Content quality assessment
After crawling, Google assesses whether the page offers unique value. Pages with thin content, near-duplicate content, or content that closely mirrors what already exists in the index are candidates for exclusion. Google's systems ask: would including this page make search results better? If the answer is unclear, the page may not be indexed.
Canonical signals
Many sites have multiple URLs that serve the same or very similar content — different URL parameters, HTTP vs HTTPS versions, trailing slash variants. Google uses canonical signals (the canonical tag, redirect patterns, and internal link consistency) to determine which version to index. Mixed signals on canonicalization confuse this process and can result in the wrong version being indexed or no version being indexed at all.
Noindex directives
A noindex meta tag tells Google not to include a page in its index. This is intentional for pages like thank-you pages, admin areas, and staging environments. The problem occurs when noindex tags are accidentally left on production pages — a mistake that's surprisingly common after site launches. Google will crawl a noindexed page but will not rank it for anything.
Site-level quality signals
Google evaluates individual pages partly in the context of the site they belong to. A single high-quality page on a site that otherwise has very low-quality content may be treated with less trust than the same page would receive on a credible domain. This is one reason why content audits — identifying and improving or removing weak pages — can improve the indexing of other pages on the same site.
How ranking signals work together
Ranking isn't a single calculation. It's the result of many signals evaluated simultaneously. This walkthrough explains the main categories.
Relevance signals
Relevance signals tell Google what a page is about. These include the page title, headings, body content, internal links pointing to the page, and the anchor text of external links. Google's language models go beyond exact keyword matching to understand topics, entities, and the relationships between them. A page that thoroughly covers a topic will tend to be relevant for many related queries, not just exact phrase matches.
Authority signals
Authority signals measure how much other sources on the web recognize the page or domain as credible. Backlinks remain the primary authority signal — a link from a trusted, established site passes more authority than a link from a new or low-quality one. The overall link profile of a domain influences how much trust any individual page on that domain receives.
Quality signals
Quality signals reflect how well the page serves the user. Page experience factors like loading speed, mobile usability, and stability of layout during loading (Core Web Vitals) are part of this category. So is content quality in the broader sense — depth, accuracy, originality, and clarity. Quality signals have become increasingly important as Google's systems have gotten better at distinguishing genuinely helpful content from content optimized to look helpful.
Intent matching
Even a high-quality, authoritative page won't rank well if it doesn't match what people actually want when they type a query. Google categorizes search intent as informational, navigational, commercial, or transactional. A page formatted as a blog post won't rank for a query where everyone searching wants a product page, regardless of its quality by other measures.