How Google Actually Works
Crawling, indexing, and ranking — the three-step process behind every search result
SEO looks like magic from the outside. Sites with no ad spend get thousands of visitors a month. But there is no magic — just a three-step process Google runs on every page on the web. Understanding those three steps tells you exactly what to fix when your site is not ranking.
Step 1 — Crawling
- Googlebot discovers pages by following links — Internal links within your site and external links from other sites both count
- It visits each URL on a crawl schedule — Popular pages get crawled more frequently than obscure ones
- Crawl budget is limited — Large sites need to prioritise which pages get crawled — block thin content to save budget
Google's crawlers are like librarians who walk through every aisle in a library
Googlebot (Google's crawler) follows links from page to page across the entire web — like a librarian walking every aisle, reading every book spine. If no links point to your page, Googlebot may never find it. If your page blocks crawlers (via robots.txt), they stop at the door.
Step 2 — Indexing
After crawling, Google reads the page content, processes it, and stores it in its index — a database of every page it understands. Not every crawled page gets indexed. Google skips duplicate content, thin pages, and pages it cannot render.
Check if your pages are indexed
Type "site:yourdomain.com" in Google. Every result shown is an indexed page. If important pages are missing, they have an indexing problem — not a ranking problem.
Step 3 — Ranking
When someone searches, Google retrieves relevant indexed pages and ranks them using hundreds of signals. The main ones:
- Relevance — does the page match what the user searched for? — Title, headings, content, and semantic meaning all feed into this
- Authority — do credible sites link to this page? — Backlinks from trusted sites are the strongest ranking signal after relevance
- Experience signals — does the page actually help users? — Time on page, scroll depth, and click-back rate all matter
- Technical quality — is the page fast, mobile-friendly, and secure? — Core Web Vitals, HTTPS, and mobile usability are ranking factors
What this means for your site
- If you're not indexed, nothing else matters — Submit a sitemap in Google Search Console first
- If you're indexed but not ranking, you have a relevance or authority problem — Either the content doesn't match the keyword, or you need more backlinks
- Technical issues multiply everything else — A slow site that's perfectly optimised still ranks below a fast site that's well-optimised
Try this
Go to Google and type "site:yourdomain.com" — no quotes in the search bar, just the command. Count the pages shown. Are any important pages missing? If your homepage is not indexed, you have a foundational issue to fix before anything else.