What Is Crawlability? A Plain-English Explanation
October 18, 2026 · 4 min read
The short version
Crawlability is whether a search engine can actually access and read your pages at all. It's a precondition for ranking, not a ranking factor itself - a page that can't be crawled can't rank for anything, no matter how good it is, because Google never sees it in the first place.
Crawlability and indexability are related but different: crawlability is whether Google *can reach* a page; indexability is whether Google *chooses to include it* in search results once it's been crawled. A page can be perfectly crawlable and still not get indexed if Google decides it's low-value or duplicate.
How a page actually gets crawled
Roughly: Google's crawler starts from pages it already knows about (or a submitted sitemap), follows links it finds on those pages to discover new ones, and requests each page's content directly, mostly reading the HTML (and, for modern crawling, executing enough JavaScript to see what a real browser would render). If a page isn't linked from anywhere, isn't in a sitemap, or is actively blocked, it may never get requested at all.
What actually blocks crawlability
- A "robots.txt" disallow rule that's broader than intended. A single misplaced "Disallow: /" can block an entire site. Worth checking yours directly, not just assuming it's fine.
- A "noindex" meta tag left on from a staging environment. Extremely common - a tag added to keep a dev version out of search results, never removed once the real version launched.
- Orphan pages - a real page that no other page on the site links to. If nothing points to it and it's not in your sitemap, there's no path for the crawler to find it.
- Content that exists only inside JavaScript the crawler doesn't execute, or only inside a video/canvas element with no real text equivalent. This is the one that matters most for cinematic, motion-heavy sites specifically: the words that actually sell your business need to exist as real, crawlable text somewhere, not purely as pixels inside a video frame.
- A broken or missing XML sitemap. Not strictly required, but it's the most direct way to tell Google exactly what you want crawled.
How to actually check yours
- Google Search Console's URL Inspection tool - the single most direct answer, straight from Google, for any specific URL.
- View your own "robots.txt" directly (yoursite.com/robots.txt) and read it like a visitor would, not just trust it's correct.
- Check your sitemap (usually yoursite.com/sitemap.xml) actually lists the pages you expect.
- View page source (not just the rendered page) on a page you're unsure about, and look for whether your actual sales copy appears as real text.
Why this matters more than it sounds like it should
Crawlability issues are invisible in normal browsing - the page looks completely fine to you, because your browser renders everything correctly. The gap only shows up from the crawler's perspective, which is exactly why it goes unnoticed so often. It's worth an occasional direct check, not an assumption.