Problem
Large sites need a system, not manual SEO.
What you would say
“We have thousands of pages and no idea which ones matter.”
- Urgency
- Structural — needs a system, not a sprint
- First useful answer
- Segmenting by page type and measuring indexation per type usually takes about a week, and it is normally the moment the real problem becomes obvious.
- Investigation steps
- 7 steps, in a fixed order
Business impact
What this usually costs
- Crawl budget spent on URLs that will never earn anything
- Thousands of pages sitting unindexed while new ones keep being published
- Commercial pages buried deep in the architecture
- Nobody able to say which page types produce revenue
- Every release adding unmonitored risk across templates
Our approach
What we would investigate
Segment the site by page type
Not by URL. Every analysis after this — indexation, traffic, conversion, quality — is done per type, which is the only way large-site data becomes readable.
Measure indexation by type
What share of each page type is indexed, and what share of the indexed pages earn anything within 90 days.
Map crawl budget
Where crawl requests actually go, using server logs where available. Usually a large share goes to parameters, facets and duplicates.
Analyse the internal link graph
Link depth and internal links received by the pages that carry commercial value, versus the pages that receive links because of the navigation template.
Find the duplication and cannibalisation clusters
At scale these are systematic rather than incidental, which means they can be fixed with a rule instead of page by page.
Define a quality floor per page type
The minimum data or content a page must have to deserve indexation. Then measure how many pages currently clear it.
Design indexation and canonical rules
Which combinations are indexable, which are canonicalised, which are blocked, and how sitemaps are segmented so coverage is diagnosable.
Differential diagnosis
Likely causes, and what proves each one
| # | Possible cause | Evidence that confirms or eliminates it |
|---|---|---|
| 01 | Everything indexable by default, with no quality floor | Indexation rate and earning rate by page type |
| 02 | Faceted navigation generating near-unlimited crawlable URLs | Crawl log distribution, parameter URL inventory |
| 03 | Internal linking driven by the navigation template, not page importance | Link graph analysis against commercial value per URL |
| 04 | Systematic duplication across templates | Near-duplicate clustering across the crawl |
| 05 | No sitemap segmentation, so coverage problems cannot be localised | Sitemap structure review against coverage report categories |
| 06 | No per-type monitoring, so degradation is invisible | Absence of type-level reporting; drift found only in retrospective analysis |
The no-guessing rule
If the data does not support a conclusion, we write “we do not have enough evidence to confirm this” and tell you what we would need. A guess never becomes a recommendation.Outcome
What you end up with
- Page-type segmentation and a per-type performance picture
- Indexation strategy with explicit rules and a quality floor per type
- Crawl budget plan and parameter/facet handling
- Internal linking model that sends authority towards commercial pages
- Sitemap segmentation so future coverage problems are diagnosable
- Pruning and consolidation plan with the evidence for each decision
- Per-type monitoring so drift is caught in weeks
No surprises
What happens if you get in touch
You send us your website and what is happening
One form, six fields. No call required to get started.
We review the situation
We look at your site and the public data before we reply, so the first conversation is useful.
We confirm whether we can help
If we are not the right fit, we say so — and where we can, we point you somewhere better.
We explain what we would investigate
Specifically: where we would look first and why, based on what we already saw.
You decide whether to move forward
No pressure and no follow-up sequence. You have the information; the decision is yours.
Questions
Questions about large website
Evidence and further reading
- Worked example
Twelve thousand product pages that could not rank for their own model names
A canonical rule added during a duplicate-content cleanup pointed every product URL at its parent category. The catalogue was invisible for its highest-intent queries and nobody had connected the two facts.
- Insight · Technical SEO
The quality floor: how to build programmatic pages that deserve to exist
The difference between a scalable page set and scaled content abuse is not the technology. It is whether a page must clear a defined threshold before it is allowed to be indexed.
Services that fix this, and problems that travel with it
- ServiceTechnical SEO & Search GrowthMake sure search systems can crawl, render, index and understand the pages that carry your revenue.
- ServiceDynamic & Programmatic SEOTurn a large dataset into pages that deserve to exist — with a template, a quality floor and an indexation strategy.
- ServiceContent ArchitectureDesign the structure your content should have — clusters, commercial pages, internal links, briefs, pruning.
- ProblemOrganic traffic droppedSomething changed. There is always a date, and the date narrows the cause.
- ProblemTraffic but no leadsUsually a traffic-quality problem, a conversion problem, or a measurement problem — and they need different fixes.