Keep crawl facts separate
Use exact content, metadata, indexability, and internal-link evidence to organize a review—not to infer performance or business value.
Content inventory · exact crawl evidence
Crawl a public site and review content size, headings, metadata, indexability, depth, observed inlinks, exact duplicate groups, and deterministic near-duplicate fingerprint candidates. Adjustable thresholds organize review; they do not grade content quality.
No estimated traffic, synthetic content score, or sample recommendation is shown. The inventory begins with live fetched evidence.
Content governance
Use exact content, metadata, indexability, and internal-link evidence to organize a review—not to infer performance or business value.
Before merging or retiring a page, add Search Console queries, analytics, conversions, backlinks, ownership, and update history from systems you control.
Choose keep, improve, consolidate, redirect, or retire only after an editor reviews intent, audience, and evidence beyond this bounded crawl.
Ahrefs content-audit processSEOptimer crawler overviewGoogle helpful-content guidance