Case study · Developer Tools

Broken Structured Data Scanner

Crawl websites and detect malformed, missing, duplicated, inconsistent, and suspicious structured data.

Overview

A structured data auditing crawler that scans one or multiple websites for JSON-LD, Microdata, and RDFa issues. It produces page-level validation results together with a site-wide summary containing severity counts, detected Schema.org types, common issue codes, and an overall Structured Data Health Score.

Problem

Structured data problems can be distributed across hundreds of pages and may appear after CMS, theme, template, or analytics changes, making manual page-by-page validation difficult to scale.

Solution

Built a configurable website crawler that audits structured data across multiple pages, classifies detected issues by severity and category, identifies pages without structured data, and aggregates the results into a site-wide health report.

How it works

- JSON-LD scanning and parse-error detection - Microdata coverage analysis - RDFa coverage analysis - Missing structured data detection - Duplicate and conflicting data detection - Schema.org value and property validation - Page-level validity reporting - Critical, error, warning, and info severity levels - Stable issue codes for automation and QA workflows - Schema.org type frequency reporting - Structured Data Health Score - Configurable crawl depth and page limits - Same-domain crawling control - Include and exclude URL patterns - Multi-website scanning - Proxy support