Screaming Frog vs Sitebulb vs Scrapy: A Crawler Teardown for Automated SEO Pipelines
An automation-first comparison of Screaming Frog CLI, Sitebulb, and a custom Scrapy crawler for unattended technical SEO crawling pipelines.
-
-
Reverse-Engineering a Competitor’s Programmatic SEO Setup: A Python Teardown of Sitemaps, Templates, and Internal Link Graphs
Treat a competitor’s programmatic SEO site as a black box and take it apart with Python: map the URL footprint from sitemaps, fingerprint the template, reconstruct the internal link graph, and estimate what actually ranks.
-
Automate Core Web Vitals Monitoring with the CrUX API, Python, and n8n
Pull p75 Core Web Vitals field data from the free CrUX API, detect regressions across your URLs, and fire Slack alerts with a self-hosted Python and n8n pipeline.
-
Content Decay Detection at Scale: Build an Automated GSC + Python + n8n Pipeline That Flags Pages Losing Traffic
Stop losing rankings silently. A Python + n8n pipeline that pulls 16 months of GSC data, scores every URL for decay, and files refresh tickets weekly with a closed-loop verification step.
-
Agentic SEO with Claude Code: Build an Autonomous Technical Auditor That Files Its Own GitHub Issues
A teardown of an agentic SEO auditor built on Claude Code that crawls, diffs against history, and files engineering-ready GitHub issues — including architecture, the agent prompt that worked, and eight weeks of real ticket data.
-
Log File Analysis Automation: Build a Daily Googlebot Crawl Monitor with Python and n8n
A production-grade n8n + Python workflow that ingests raw server logs, verifies Googlebot via reverse DNS, computes the four metrics that matter, and posts a daily Slack digest.
