Python Developer for Automated SEO Site Audit & Competitor Scraper

Our manual SEO audit and competitor research workflows are taking too long to scale. I need a Python developer with practical SEO knowledge to build an automated script that audits our target websites and flags critical on-page issues in minutes instead of hours. The Problem to Solve: We need to automatically crawl a list of URLs (both our site and competitors'), extract key on-page SEO data, identify technical errors, and output an easy-to-read action report. Key Deliverables: Automated Crawler: A Python script (using Requests, BeautifulSoup, or Scrapy) that crawls given domains or sitemaps without getting blocked. On-Page Audit Extraction: Pull and flag missing or duplicate title tags, meta descriptions, H1s, broken links (404s), and slow-loading pages. Competitor Keyword & Content Check: Extract top-used keywords and word counts from competitor URLs for side-by-side comparison. Clean Reporting: Export all findings into a structured Excel/CSV file with a summary tab highlighting high-priority fixes.

Requirements

Strong experience with Python web scraping, rate-limiting, and handling dynamic pages. Practical understanding of technical SEO (crawling, status codes, metadata, sitemaps). Clean, documented code with instructions so I can run it locally on my machine. To apply, please briefly mention a similar SEO tool, scraper, or data automation script you have built in the past.