Dark Web Scraping & Intelligence Dashboard System (Docker Stack)

Project Description: We are looking for a skilled Engineer / Developer to build a fully localized, containerized Scraping & Intelligence Platform deployed via Docker Compose. The system automates .onion site discovery, recursive multi-engine scraping, content extraction, and automated categorization using a free, local tech stack. (IMPORTANT): Automated bids will be immediately ignored and reported, Briefly outline your experience with Python asyncio, Tor routing/proxies, Playwright/FastAPI. and your suggestions. 1/ Core Stack Requirements: - Backend & API: Python 3.12 (FastAPI), SQLAlchemy / PostgreSQL, Celery + Redis for task queues. - Scraping & Tor Routing: httpx, Playwright (Headless Chromium), custom SOCKS5 Tor circuit rotation logic, and proxy verification. - Local AI/ML Engine: Local LLM integration (via Ollama or others) for content summarization, entity extraction (crypto wallets, PGP keys, emails), and automated 20-category classification. - Frontend Dashboard: Lightweight, single-screen dashboard (Streamlit or React) with full-text search, visual uptime tracking, and bulk data export capabilities. 2/ Key System Capabilities: - Adaptive Scraping: Auto-switch between lightweight HTTP parsing and JS rendering depending on page complexity. - Scam/Clone Fingerprinting: Structural/content fingerprinting algorithm to isolate duplicate scam sites from original platforms. - Automated Monitoring: Periodic uptime status checks, content diff versioning, and automated alerts for status changes. - Open-Source Infrastructure: Entire stack must be 100% free/open-source and deployable on a single local machine or Linux VPS via Docker Compose. 3/ Additional Info: Comprehensive step-by-step documentation, architecture specs, and tool lists will be provided immediately upon hiring.