Python Developer for Web Scraping Investigation

We are looking for an experienced Python Web Scraping / HTTP Request Developer to investigate a response issue with the Temu website. Website: https://www.temu.com/ The task is only to investigate the response issue and identify the root cause. The required flow is: * First open the Temu website * Navigate to **Categories** * Identify and collect all required categories * For each category, identify all available products * Handle category page pagination / "Load More" functionality * Verify that the correct product response is returned for each category and product page The developer should: * Analyze the existing request flow * Check the required request parameters * Check headers, cookies, session values, and other relevant request components * Identify why the response is incorrect or incomplete * Provide the required technical changes to obtain the correct response ### Scraping Requirements The scraper should support: * All required category/listing page extraction * Product detail page extraction * Category pagination / "Load More" functionality * All products available under the required categories * Correct and consistent product responses Temu pages can contain dynamically loaded content, so the developer should analyze the required HTTP requests and determine how to obtain the correct response through the request method. The developer should first create a working proof of concept for a selected category and demonstrate that the required product fields are returned correctly before scaling the solution. ### Notes * **Only the HTTP request/response method is required.** * **Do not use Selenium or Playwright.** * We will manage additional requirements such as **proxy, server, and infrastructure** from our side. * The main requirement is to identify and resolve the **request/response issue** and provide the working request method.