arrow_back Torna alle freelance
F

MQTT-Hadoop Sales Data Pipeline Development

Freelancer

Condividi:
placeGH home_workRemoto assignmentDeterminato publicOfferta aggregata · GH

eventPubblicata il 06 ott 2026 · verifiedAbbiamo verificato il 06 ott 2026 che è ancora attiva

Questa azienda è tua?

US$ 250 – US$ 750 per progetto

Sull'offerta

Title: Urgent: MQTT to Hadoop Sales Data Pipeline with Hive Data Warehouse (Small Scope) We need an experienced Big Data developer to build a compact, end-to-end sales data pipeline. The scope is small and well defined, and we need it delivered quickly. We plan to award within hours to the right candidate. The project is fully self-contained. It needs no account access, credentials, invitations or files from our side. You can start right away in your own local environment. PROJECT OVERVIEW Build a small pipeline that ingests real-time sales events through MQTT, stores them in Hadoop, and organizes them in a Hive data warehouse for basic sales reporting. SCOPE OF WORK Part 1 - Data Generation (MQTT Publisher) Write a Python script that publishes simulated sales events to a local Mosquitto broker. Each event should contain order_id, timestamp, region, product, quantity and price. Part 2 - Data Ingestion (MQTT Subscriber to HDFS) Write a subscriber that consumes these events and writes them to HDFS. A single-node Hadoop setup is enough. Part 3 - Data Warehouse (Hive) Design a simple star schema in Hive with these tables: - fact_sales - dim_product - dim_region Load the ingested data into these tables. Part 4 - Sales Reporting Provide three SQL queries: - Total sales by region - Top 5 products by revenue - Daily sales totals DELIVERABLES - Complete source code (zip or rar) - A short README covering setup, execution steps and a brief description of the architecture - Screenshots showing the pipeline running and the query results TIMELINE Delivery is expected within 1 to 2 days of award. Please state your exact delivery time in your proposal.

REQUIREMENTS

Hands-on experience with Hadoop (HDFS, Hive) - Working knowledge of MQTT and Python - Understanding of data warehousing concepts (star schema) - Clear, timely communication HOW TO APPLY Begin your proposal with the word "PIPELINE" and include: - A brief summary of your relevant experience - Your proposed approach in 2 to 3 lines - Your delivery timeline Generic or copy-paste proposals will not be considered.

Continua a leggere gratis

Crea un account gratuito per vedere l'offerta completa e candidarti.

  • badgePortfolio visibile alle aziende
  • notificationsAvviso di nuova offerta via e-mail
  • favoriteSempre gratis, senza trucchi