arrow_back フリーランスに戻る
F

MQTT-Hadoop Sales Data Pipeline Development

Freelancer

シェア:
placeGH home_workリモート assignment契約社員 public集約求人 · GH

event2026年10月06日に公開 · verified2026年10月06日時点で募集中であることを確認済みです

この企業はあなたの会社ですか?

US$ 250 – US$ 750 /案件

求人について

Title: Urgent: MQTT to Hadoop Sales Data Pipeline with Hive Data Warehouse (Small Scope) We need an experienced Big Data developer to build a compact, end-to-end sales data pipeline. The scope is small and well defined, and we need it delivered quickly. We plan to award within hours to the right candidate. The project is fully self-contained. It needs no account access, credentials, invitations or files from our side. You can start right away in your own local environment. PROJECT OVERVIEW Build a small pipeline that ingests real-time sales events through MQTT, stores them in Hadoop, and organizes them in a Hive data warehouse for basic sales reporting. SCOPE OF WORK Part 1 - Data Generation (MQTT Publisher) Write a Python script that publishes simulated sales events to a local Mosquitto broker. Each event should contain order_id, timestamp, region, product, quantity and price. Part 2 - Data Ingestion (MQTT Subscriber to HDFS) Write a subscriber that consumes these events and writes them to HDFS. A single-node Hadoop setup is enough. Part 3 - Data Warehouse (Hive) Design a simple star schema in Hive with these tables: - fact_sales - dim_product - dim_region Load the ingested data into these tables. Part 4 - Sales Reporting Provide three SQL queries: - Total sales by region - Top 5 products by revenue - Daily sales totals DELIVERABLES - Complete source code (zip or rar) - A short README covering setup, execution steps and a brief description of the architecture - Screenshots showing the pipeline running and the query results TIMELINE Delivery is expected within 1 to 2 days of award. Please state your exact delivery time in your proposal.

REQUIREMENTS

Hands-on experience with Hadoop (HDFS, Hive) - Working knowledge of MQTT and Python - Understanding of data warehousing concepts (star schema) - Clear, timely communication HOW TO APPLY Begin your proposal with the word "PIPELINE" and include: - A brief summary of your relevant experience - Your proposed approach in 2 to 3 lines - Your delivery timeline Generic or copy-paste proposals will not be considered.

このまま無料で続きを読む

無料アカウントを作成すると、求人の全文を見て応募できます。

  • badge企業からポートフォリオが見える
  • notifications新着求人をメールでお知らせ
  • favorite常に無料、追加料金なし