Azure Data Engineer Needed in Pune

Part-Time On-Site Azure Data Engineer – Pune I am looking for a hands-on Azure Data Engineer for a personal project in Pune. This is a part-time, on-site/in-person opportunity. The selected freelancer will work directly with me for approximately 5 hours per day. Required Skills: • Azure Databricks • PySpark / Python • Strong SQL / SQL Server • Azure Data Factory (ADF) • Azure Data Lake Storage Gen2 (ADLS Gen2) • Delta Lake • ETL/ELT • Historical and incremental data processing • Delta MERGE / Upsert • JSON and nested JSON processing • Data transformation and deduplication • Source-to-target data validation and reconciliation • Basic Spark/Databricks performance optimization Healthcare or Insurance domain experience is preferred. Experience with Member, Claims, Policy, Benefits, FHIR or HL7 data will be an advantage.

Responsibilities

• Develop and troubleshoot Azure Databricks notebooks using PySpark. • Build and modify ADF data pipelines. • Process data from SQL Server and other sources. • Implement historical and incremental data processing. • Create and maintain Delta Lake tables. • Implement MERGE/Upsert logic. • Parse and transform nested JSON data.