Data Engineer

Role & Responsibilities Responsibilities Design and develop scalable ETL/ELT data pipelines using Python, PySpark, MSBI and Apache Spark. Build and manage lake house/data platforms, including data modelling, partitioning, metadata and Iceberg tables. Deploy and manage data pipelines using Kubernetes, Docker, CI/CD and DevOps practices in on-premise environments. Provide L3 support, optimise data platform performance, ensure security/governance and collaborate with technical and business stakeho…