Data engineer

We are seeking a highly skilled Data Engineer to join our onsite team. In this role, you will design, build, and optimize complex, highly scalable big data pipelines and infrastructure on AWS to support advanced regulatory analytics, surveillance systems, and market research. Key Responsibilities Pipeline Development: Design, develop, and maintain high-performance ETL/ELT data pipelines capable of ingesting and transforming massive volumes of structured and unstructured financial data. Big Data Processing: Utilize PySpark, Apache Spark, and AWS EMR to process billions of records efficiently, ensuring low latency and high reliability. Cloud Architecture: Architect and optimize solutions within FINRA’s AWS data lake and data warehousing environment (S3, Athena, Glue, Snowflake, Presto/Trino). Data Quality & Governance: Implement rigorous data quality checks, validation frameworks, and observability pipelines to ensure data lineage, consistency, and strict regulatory compliance. Collaboration: Partner cross-functionally with data scientists, economists, software engineers, and regulatory stakeholders to translate complex business requirements into robust technical solutions. CI/CD & DevOps: Deploy scalable infrastructure using CI/CD pipelines (Jenkins, Bitbucket, Git) and infrastructure-as-code (Terraform, CloudFormation). Performance Optimization: Troubleshoot production data pipelines, tune PySpark/SQL queries for optimal compute performance, and manage AWS resource costs. Required Qualifications Experience: 5+ years of hands-on, dedicated Data Engineering experience in a production environment. Programming Languages: Expert-level proficiency in Python (specifically for data engineering) and advanced SQL. Big Data Ecosystem: Deep, hands-on experience with Apache Spark (PySpark) and distributed computing architecture. Cloud Platforms: Strong implementation experience within the AWS ecosystem, specifically with EMR, S3, Glue, Athena, IAM, and Step Functions. Data Architecture: Proven experience working with data lakes, modern data warehousing (e.g., Snowflake, Redshift), and data formats (Parquet, Apache Iceberg, Delta Lake). Education: Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a closely related discipline. Work Authorization: Eligible to work in US Preferred Qualifications Prior domain experience in financial services, capital markets, payroll, or regulatory environments. Experience with streaming data technologies such as Apache Kafka or Amazon Kinesis. AWS Certifications (e.g., AWS Certified Data Analytics, AWS Certified Solutions Architect). Familiarity with AI-assisted developer tooling (GitHub Copilot, Amazon Q) and integrating AI into engineering workflows. Excellent communication skills with the ability to explain complex technical concepts to non-technical financial stakeholders. Analytics SME JD offshore- We are looking for an experienced Adobe Analytics and Adobe Launch SME to lead analytics implementation, tag management, data collection, and reporting across web and digital platforms. The ideal candidate will have strong hands-on experience with Adobe Analytics, Adobe Experience Platform Data Collection Tags—formerly Adobe Launch—and modern web analytics practices. Key Responsibilities Design and implement Adobe Analytics tracking for websites and digital experiences. Configure Adobe Launch properties, rules, data elements, extensions, and publishing workflows. Develop and maintain solution design reference documents, data layers, event mappings, eVars, props, and success events. Implement tracking using Adobe Web SDK, AppMeasurement, and Experience Cloud ID Service. Troubleshoot data collection, tag-firing, attribution, and reporting issues using browser debugging tools. Validate implementations through QA, network-call testing, and data reconciliation. Build Adobe Analytics reports, segments, calculated metrics, dashboards, and Analysis Workspace projects. Work with marketing, product, development, privacy, and business teams to translate measurement requirements into technical solutions. Support consent-management integrations and ensure analytics tags comply with privacy requirements. Establish tagging standards, governance, documentation, and release-management processes. Provide technical guidance and mentoring to analytics developers and business users. Required Qualifications 6+ years of experience in digital analytics, including strong hands-on Adobe Analytics experience. 4+ years of experience implementing and managing Adobe Launch or Adobe Experience Platform Data Collection Tags. Strong knowledge of JavaScript, HTML, browser developer tools, cookies, local storage, and network requests. Experience designing data layers and enterprise analytics implementation frameworks. Strong understanding of eVars, props, events, processing rules, classifications, marketing channels, and attribution. Experience with Adobe Web SDK, Experience Cloud ID Service, and Adobe Debugger or Assurance. Ability to troubleshoot complex implementation and data-quality issues. Strong communication, documentation, and stakeholder-management skills.

Preferred Qualifications

Adobe Analytics Business Practitioner or Developer certification. Experience with Adobe Experience Platform, Customer Journey Analytics, Adobe Target, AEM, and OneTrust. Knowledge of server-side tagging, APIs, mobile-app analytics, and customer journey measurement. Experience working in Agile delivery environments