Job Description: Data Engineering Lead – AWS, Snowflake & Databricks

Role Overview

We are looking for an experienced Data Engineering Lead to drive the design, development, and delivery of enterprise-scale data platforms across cloud and on-premise environments. The ideal candidate will bring deep expertise in the AWS data ecosystem, Snowflake, and Databricks, along with strong hands-on skills in SQL, PySpark, Spark, and Trino.

This role requires a strong blend of technical leadership, architecture thinking, and delivery excellence, particularly within financial services / capital markets domains.

Key Responsibilities

• Lead the design and implementation of enterprise data platforms (Data Lakes, Lakehouse, DWH)
• Architect scalable, secure, and high-performance data architectures on AWS
• Build modern ETL/ELT pipelines using PySpark, SQL, Spark
• Implement AWS services (S3, Glue, EMR, Lambda, Redshift)
• Lead and mentor data engineering teams
• Define best practices, reusable frameworks, and coding standards
• Enable enterprise analytics through curated data models
• Ensure data governance, quality, and lineage
• Optimize pipelines for performance and cost
• Work closely with financial domain stakeholders

Required Skills & Expertise

• AWS Data Stack: S3, Glue, EMR, Lambda, Redshift, Athena
• Snowflake: Advanced SQL, performance tuning
• Databricks: Delta Lake, Notebooks, Jobs
• Strong SQL, PySpark, Spark
• Experience with Trino (Presto)
• ETL/ELT frameworks, data modeling (Dimensional, Data Vault)
• Lakehouse architecture and Medallion design
• Data governance, security, and access management

Experience & Domain

• 10–15 years of experience in Data Engineering / Analytics
• Strong AWS, Snowflake, Databricks experience
• Experience building enterprise data lakes and lakehouses
• Experience in Financial Services / Banking / Capital Markets

Certifications (Preferred)

• AWS Certified Solutions Architect / Data Analytics
• Databricks Certified Data Engineer
• Snowflake SnowPro Certification

Leadership & Soft Skills

• Strong stakeholder management and communication
• Leadership experience with global teams
• Strong problem-solving and decision-making

Summary

Experienced Data Engineering Lead with expertise in AWS, Snowflake, and Databricks, specializing in enterprise-scale data platforms and financial domain solutions.