Senior Technical Lead (ETL)

Engineering Pune, Maharashtra


Description

Skills:

  • 8-10 or more years hands on experience with Matillion/Informatica/IICS/Talend/Pentaho/SSIS in designing and developing ETL processes based on multiple sources using ETL tools.
  • Experience in designing end to end ETL solutions focusing on performance and quality
  • Should be aware of ETL best practices and performance tuning
  • Good understanding of data mapping, data validation, data manipulation, data analysis use cases.
  • Participation and contribution in quality assurance of ETL components
  • Experience with loading data from multiple file formats (CSV, JSON, XML etc..)
  • Computer science background with a good understanding of data.
  • At least 1 year experience with any programming language (any one object oriented, e.g. Python (preferred), Java etc.)
  • 6 plus years of experience working as Database Developer
    • Expert at all aspects of relational database design
    • Experience working with engineering team with respect to database-related performance tuning, writing of complex SQL, indexing, etc.
  • Good to have experience working with Matillion, Snowflake Cloud Database, Amazon S3

Responsibilities:

  • Engage with customer to identify all native data sources in the customer's data warehouse that are needed to build the new analytic solution.
  • Map out the ETL process using the new data sources to create a new analytic DataMart.
  • Define the ETL and report schemas aimed at optimizing storage capacity and performance.
  • Document the enrichment activity that must be applied to any new data.
  • Work with customer business users, customer data experts to make sure the solution meets all requirements both in data availability and performance.
  • Share any new learnings internally with the project Manager, IT organization and Engineering to drive constant improvements to the infrastructure and the product that drives the ETL work and customer experience
  • Should be aware of ETL best practices and performance tuning
  • Good understanding of data mapping, data validation, data manipulation, data analysis use cases.
  • Participation and contribution in quality assurance of ETL components
  • Support development teams with performance tuning and troubleshooting issues
  • Proficient with a database SQL language for user defined database extract and view definition etc.

Others:

  • Willingness to overlap with US (West Coast) hours for meetings/technical discussion.
  • Strong communication skills. Proactive about asking questions and getting feedback on their own work.
  • Need someone with maturity who will not do work just as told but take ownership and think holistically and challenge status quo.
  • Looks for opportunities to make improvements and can do so in a safe and well-communicated manner.