Data Engineer

Information Technology Remote, United States


Description

Position at Infostretch

Senior Data Engineer- Remote

About the Role

We are currently looking to hire a Senior Data Engineer to join our remote team.  

In this role, you will join a savvy group of Data Engineers dedicated to supporting the next generation of products and data initiatives. As a Senior Data Engineer, you will be responsible for expanding and optimizing our data and data pipeline architecture and optimizing data flow and collection for cross-functional teams. In addition, you will be hands-on within data analytics, cloud development, AI/ML, data modeling, etc., by leveraging multiple tools and technologies, including but not limited to SQL, Python, DBT, and Snowflake. You will also manage client expectations and support the data needs of multiple teams, systems, and products.  

Responsibilities
  • Analyzing and reverse engineering of IBM DataStage code  
  • Developing ELT data pipelines to migrate applications using DBT and Snowflake frameworks along with Python coding 
  • Responsible for translating functional ETL requirements into a technical design document  
  • Building the DataStage jobs and sequences to pull data from the source into staging tables, from staging tables into historical tables using Change Data Capture methodologies, and then from historical tables into dimensional data marts for reporting
  • Identifying and clarifying issues/problems that need action and drive appropriate decisions and activities relating to system integrations, compatibility, and multiple platforms  
  • Researching, testing, building, and coordinating new products' conversion and integration based on client requirements  
  • Responsible for designing and developing new software products or significant enhancements to existing software  
  • Responsible for overseeing the testing, implementation, maintenance, and enhancement of the applications and leading software developers on the development team  

Requirements
  • 10+ years of experience in practical hands-on experience working in data modeling, data extraction data manipulation, and data warehousing concepts  
  • Bachelor's in Computer Science, Information Technology, Mathematics, Engineering or an equivalent field  
  • Minimum of 5+ years of practical hands-on experience working with SQL/SQL Server and Python for analytics or data science purposes  
  • 2+ years of experience in writing scripts using Unix or Python  
  • 3+ years of experience in Migration from Data Stage to other technologies  
  • Proficiency with modern data tools and cloud technologies would be advantageous. These can include but are not limited to Snowflake, DBT, Talend, and AWS