Senior Data Engineer - Spiceworks

Engineering Pune, India Hyderabad, India


Description

Position at Spiceworks

 About SWZD:

Spiceworks Ziff Davis (SWZD) is the trusted global marketplace for connecting technology buyers and sellers across all marketing channels. We provide the valued information IT and business decision makers need to research, buy, and manage technology while delivering the intelligence and insights technology brands need to create and sell better products and services. By combining the breadth and depth of the Spiceworks and Ziff Davis Communities with expert content, trusted first party data, and proven lead generation capabilities, Spiceworks Ziff Davis is uniquely positioned to help technology buyers and sellers to grow their businesses.

 

About the role and team:

We are looking to hire an experienced data engineer to join our dynamic engineering team. You will be a part of a global data engineering team, spread across the Austin, Hyderabad, and Pune SWZD offices, and will play a key role in enabling our data-driven strategy. As a Data Engineer, you’ll work closely with Product Managers, Finance and Business Analysts, Data Scientists, and Software Engineers as you help define our data development roadmap. Eager to jump into a pivotal role that's essential in enabling data-informed decisions? It’s time to apply!

 

Responsibilities

Your day-to-day:

  • Lead the development of self-monitoring, robust, scalable, batch and streaming ETL processes
  • Contribute to the consolidation of our data and empower other teams to derive value from our warehouse ecosystem
  • Work closely with stakeholders on the data supply side (e.g. application engineers) and data demand side (e.g., BI analysts, data scientists, product managers, and other engineering teams)
  • Ensure data privacy and compliance (GDPR), as well as maintaining data dictionaries for governance purposes
  • Develop and improve the continuous integration and testing processes
  • Mentor junior engineers and promote good engineering practices

 

Qualifications

What does it take to do this job?

 

  • 5+ years of experience delivering data pipelines and managing resulting data stores (experience with Snowflake Data Warehouse, a plus)
  • Experience using managed cloud services (AWS preferred)
  • Experience using a wide range of data and orchestration technologies (Postgres, Redshift, Athena, Hive, Kafka, Kinesis, Firehose, Airflow, Talend, Matillion..)
  • Good understanding of SQL and query optimization.
  • Experience identifying and resolving performance and data quality issues
  • Experience working in agile/scrum development environments
  • Proficiency in Python
  • Bachelor’s or master's in engineering, computer science, or related field preferred