Data Engineering Expert
Description
INNIO Data Engineers are the wizards turning complex industrial and business data sources into a reliable warehouse that drive operational and strategic decisions across the company. Their journey starts at Ingestion and ends in providing Data Analysts, Scientists and BI developers with clean and well structured data models (as per Kimball).
Tasks include building pipelines, implementing tests, interacting with other data team members and the business to investigate errors and ensure accurate implementation while adhering to software development principles in their work. Senior Engineers are expected to participate in architectural tasks as well.
What INNIO offers you
- Young & supportive team - in a fast-growing international business environment
- Learn & develop yourself - help you craft your career path with (INNIO learning, free language courses according to business needs
- Hybrid working - 50% Office, 50 % Home Office with flexible working hours
- Cafeteria package with various options - SZÉP Card, Cash option, Nursery & kindergarten support
- Medicover Spring White Package- from the first day of employment
- Easily accessible location - in the heart of the most vibrant campus area in Budapest (location: 13rd District, easy to approach by Metro Line 3)
- Take a break - Recharge your batteries with free coffee and tea selection in the kitchen area
- Live an active lifestyle – activate your AYCM pass
Your tasks:
- Design and implement scalable and robust data pipelines to support analytics and data processing needs based on business specification
- Build and maintain data tests to ensure quality and stability for our data consumers
- Design and implement the landing and ingestion of new data sources
- Adhere to the established software development and security policies
- Test, monitor and document your and other engineers’ work
- Senior Engineers to participate in the architecture development and maintenance of the INNIO Data Platform
Your profile:
- Completed university studies with a focus in the area of IT or STEM (preferable but not required)
- Fluency in English (written and spoken); German is not required, but useful
- 2-5 (5+ for seniors) years of experience in data engineering / architecture or related fields
- Hands on experience in building data ingestion/transformation pipelines and tests, preferably in a software development environment (Git, JIRA, CI/CD)
- Solid knowledge of SQL and Python
- Some mileage with working in an agile enironment (preferable)
- Experience with cloud platforms / providers
- Openness to new technologies and methodolgies, willingness to learn and adapt
Preferable tech stack:
- Expereince with Databricks (SQL, PySpark, Data Load Tool, Lakeflow Declarative Pipelines, Asset Bundles etc.)
- Experience with dbt (pipelines, tests, etc.)
For Senior Engineers:
- Azure and AWS data architecture experience (CI/CD, Security, Kubernetes)
- Orchestration with Dagster (or any similar tool, such as Airflow etc.)
- Experience with Terraform
Experience with different tools (but clear knowledge of the core concepts) combined with a willingness to learn and adapt is sufficient.