Data Engineer

IT And Software Development National Capital Region

It is important that the incumbent of this role have some of the following:

Tertiary qualification in Data Engineering, Data Science or Computer Science
Experience with AWS services (including EMR, Lambda, API Gateway, S3, Redshift)
Understanding of ETL techniques and methodologies and ability to construct associated directed acyclic graphs (DAGs)
Knowledge of database storage, collection and aggregation models, techniques and technologies
Coding skills with Python, PySpark, Javascript
Experience with API development and understanding of software development principles
Knowledge of Docker, Kafka, MapReduce (Desirable)
Working knowledge of converting batch pipelines into real-time data streaming (Desirable)
Tableau visualisation techniques and data sourcing practices (Desirable)

An interest in the sporting industry (Desirable)