Data Engineer

Engineering & Technology Kuala Lumpur, Malaysia


Description

About Us: 

Sitecore’s mission is to provide cutting-edge DXP solutions that enable the world’s greatest brands to craft truly unforgettable experiences for their customers. A highly decorated industry leader, Sitecore brings content, commerce, and data into one connected platform that delivers millions of digital experiences every day. Thousands of blue-chip companies, including American Express, Porsche, Starbucks, L’Oréal, and Volvo Cars, rely on Sitecore to provide more engaging, more personalized experiences for their customers. Under the leadership of our new product-centric CEO, we are poised to continue to push the boundaries of marketing technology and shape the future of customer engagement. Learn more at Sitecore.com.

About the Role:

As a Data Engineer, you will work with Lead Data Engineer and Engineering Manager to design, develop, maintain, optimize data pipelines and workflows. You will be responsible in building efficient and reliable data engineering solutions. Ensuring data is consistently processed from various data sources of the data ecosystem. You will work on various technologies and platforms, Databricks, Power BI, Python, SQL, etc. You will collaborate with FinOps, Data Analyst and other stakeholders from different teams.

What you will do:

  • Design, develop, maintain and implement efficient data pipelines using Databricks to gather and transform data from various data sources.
  • Perform data ingestion, transformation and delivery using Python and SQL.
  • Work with structured and unstructured data from various data sources to integrate and transform it into useful data for analysis.
  • Create and manage data models, schemas and tables of different sources.
  • Optimize solutions and identify bottlenecks in data pipelines to improve performance and efficiency.
  • Performance tuning to optimize queries for speed and efficiency.
  • Generate and visualize data insights using Power BI.
  • Perform R&D to evaluate new technologies, tools and methods to improve data engineering processes and solutions.
  • Collaborate closely with data analysts and other stakeholders to understand data needs and support their requirements.

What you need to succeed:

Technical skills 
  • Hands-on experience in Python, SQL and other programming languages commonly used in data engineering.
  • Knowledge of Databricks, Spark, cloud environments like Azure or AWS and Blob storage.
  • Experience in ETL (extract, transform, load) processes.
  • Strong proficiency in SQL for querying, managing, and optimizing relational tables.
  • Data processing for structured and unstructured data. CSV, JSON and Parquet format.
  • Experience in designing and developing Power BI reports or similar.
  • Strong knowledge of both relational SQL (MySQL, PostgreSQL) and NoSQL (Cosmos DB, MongoDB)
  • Experience in agile methodologies (Kanban, Scrum, SAFe, XP, Lean)
Soft skills 
  • Problem-solving, analytical skills and provide solutions using the right approach and best practices.
  • Collaborate effectively with proper communication skills with various teams and explain technical concepts to non-technical stakeholders.
  • Quick learner, adaptability to integrate new tools and technologies into existing systems.
  • Participate in knowledge sharing and provide topic of discussion.

What will set you apart:

  • Hands-on experience with cloud-native data processing solutions. (BigQuery, Databricks, Snowflake)
  • Strong experience in Databricks, Python, SQL, PySpark, Power BI or other commonly used data engineering tools and platforms.
  • Hands-on experience with cloud-native data platforms and services. (Azure Data Lake, Blob Storage, AWS S3)
  • Strong experience in maintaining database system and writing SQL query.
  • Experience of ETL and data pipeline optimization techniques to handle data efficiently.
  • Familiarity with CI/CD pipelines and Unit testing.

Additional Information  

Sitecore is proud to be an equal-opportunity workplace. We are committed to equal employment opportunity without unlawful regard to race, color, ancestry, religion, gender, national origin, sexual orientation, age, citizenship, marital status, disability, veteran status, or any other local legally protected characteristic.   
 

Share this job