Pyspark AWS Data Enigneer

Delivery Hinjewadi, Pune, India


Description

JD: PySpark Data Engineer

  • Bachelor’s or Master’s degree in computer science or software engineering
  • 5-10+ years of programming as Software Engineer or Data Engineer with experience in Informatica or any other ETL tools.
  • 2+ years of advanced experience in PySpark (Python and Spark)
  • 2+ years of experience with AWS cloud services: S3, EC2, EMR, RDS, Redshift, Glue, Lambda, EKS
  • Experience building and optimizing big data pipelines using Spark or other similar technologies
  • Experience with relational SQL and NoSQL databases, including Postgres
  • Solid understanding of how to design robust data workflows including optimization and user experience
  • Strong analytical and problem-solving skills
  • Excellent oral and written communication skills