Senior Data Engineer (Big Data)

Engineering Mill Valley, California


Description

Our mission is to help people everywhere find a job and company they love.  We are disrupting an industry by changing how people search for jobs and how companies recruit top talent. 

We are looking for a talented engineer to join our growing data engineering team. The ideal candidate has significant experience in building scalable data platforms that enable business intelligence, analytics, data science and data products. You must have strong, hands-on technical expertise in a variety of technologies and the proven ability to fashion robust, scalable solutions. You should have a passion for continuous improvement and data quality.

We embrace a wide variety of technologies and work very closely with data scientists and business stakeholders to deliver end to end solutions. If you are interested in a fast paced environment, the latest technologies, and fun data problems, come join us!

Responsibilities

  • Design and develop big data applications using a variety of different technologies.
  • Develop logical and physical data models for big data platforms.
  • Automate workflows using Apache Airflow.
  • Write data pipelines using Apache Hive, Apache Spark, Apache Kafka.
  • Create solutions on AWS using services such as Lambda and API Gateway.
  • Provide ongoing maintenance and enhancements to existing systems, and participate in rotational on-call support.
  • Learn our business domain and technology infrastructure quickly and share your knowledge freely and proactively with others in the team.

Key Qualifications

  • 5+ years of hands-on experience with developing data warehouse solutions and data products.
  • 2+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive, Spark, Airflow, Kafka, etc.
  • 2-3 years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
  • Experience with programming languages: Python, Java, Scala, etc.
  • Experience with scripting languages: Perl, Shell, etc.
  • Practice working with, processing, and managing large data sets (multi TB/PB scale).
  • Exposure to test driven development and automated testing frameworks.
  • Background in Scrum/Agile development methodologies.
  • Capable of delivering on multiple competing priorities with little supervision.
  • Excellent verbal and written communication skills.
  • Bachelor's Degree in computer science or equivalent experience.

Nice To Have

  • Experience building machine learning pipelines or data products.
  • Familiarity with AWS or GCS technologies.
  • Be passionate about or have contributed to open sourced engineering projects in the past.

Why Glassdoor?

  • Work with purpose – join us in creating transparency for job seekers everywhere
  • Glassdoor gives back! Glassdoor is a Pledge 1% member; all employees receive 3 paid volunteer days per year
  • 100% company paid medical/dental/vision/life coverage; 85% dependent coverage
  • Equity in a late stage startup backed by top-tier VCs
  • Sunny & peaceful Mill Valley offices located right on the water
  • Walking, running and biking trails steps away from the office
  • Onsite gym and fitness classes
  • Free catered lunch; new menu daily
  • Paid holidays and flexible paid time off
  • Your choice between Mac or PC
  • Dog-friendly office (with dog-free zones if you are so inclined)
  • Free parking

Glassdoor is committed to equal treatment and opportunity in all aspects of recruitment, selection, and employment without regard to gender, race, religion, national origin, ethnicity, disability, gender identity/expression, sexual orientation, veteran or military status, or any other category protected under the law. Glassdoor is an equal opportunity employer; committed to a community of inclusion, and an environment free from discrimination, harassment, and retaliation.