Data Engineer- Stream

Engineering Bengaluru, Karnataka Full-Time


Description

This is Us: 

 We have a bold vision to connect 25 million vehicles by 2025. 

  • We love what we do. We do what is right. We are always reaching. 
  • We adhere to our brand promise – to make the complex simple, the future predictable, and our customers successful. 

With more than 4 million connected vehicles today, Spireon is an exciting player in the growing Connected Car and Internet of Things (IoT) technology categories. We help people and businesses track and protect their most important assets with vehicle intelligence solutions that gather Big Data and provide critical insights with easy-to-use dashboards and apps. 

This is You: 

Spireon is seeking a Senior Data Engineer to assist in data integration, data processing, data quality, and data reporting development to meet the strategic and operational needs of the organization. 

You reflect Spireon’s Core Values: 

Adaptable/Resilient – You easily adapt to change, take on new responsibilities, embrace challenges and thrive in ambiguity. 

Customer’s Guide – You build client confidence, start with the customer in mind first, and ensure commitments are met. 

Go Higher - You are not happy with the status quo, like to push the envelope and engage in stretch projects. 

Team Player - You are a collaborator, invite feedback from colleagues, and naturally do the right thing for the team. 


Responsibilities: 

  • Work with the data team and software developers to maintain data pipelines, Snowflake DataPlatform, CI/CD (schema and data pipeline life cycle) 
  • Work with the data team in the data preparation, data quality, reporting, and analytic tasks required to meet business needs and requirements. 
  • Use advanced visualization software such as Looker (Tableau or PowerBI) to create meaningful graphical representations of data and tell compelling stories with reports. 
  • Assist in the design of dashboard representation of various data, clearly showing data-driven cut-offs and threshold criteria. 
  • Implement testing strategies to ensure consistency between data collection sources, data warehouse database, reports, and interfaces. 
  • Identify the root cause of data integrity issues and implement corrective action through strong partnerships with the development team and database administrators. 
  • Work with multiple, large datasets (primarily Snowflake, MySQL, ElasticSearch, Mongo, S3) as needed to drive analytic, graphical, and reporting solutions. 
  • Maintain database and reporting documentation. 

Requirements: 

  • Bachelor’s or Master’s degree in CS, Engineering
  • Over all 7 + years of engineering experience with Application and/or data development
  • 2 + Coding experience with Python or Scala or Similar language required
  • 2+ Experience building data pipelines with data from event streams, NoSQL, APIs etc. using distributed data frameworks
  • 2+ Experience designing and delivering data integrations, data lakes and data warehouses
  • Experience with different aspects of data systems including database design, data modelling, performance optimization, SQL etc.
  • Experience in Kafka, Spark Streaming , AWS and Docker is a huge plus
  • Communicate and document solutions and design decisions
  • Strong communication skills (able to explain concepts to non-technical audiences as well as peers)
  • Self-starter who is highly organized, communicative, quick learner, and team-oriented



Rewards:

  • Award Winning Products and Customer Service
  • Work with the Best and Brightest Talent
  • Leader in Aftermarket Telematics and Vehicle Intelligence Solutions
  • Comprehensive Benefits (Medical, Dental, Vision, 401K Plan)
  • Flexible Schedule and Work Life Balance
  • Culture of Ongoing Learning and Development
  • Wellness Programs, Virtual Happy Hours and Team Building Events
  • Employee Discounts on Spireon Products and Services