Data Engineer

Product Development Open, Any

Position at Smarsh

Smarsh empowers its customers to manage the risk and unleash the intelligence in their digital communications. Our growing community of over 6500 organizations in regulated industries counts on Smarsh every day to help them spot compliance, legal or reputational risks in 80+ communication channels, before those risks become regulatory fines or headlines.  Relentless innovation has fueled our journey to consistent leadership recognition from analysts like Gartner and Forrester, and our sustained, aggressive growth has landed Smarsh in the annual Inc. 5000 list of fastest-growing American companies since 2008.

Essential Functions

Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Essential Functions below:

  • Support our existing reporting needs and technologies
  • Be part of a team that will standup up a robust data warehouse to support to support reporting & analytics for internal stakeholders and clients.
  • Design and code data pipeline features and data processing jobs for collecting data from disparate systems for the purpose of storing in a data warehouse
  • Create and maintain optimal data pipeline architecture.
  • Work with real-time data streams from multiple internal/external sources
  • Write ETL pipelines to implement pre-defined business rules and metrics along with ensuring data quality in data warehouse processes
  • Ensure smooth ongoing operations of data warehouse platform with high availability while making continuous improvements.
  • Provide scalable solutions to manage large imports and implement operational procedures as necessary
  • Design robust data warehouse management functions covering resource management, security, backup and recovery, performance monitoring and tuning and high availability
  • Participate in peer code reviews and produce high quality documentation
  • Work on integrated teams of product management, architects, and data engineers to ensure we’re building the best products possible
  • Collaborate with business units to automate reporting needs
  • Upkeep standard development methodologies of best practices for collaborative coding, modular efficiency, version control, QA, and release management
  • Other duties as assigned

Education and Experience

  1. B.S. degree in math, statistics, computer science, or equivalent technical field
  2. Minimum 3+ years of experience with data engineering with emphasis on data analytics and reporting
  3. Expert experience in report building through MS SQL Server Reporting Services (SSRS)
  4. Expert experience with MS SQL relating to query writing and tuning
  5. Demonstrated experience working in large-scale data environments which included real-time and batch processing requirements
  6. Experience working with source-code management tools such as GitHub and Jenkins
  7. Ability to partner with business and technology team members, to understand business requirements and translate those into value-add technology solutions
  8. Experience designing and delivering large scale, 24-7, mission-critical data pipelines and features using modern big data architectures
  9. A sound understanding of BI best practices, relational structures, dimensional data modeling, structured query language (SQL) skills, data warehouse and reporting techniques
  10. Proven ability to work within set timelines and update management on deviation from these estimates
  11. Has strong interpersonal communication skills; effectively communicates in verbal and written form
  12. You appreciate agile software processes, data-driven development, reliability, and responsible experimentation.
  13. Or equivalent combination of education and experience.

Additional Eligibility Qualifications

  • Experience developing solutions in Snowflake
  • Knowledge of building solutions with data visualization and reporting tools such as Looker, PowerBI, Tableau, etc.
  • Experience integrating data from multiple data sources and file types such as JSON and AVRO formats.

Work Authorization/Security Clearance (if applicable)

We are not providing sponsorship at this time.

About our culture

Smarsh hires lifelong learners with a passion for innovating with purpose, humility and humor. Collaboration is at the heart of everything we do. We work closely with the most popular communications platforms and the world’s leading cloud infrastructure platforms. We use the latest in AI/ML technology to help our customers break new ground at scale. We are a global organization that values diversity, and we believe that providing opportunities for everyone to be their authentic self is key to our success. Smarsh leadership, culture, and commitment to developing our people have all garnered Best Places to Work Awards. Come join us and find out what the best work of your career looks like.