Senior Data Engineer - Payment Intelligence
Description
Senior Data Engineer – Payment Intelligence
AArete is one-of-a-kind when it comes to consulting firm culture.
We’re a global, innovative management and technology consulting firm with offices in the U.S., India, and Europe. Our name comes from the Greek word for excellence: “Areté.” And excellence is exactly what we strive for.
We’re celebrating our fourth year as one of Forbes’ World’s Best Management Consulting Firms – and our success starts with our people. From robust career development planning to competitive life and wellness benefits, AArete’s “Culture of Care” takes a holistic approach to the employee experience.
AAretians (our team members) are leaders at every level. You are encouraged to unlock your full potential by directly contributing to our mission and prioritizing personal development and fulfillment.
The Role
We are hiring a Senior Data Engineer to join our Payment Intelligence (PI) team within the Data Architecture & Engineering practice. You will design, build, and maintain data pipelines that power healthcare payer analytics - including claims processing, contract configuration, pricing edits, and fee schedule ingestion. This is hands-on engineering work in a Snowflake and AWS environment, not a management role.
Work You’ll Do
- Design, develop, and maintain scalable data pipelines in Snowflake for healthcare claims, contract configuration, and fee-for-service reimbursement logic
- Build and optimize ELT processes using Snowflake SQL, stored procedures, and dynamic SQL for complex healthcare datasets
- Develop and maintain Apache Airflow DAGs (AWS MWAA) for pipeline orchestration, scheduling, and monitoring across multiple data domains
- Write clean, testable Python scripts for data transformation, validation, web scraping automation, and API integrations
- Implement and maintain CI/CD workflows using Bitbucket Pipelines and Liquibase for database migration and schema change management
- Support data quality and governance processes, including Snowflake role-based access control, dynamic data masking, and schema patterns
- Monitor pipeline health, troubleshoot failures, and resolve incidents across Snowflake, AWS Lambda, S3, SNS, and CloudWatch
- Leverage AI coding assistants to accelerate development, with a focus on review, refinement, and quality assurance of AI-generated output
- Collaborate with business analysts and project teams to translate healthcare business requirements into technical pipeline specifications
- Document technical processes, pipeline architecture, and operational runbooks in Confluence
- Other duties as assigned
Requirements
- 5+ years of hands-on data engineering experience
- Proficiency in Snowflake: ELT pipeline development, stored procedures, query optimization, data modeling (star, snowflake, and hybrid schemas)
- Strong SQL skills, including complex joins, window functions, CTEs, and dynamic SQL generation
- Solid Python experience in a data engineering context (Pandas, file processing, API clients, web scraping with BeautifulSoup or Scrapy)
- Experience with Apache Airflow for pipeline orchestration (AWS Managed Workflows for Apache Airflow preferred)
- Hands-on experience with AWS services: S3, Lambda, SNS, CloudWatch, IAM
- Proficiency with Git-based version control and CI/CD pipelines (Bitbucket Pipelines preferred)
- Experience with database migration tooling (Liquibase preferred)
- Demonstrated ability to work independently and manage priorities across concurrent workstreams
- Strong written and verbal communication skills in English, with the ability to collaborate effectively across time zones
- Experience working in globally distributed teams
Preferred Qualifications
- Healthcare payer domain experience: claims data, provider contracts, fee schedules, or pricing analytics
- Experience with data governance frameworks, HIPAA compliance, and PHI handling in cloud environments
- Familiarity with Power BI for data visualization and reporting
- Experience with AI-assisted development tools (Claude Code, GitHub Copilot, or similar)
- Familiarity with Terraform or infrastructure-as-code practices
- Unit testing and test-driven development practices for data pipelines
- Agile delivery experience (Scrum or Kanban), including sprint planning and backlog management in Jira
- Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent practical experience)
Benefits
- Flexible Paid Time Off of up to 23 days annually, in addition to 10 paid public holidays
- Hybrid work model with flexible in-office attendance
- Comprehensive health benefits including medical insurance (Mediclaim), personal accident insurance, and term life insurance
- Generous paid parental leave program
- Attractive employee referral bonus scheme
- Transportation allowance and night shift allowance
- Employee advance salary loan facility
- Structured professional certification reimbursement policy to support ongoing learning and development
We put humans at the center of our work
We’re a global management and technology consulting firm specializing in strategic profitability improvement, digital transformation, and strategy & change for clients. Our cross-industry solutions are powered by a digital-first mindset, market intelligence, and data-driven approach to deliver purposeful change, actionable insights, and guaranteed results.
But what sets us apart is our people. We are guided by our deeply embedded guiding principles: Excellence, Passion, Loyalty to Clients, Stewardship, Family, Community, Sustainability, and Inclusion.
And we’ve been recognized as a top firm to work for by companies like Forbes, Top Workplaces Chicago Tribune, and Consulting Magazine.
We’ve earned a Great Place to Work Certification™ and been named a World’s Best Management Consulting Firm by Forbes, Vault’s Top 50 Firms to Work For, Crain's Chicago Business Fast 50, Inc 5000’s Fastest Growing Firms, and Consulting Magazine's Fastest Growing Firms.
Learn more about our award-winning culture
We are an Equal Employment Opportunity Employer
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
#LI-DNI