PYSPARK DEVELOPER ON EMR/AWS
Description
FI Consulting is a fast-moving, high-growth firm with huge potential. FI offers variety, challenge, responsibility and the opportunity to realize your leadership potential.
For more than 19 years financial institutions in the Federal, private and public sectors have called on FI Consulting to address complex and high-stakes analytical challenges that are closely scrutinized by executives, auditors, regulators and stakeholders. We help clients succeed by applying our core strengths in business applications of Data Engineering, Analytics, Modeling, and Business Architecture to gain insight into finances, loans, performance, manage risk, and improve operations.
We are looking to strengthen a team with a PySpark developer to migrate SAS models into AWS.
Required Skills:
- The developer is expected to be hands on with converting SAS code to PySpark ensuring quality and maintainability.
- Well versed in EMR PySpark performance tuning leveraging EMR architecture (Master, cluster, memory utilization...)
- Ability to quickly identify sources of discrepancies in outcome between SAS and PySpark execution.
- Experience with Parallel programming with Big Data, ETL, API Framework etc.
- At least 2+ years of experience working in a PySpark/EMR environment
- Proficiency with one or more programming language (Python, Java, PySpark preferred)
- Proficiency in SQL, relational and non-relational databases, Query optimization, and data modeling
- Experience working in a linux-based environment
- Ability to be a self-starter and to take control of a process without a lot of guidance.
- Experience working on a team operating under Agile Scrum delivery methodology.
As part of our meritocratic culture, we strongly encourage each of our employees to remain committed to “stretching” the levels of their most current professional strengths to continuously adapt, grow and expand their subject matter expertise for the benefit of adding value to our clients. The emphasis on stretch starts at the very top of our organization and is promoted throughout to all members of our team. The desire of our employees to stretch is critical to effectively, and with greater flexibility, plan project assignments and subsequently position our people and the company for future success.
Who We Are: FI Consulting is a 65-person professional services firm that helps government and commercial financial institutions solve hard problems in data, analytics, modeling, and technology. Our professionals are specialists with expertise across a range of fields, for example:
- Financial and economic modeling
- Data analytics & visualization
- Financial products and markets
- Economics and statistics
- Business process management and re-engineering
Our Company Values & Operates on:
- A Commitment to Creating Value for our Clients and our Employees
- A Flat Management Structure that is Still Led by one of the Original Founders
- An Emphasis on Teamwork and Cooperation
- Employee Development and Career Growth
- Continuous Improvement
- An Entrepreneurial Culture that Rewards Finding, Developing, and Owning Business
What its really like to Work for Us:
You will work with a team of smart, talented people in a culture that is simultaneously driven, collegial, and supportive. We set high expectations for employees in the areas of project delivery excellence, building trusted client relationships, and continuous improvement. Teamwork and collaboration is at the heart of what we do.
FI Consulting is an Equal Opportunity Employer of Minorities, Females, Protected Veterans, and Individuals with Disabilities.
FI Consulting participates in E-Verify.