ETL Developer (Mid - SME Level)
Description
ETL Developer – TS/SCI with Full Scope Polygraph
Xcelerate Solutions is seeking an experienced ETL Developer to play a pivotal role in shaping, leading, and implementing cutting-edge data flow solutions centered around Apache NiFi. This role supports the design, development, and deployment of Extract, Transform, and Load (ETL) processes that power enterprise-level data lakes and analytics ecosystems. The ideal candidate will define architectural best practices, optimize performance in large-scale environments, and mentor junior developers, ensuring the delivery of robust, scalable, and secure data flow solutions aligned with mission-critical customer objectives.
Security Clearance:
Top Secret / SCI with Full Scope Polygraph
Top Secret / SCI with Full Scope Polygraph
Location:
Bethesda, MD
Bethesda, MD
Responsibilities:
- Architect complex data pipelines: Design and implement enterprise-level NiFi-based ETL architectures for large-scale data ingestion, transformation, and processing from diverse structured and unstructured sources.
- Optimize and tune performance: Configure and fine-tune NiFi processors, manage system memory, and balance workloads to ensure optimal throughput and efficiency for both batch and real-time data flows.
- Advanced troubleshooting: Identify and resolve complex data flow issues, performance bottlenecks, and integration challenges to maintain consistent and reliable operations.
- Integrate with big data and cloud technologies: Connect NiFi with databases, cloud platforms (AWS, Azure, OCI), and big data services (e.g., Kafka, Elasticsearch, S3, SQS/SNS) to enable seamless end-to-end data movement.
- Establish best practices: Define and enforce NiFi development, deployment, and governance standards, ensuring alignment with enterprise data management policies and DevOps practices.
- Documentation and knowledge sharing: Develop comprehensive documentation, including data flow mappings, architectural diagrams, and SOPs, to support scalability and continuity across teams.
- Cross-functional collaboration: Partner closely with data architects, data engineers, and application developers to translate complex business requirements into robust technical implementations.
- Mentorship and leadership: Provide technical guidance, conduct code reviews, and mentor junior team members to enhance team capability and foster a culture of continuous improvement.
Minimum Requirements:
- Proven experience designing, developing, and managing complex NiFi data flow solutions in large-scale, enterprise environments.
- Deep understanding of NiFi architecture, including processors, configurations, clustering, and NiFi Registry.
- Proficiency in Java and Python for developing custom NiFi processors and automation scripts.
- Experience managing relational and NoSQL databases (e.g., PostgreSQL, Elasticsearch, DynamoDB) and writing optimized queries.
- Strong background in real-time streaming and REST API integration for dynamic data movement.
- Hands-on experience with cloud platforms (AWS, Azure, OCI) and related data services.
- Ability to analyze complex data challenges, identify root causes, and implement effective, sustainable solutions.
- Excellent communication and collaboration skills, with the ability to clearly convey technical concepts to diverse audiences.
Education/Experience:
- HS diploma plus 12 - 16+ years of relevant experience
- BS degree plus 8 - 12+ years of relevant experience
- Master’s degree plus 6 - 10+ years of relevant experience
- Active TS/SCI with polygraph required.
Preferred Qualifications:
- Demonstrated experience deploying and managing ETL solutions within AWS environments, leveraging native cloud data tools and automation frameworks.
About Xcelerate Solutions:
Founded in 2009 and headquartered in McLean, VA. Xcelerate Solutions (www.xceleratesolutions.com) is one of America's fastest-growing companies. Xcelerate’s culture is defined by our dynamic workforce of versatile professionals, supported with growth and development opportunities that drive both individual and company success.
Our commitment to employees has been recognized by the Washington Business Journal’s “50 Best Places to Work” list and Great Place to Work® certification, with a 4.6-star rating and 99% CEO approval on Glassdoor. Come find out why Xcelerate Solutions is one of the top DC Metro employers!
Xcelerate Solutions is an Equal Employment Opportunity/Affirmative Action Employer. We evaluate qualified applicants without regard to race, color, national origin, religion, age, equal pay, disability, veteran status, sex, sexual orientation, gender identity, genetic information, or any other protected characteristic.
Pay Transparency Notice:
Xcelerate Solutions will not discharge or otherwise discriminate against employees or applicants for discussing or disclosing their compensation.
Xcelerate Solutions will not discharge or otherwise discriminate against employees or applicants for discussing or disclosing their compensation.