Senior Data Engineer
Description
Company Overview:
Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer many opportunities for professionals to elevate their careers and experience substantial growth. Joining our team means engaging with expansive engineering teams across Latin America and the United States, contributing to cutting-edge developments in multiple industries.
We are looking for an experienced Senior Data Engineer to help design, build, and optimize modern data solutions. You will work on scalable batch and streaming pipelines, ensure high standards of data governance and security, and contribute to a cloud-based data platform used for analytics and AI. Our preferred platforms are Fabric, Snowflake, Databricks, and AWS (in that order). If you have experience in Azure data services, that knowledge is highly relevant and transferable to Fabric.
Position Title: Senior Data Engineer
Location: Remote - LATAM
What you will be doing:
- Build & Optimize Pipelines: Develop reliable batch and streaming data pipelines using Spark, Delta Lake, and modern frameworks.
- Data Platform Engineering: Implement ingestion, transformation, and curation workflows across Databricks, Fabric, Snowflake, or AWS.
- Model Data: Design logical and physical models that support analytics, AI, and business processes.
- Orchestrate Workflows: Use orchestration tools like Lakeflow, Airflow, dbt, or equivalent to manage end-to-end data processes.
- Governance & Security: Apply best practices for data governance, lineage, and secure access.
- Collaborate: Partner with data scientists, analysts, and business stakeholders to deliver data solutions that meet real-world needs.
- Optimize: Monitor and tune pipelines and infrastructure for scalability, reliability, and cost efficiency.
Requirements & Qualifications
To excel in this role, you should possess:
- Technical Skills: strong hands-on experience with Apache Spark, Delta Lake, and streaming technologies. Solid programming skills in Python and SQL. Good understanding of data modeling, governance, and security best practices
- Platforms: Experience in one or more of Fabric, Snowflake, Databricks, AWS. Knowledge of Azure data services is considered transferable to Fabric
Nice to Have:
- Familiarity with CI/CD for data pipelines
- Exposure to machine learning or AI-driven data pipelines
Soft Skills:
- Problem-solving approach with a focus on scalability and efficiency.
- Strong communication and collaboration skills in cross-functional teams
Why you will love Lean Tech:
- Join a powerful tech workforce and help us change the world through technology
- Professional development opportunities with international customers
- Collaborative work environment
- Career path and mentorship programs that will lead to new levels.
Join Lean Tech and contribute to shaping the data landscape within a dynamic and growing organization. Your skills will be honed, and your contributions will be vital to our continued success. Lean Tech is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.