Senior Data Engineer
Description
Company Overview:
Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer a multitude of opportunities for professionals to elevate their careers and experience substantial growth. Joining our team means engaging with expansive engineering teams across Latin America and the United States, contributing to cutting-edge developments in multiple industries.
Currently, we are seeking a Data Engineer with a strong English level to join our team. Here are the challenges that our next warrior will face and the requirements we look for:
Position Title: Senior Data Engineer
Location: Colombia (Remote)
What you will be doing:
- Design and implement robust and scalable data pipelines using Python and DBT.
- Develop and maintain data integrations with APIs and cloud services.
- Optimize data models in Snowflake to enhance performance and efficiency.
- Automate ETL processes to manage unstructured data and decision logic.
- Ensure data integrity and efficient processing using pandas.
- Design scalable solutions for seamless integration with enterprise cloud systems such as EC2 and RDS.
- Implement monitoring systems for data pipelines and incorporate feedback mechanisms.
- Collaborate with cross-functional teams to gather requirements and deliver solutions aligned with business objectives.
- Stay informed on industry trends in data engineering and cloud computing, integrating innovations into current systems.
Requirements & Qualifications
To excel in this role, you should possess:
- Main skills:
- Bachelor's or Master’s degree in Computer Science, Data Engineering, or a related field.
- 5+ years of experience in data engineering, particularly with data integration and process automation.
- Advanced proficiency in Python, including experience with data analysis using pandas.
- Intermediate experience with cloud services in AWS.
- Deep knowledge of DBT for data transformation and modeling.
- Experience with Snowflake for data storage and processing.
- Experience with API development and integration.
- Strong knowledge of DevOps practices, including deployment, versioning, and monitoring of data pipelines.
- Familiarity with data engineering tools in Python like Airflow, pandas, and requests.
- Secondary skills:
- Intermediate knowledge of Docker and familiarity with microservices architecture and containerization technologies.
- Experience with process automation tools and frameworks.
- Understanding of the ethical considerations and safety measures in automated systems.
- Soft skills:
- Effective communication: ability to clearly articulate complex technical concepts to non-technical stakeholders, facilitating cross-functional collaboration.
- Problem-solving: Strong analytical and innovative skills, essential for navigating and resolving complex challenges in data engineering and process automation.
- Collaboration: demonstrated experience working with diverse teams to gather requirements and deliver data-driven solutions aligned with business objectives.
- Adaptability: proactively stay informed about industry trends in data engineering and cloud computing, and integrate innovative solutions into current systems to maintain a competitive edge.
- Leadership: Lead projects with a focus on optimizing performance and efficiency, fostering a culture of continuous improvement and learning.
Why you will love Lean Tech:
- Join a powerful tech workforce and help us change the world through technology
- Professional development opportunities with international customers
- Collaborative work environment
- Career path and mentorship programs that will lead to new levels.
Join Lean Tech and contribute to shaping the data landscape within a dynamic and growing organization. Your skills will be honed, and your contributions will play a vital role in our continued success. Lean Tech is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.