Mid+ to Senior Python ETL Developer

ETL DeveloperRemote, Brazil


Description

Company Overview:

 

Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer many opportunities for professionals to elevate their careers and experience substantial growth. Joining our team means engaging with expansive engineering teams across Latin America and the United States, contributing to cutting-edge developments in multiple industries.
Currently, we are seeking a Python ETL Developer to join our team. Here are the challenges that our next warrior will face and the requirements we look for: 

 

What You Will Be Doing

 

• Design and implement robust and scalable data pipelines using Python.
• Develop and maintain data integrations with various company platforms and
services via APIs and web scrapers.
• Utilize web scraping tools and libraries such as BeautifulSoup, Scrapy, or
Selenium to extract the required information.
• Centralize data from multiple sources into the company's databases for
unified access and analysis.
• Automate ETL processes to manage unstructured data and decision logic.
• Ensure data integrity and efficient processing using pandas and other
relevant Python libraries.
• Optimize data models in Snowflake to enhance performance and efficiency.
• Implement monitoring systems for data pipelines and incorporate feedback
mechanisms.
• Collaborate with cross-functional teams to gather requirements and deliver
solutions aligned with business objectives.

 

Required Skills & Experience

 

To excel in this role, you should possess:
• Bachelor's or Master's degree in Computer Science, Data Engineering, or a
related field.
• 3+ years of experience in data engineering with a focus on data integration
and process automation.
• Advanced proficiency in Python, including experience with data manipulation
and analysis using pandas.
• Experience with Snowflake for data storage and processing.
• Strong experience with API development and integration.
• Proficiency in web scraping tools and libraries such as BeautifulSoup, Scrapy,
or Selenium.
• Intermediate experience with AWS services (EC2, RDS) for managing data
solutions and scaling models.
Pg. 8 / 12
• Strong knowledge of DevOps practices, including deployment, versioning,
and monitoring of data pipelines.
• Intermediate knowledge of Docker and familiarity with microservices
architecture and containerization technologies.
• Excellent problem-solving skills and ability to work with cross-functional
teams.
• Understanding of the ethical considerations and safety measures in
automated systems.

 

Why you will love Lean Tech:

 

  • Join a powerful tech workforce and help us change the world through technology
  • Professional development opportunities with international customers
  • Collaborative work environment
  • Career path and mentorship programs that will lead to new levels. 

 

Join Lean Tech and contribute to shaping the data landscape within a dynamic and growing organization. Your skills will be honed, and your contributions will be vital to our continued success. Lean Tech is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.