Mexico
Banco Mercantil del Norte, S.A.
DaCodes
Data Engineer Azure Databricks - ETL Automation Specialist
RemoteMexico
Ciudad de México, Mexico
PythonSQL
Automatic translation. Check the original.
About the opportunity
Work at DaCodes!
We are a firm of experts in high-impact software and digital transformation.
For 10 years, we have created solutions focused on technology and innovation thanks to our team of almost 300 talented #DaCoders, including developers, architects, UX/UI designers, PMs, QA testers, and more. Our team collaborates on projects with clients in LATAM and the United States, achieving outstanding results.
At DaCodes, you will have the opportunity to drive your professional development, work on diverse projects across different industries, and contribute to the design, implementation, and optimization of cloud infrastructures.
Our DaCoders have a great impact on the success of our business and that of our clients. You will be the expert participating in our projects and will have access to disruptive startups and global brands.
Interested?
We are looking for an Azure Data Engineer with experience in Databricks and Azure Data Factory for a short-term project focused on the automation and optimization of data integration processes.
We are looking for a person with execution capability, who can quickly join a productive environment and contribute to the construction, automation, and improvement of ETL processes within the Azure ecosystem. The ideal profile has practical experience developing data pipelines, processing structured files, and automating workflows using Azure Data Factory and Databricks.
This position is aimed at professionals who enjoy solving challenges related to data integration, operational automation, and efficient information processing, collaborating with technical and business teams to ensure data quality and availability.
Main Responsibilities
- Design, develop, and maintain ETL processes using Azure Data Factory and Databricks.
- Implement data integration pipelines for ingesting and processing CSV, TXT, Excel, and other information sources.
- Automate data loading, transformation, and validation processes.
- Configure and manage Jobs and Workflows in Databricks for scheduled process execution.
- Develop data transformations using SQL and technologies from the Databricks ecosystem.
- Monitor, diagnose, and resolve incidents related to pipelines and ETL processes.
- Ensure the quality, consistency, and integrity of processed data.
- Collaborate with technical teams and stakeholders to understand integration and automation requirements.
- Participate in optimization and continuous improvement activities for data processes.
Desired Profile Experience
- 5+ years of experience in Data Engineering, ETL Development, or Data Integration roles.
- Proven experience working with Azure Data Factory.
- Hands-on experience developing solutions with Databricks.
- Experience implementing end-to-end ETL processes.
- Experience processing and integrating structured files and diverse data sources.
Technical Knowledge
Essential
- Azure Data Factory (ADF).
- Azure Databricks.
- Advanced SQL.
- Development and automation of ETL processes.
- Design and maintenance of data pipelines.
- Integration and processing of CSV, TXT, and Excel files.
- Troubleshooting and monitoring of data processes.
- Python.
- PySpark.
Soft Skills
- Analytical and problem-solving skills.
- Autonomy and results-orientation.
- Effective communication.
- Attention to detail.
- Proactivity.
- Ability to integrate quickly into ongoing projects.
- Organization and efficient priority management.
Previous experience working in Microsoft Azure-based cloud environments
Desirable
- Azure Data Lake Storage (ADLS).
- Azure Blob Storage.
- Git.
- Optimization of data transformation processes.
Additional Requirements
Modality: Remote.
Location: LATAM.
Level: Semi Senior or Senior.
Availability to join a fast-execution project.
Salary Range 35 to 40k net (Mexico) // 1800 USD Per month. (LATAM)
----------------------------------------------------------------------------------------
- 🚀 Integration into global brands and disruptive startups.
- 🏡 Remote work/Home office.
- ⏳ Schedule adjusted to the work cell/assigned project.
- 📅 Monday to Friday work.
- 🌎 Multicultural work teams.
- 🏆 Opportunities within our different business lines.
- 🏅 Proudly certified as Great Place to Work.
More opportunities with one profile
Want to be considered for more roles without repeating the whole process? Create your profile and be found by companies using Nort.
Create my profile