Data Engineer: Integration Migration
Enroute
Job Description
<p>We love technology, and we enjoy what we do. We are always looking for innovation. We have social awareness and try to improve it daily. We make things happen. You can trust us. Our <a href="https://himalayas.app/companies/enroute">Enroute</a>rs are always up for a challenge. We ask questions, and we love to learn.</p><p>We pride ourselves on having great benefits and compensations, a fantastic work environment, flexible schedules, and policies that positively impact the balance of work and life outside of it. We care about who you are in the office and as an individual. We get involved, we like to know our people, we want every <a href="https://himalayas.app/companies/enroute">Enroute</a>r to become part of a great community of highly driven, responsible, respectful, and above all, happy people. We want you to enjoy working with us.<br><br>We are looking for a <strong>Data Engineer</strong> with strong ETL and integration experience to support a migration from different Sources to Azure Data Factory. This role will focus on analyzing existing processes, redesigning and rebuilding data pipelines in ADF, and ensuring that data movement, transformations, scheduling, monitoring, and error handling are successfully migrated to the Azure platform. </p><p>The ideal candidate should have hands-on experience designing, developing, and supporting ETL / ELT pipelines, working with enterprise integration platforms, and building reliable data movement processes in Azure Data Factory. </p><h3>Requirements</h3><ul><li>Strong hands-on experience with Azure Data Factory. </li><li>Experience designing, developing, and supporting ETL / ELT pipelines. </li><li>Experience integrating with databases, flat files, APIs, cloud storage, and enterprise applications. </li><li>Strong SQL skills and experience working with relational databases. </li><li>Understanding of pipeline orchestration, dependencies, scheduling, monitoring, retry logic, and error handling. </li><li>Experience with data mapping, transformation logic, data validation, and migration testing. </li><li>Ability to analyze existing integration processes and rebuild them in a new platform. </li><li>Strong troubleshooting, documentation, and communication skills. </li><li>Ability to collaborate with database engineers, QA, architecture, and business teams. </li><li>Experience with CI/CD process.<br><br><strong>Responsibilities</strong></li><li><strong>Analyze existing integrations, workflows, mappings, transformations, schedules, and dependencies. </strong></li><li><strong>Design and develop data pipelines in Azure Data Factory. </strong></li><li><strong>Connect ADF pipelines to source and target systems, including Oracle, Azure SQL, files, APIs, and other relevant systems. </strong></li><li><strong>Implement pipeline scheduling, parameterization, monitoring, alerting, retry logic, and error handling. </strong></li><li><strong>Collaborate with database migration engineers to ensure pipelines align with migr