Azure Data Platform Engineer

Position Overview

We are seeking a seasoned Azure Data Platform Engineer to lead the design, creation, testing, deployment, and maintenance of extensive data pipelines leveraging Azure Data Factory (ADF). The role involves integrating data from diverse sources into Azure storage solutions, ensuring reliable and scalable data architectures aligned with business needs.

Key Responsibilities

• Architect, implement, and sustain large-scale data pipelines with Azure Data Factory to enable seamless extraction, transformation, and loading of data.
• Partner with various cross-functional teams to gather business requirements and translate them into robust and scalable data architectures.
• Develop advanced ETL workflows to integrate heterogeneous datasets across multiple systems, optimizing data flow and reliability.
• Identify, analyze, and resolve issues impacting pipeline performance, data integrity, and security compliance.

Qualifications and Experience

• Between 4 to 9 years of professional experience in conceiving and deploying big data solutions within Microsoft Azure ecosystems.
• In-depth knowledge of Azure HDInsight Studio for designing and implementing scalable data solutions.
• Expertise in developing ETL processes using Azure Data Factory or comparable platforms such as Informatica PowerCenter or Talend.
• Familiarity with monitoring and real-time event processing tools like Azure Event Hubs.

Additional Information

Applicants do not need to have completed formal graduation to be eligible for this role.