Azure Data Engineer - ADB, Python, PySpark, SQL, BI

Role Overview

This position involves designing, architecting, developing, and maintaining complex data engineering solutions within the Azure ecosystem. The role demands advanced coding skills and the capacity to resolve production issues efficiently while collaborating with various stakeholders to fulfill business requirements.

Key Responsibilities

• Develop intricate codebases and troubleshoot problems effectively.
• Work closely with stakeholders to comprehend needs and independently provide reliable technical solutions.
• Dedicate approximately 70% of time to designing, architecting, and coding, and 30% to mentoring the team and coordinating activities.
• Manage development processes as well as debugging and resolving any post-production defects related to the developed components.
• Participate in coding exercises assessing the ability to deliver optimal Python/PySpark code addressing data quality and transformation without reliance on AI tools, and rectify errors in sample code.

Required Skills and Experience

• Expertise in Azure Data Bricks, Python, PySpark, SparkSQL.
• Proficient in continuous integration and deployment using Jenkins, GitHub.
• Experience with monitoring tools like Dynatrace.
• Capability to write high-quality, optimal code in time-restricted conditions.
• Strong analytical and problem-solving skills.

Additional Advantages

• Experience or exposure to Power BI dashboard development.
• Functional knowledge in retail banking, capital markets, or securities processing.