Azure DataBricks Pyspark Python SQL Developer

About the Role

We are seeking a seasoned developer with over 8 years of experience specialized in Azure, DataBricks, Pyspark, Python, and SQL. The candidate must demonstrate proficiency in crafting complex code, troubleshooting production issues, and exhibiting a strong aptitude for problem solving.

Key Responsibilities

• Write sophisticated, efficient code and quickly resolve any defects or issues that arise post-production.
• Engage collaboratively with stakeholders to fully grasp project requirements and independently deliver effective, robust solutions.
• Participate in technical interviews which include writing accurate, optimized code within a fixed time frame focusing on data transformation and quality, without reliance on AI tools.
• Maintain and enhance continuous integration/continuous deployment (CI-CD) pipelines integrating tools such as Jenkins and Github.
• Monitor applications using observability tools including Dynatrace to ensure high availability and performance.

Required Skills and Experience

• Comprehensive expertise in Microsoft Azure cloud services, Databricks platform, Python programming, Pyspark, SparkSQL, and SQL databases.
• Strong problem-solving abilities with a demonstrated history of debugging and resolving complex issues independently.
• Experience in managing CI-CD workflows and using tools like Jenkins and Github.
• Familiarity with application monitoring solutions such as Dynatrace.

Preferred Additional Skills

• Knowledge of Java programming, Kafka message brokers, Cassandra databases, Microservices architecture, API development.
• Experience with Apache Flink, ZeroMQ messaging library, and Protocol Buffers serialization technique.

Domain Expertise Advantageous

Hands-on experience in Retail Banking, Capital Markets, or Securities Processing domains will be considered a strong advantage.

Applicant Eligibility

This role is open to candidates holding any graduate-level degree.