Azure Data Engineer

About the Role

We are seeking an experienced Azure Data Engineer with over 5 years of professional experience. This position is based in Mumbai, with additional opportunities available in Bangalore, Chennai, Hyderabad, and Gurugram. The role involves working extensively with Microsoft Azure data services and related technologies.

Key Responsibilities

• Offer expert knowledge on Azure Databricks (ADB) and Azure Data Factory (ADF) for solution architecture and implementation.
• Develop, test, and review code to continuously enhance the data platform.
• Ensure compliance with established architectural guidelines.
• Construct and sustain infrastructure components for data products, including pipelines, storage, and processing systems.
• Maintain high standards for scalability, reliability, and performance of data infrastructure while optimizing resource use and minimizing downtime.
• Partner with Data Architects and Domain Data Stewards to architect and realize data solutions that fulfill business needs and adhere to Data Mesh principles.

Technical Requirements

• Strong expertise in Azure Databricks, Azure Data Factory, Python, PySpark, SQL, ETL processes, and Continuous Integration/Continuous Deployment (CI/CD).
• Proven experience implementing projects on Azure platforms.
• Familiarity with Azure data assets such as Azure SQL Database, Azure SQL Data Warehouse, and Synapse Analytics.
• Experience with data ingestion, curation, and transformations utilizing Spark technologies.

Additional Skills

• Excellent communication skills, both verbal and written.
• Ability to work autonomously as well as collaboratively in team settings.

Eligibility

Applicants must hold a degree in any field.