Assistant Manager - Azure Data Engineer

Role Overview

We are seeking an experienced Azure Data Engineer to join our team in Gurugram. The ideal candidate will have over 5 years of experience and hold a bachelor's degree, bringing strong expertise in designing, developing, and maintaining robust data pipelines and ETL workflows within Azure environments.

Key Responsibilities

• Design, build, and maintain efficient data pipelines and ETL processes leveraging Databricks, Azure Data Factory, and Azure SQL Database.
• Implement data orchestration and automation solutions to streamline workflows and optimize operational costs on Azure cloud infrastructure.
• Develop and integrate RESTful APIs to facilitate seamless data exchange and interoperability between systems.
• Ensure high data quality, robust security measures, and proper user access controls across platforms.
• Collaborate effectively with diverse teams to deliver scalable data solutions that support analytics and business intelligence needs.
• Apply best practices in version control and code modularization using GitHub and implement continuous integration and continuous deployment (CI/CD) pipelines.
• Monitor cloud infrastructure to improve performance and manage cost efficiency proactively.
• Create detailed technical documentation and deliver professional presentations utilizing Microsoft Excel, PowerPoint, and Word.

Required Qualifications

• Bachelor’s degree in a relevant field with 5 to 6 years of professional experience.
• Advanced proficiency in SQL and Python programming languages.
• Intermediate experience with REST API development and Azure cloud services.
• Hands-on experience with tools and technologies including Databricks, Azure Data Lake Storage (ADLS), Azure SQL, Azure Data Factory (ADF), GitHub, Visual Studio Code, and SQL Server Management Studio (SSMS).
• Strong understanding of CI/CD processes, orchestration, automation, code modularization, version control, data management, data engineering concepts, cost management, ETL frameworks, and user access management.

Preferred Skills

• Knowledge of data analytics, artificial intelligence and machine learning (AI/ML) concepts.
• Experience with visualization tools such as Tableau and Power BI.
• Familiarity with PySpark and big data processing frameworks.