Azure Databricks Developer - Data Engineering with ADF, PySpark, Scala

About Tata Consultancy Services (TCS)

TCS is a global leader in IT and business solutions, employing over 612,000 professionals worldwide across 55 countries. In the fiscal year 2023-24, the company reported revenues of USD 29.08 billion. Its service offerings span Cloud Infrastructure, Cognitive Business Operations, Cybersecurity, Consulting, Enterprise Solutions, IoT/Digital Engineering, and Data & Analytics. Recognized as one of India's largest equal opportunity employers, TCS boasts over 100,000 women employees and is consistently ranked among India's Most Respected Companies.

Job Overview

We seek an experienced Azure Databricks Developer based in Chennai with 7-12 years of expertise in Data Engineering and cloud data platforms. The ideal candidate will specialize in Azure Databricks, Azure Data Factory (ADF), PySpark, and Scala, with proven skills in developing scalable, high-performance data solutions on Microsoft Azure.

Key Responsibilities

• Design and implement robust data pipelines using Azure Databricks and Azure Data Factory (ADF).
• Develop scalable ETL/ELT solutions to handle extensive data processing workloads.
• Create data transformation and analytics workflows leveraging PySpark and Scala.
• Work extensively with Azure Data Lake Storage and cloud-native data architectures.
• Optimize Spark jobs and Databricks workloads to enhance performance and cost-effectiveness.
• Integrate data streams from various enterprise systems and external sources.
• Collaborate with business units, architects, and analytics teams to deliver actionable data solutions.
• Provide support for production deployment, monitoring, and troubleshooting of data pipelines.

Required Technical Skills

• Proficiency in Azure Databricks and Azure Data Factory (ADF).
• Strong coding skills in PySpark and Scala.
• Experience managing data on Azure Data Lake Storage (ADLS).
• Solid knowledge of SQL and data engineering principles, including data modeling and ETL/ELT development.

Preferred Skills

• Familiarity with Azure Synapse Analytics and Delta Lake.
• Experience with Azure DevOps, CI/CD pipelines, and Spark performance tuning.
• Sound understanding of data warehousing concepts.

Candidate Eligibility

• 7 to 12 years of professional experience in IT.
• Hands-on expertise with Azure Databricks, ADF, PySpark, and Scala technologies.
• Proven track record of designing and deploying enterprise-scale data platforms.
• Good grasp of Azure cloud services and big data ecosystems.
• Strong analytical and troubleshooting capabilities.
• Must be able to attend walk-in interview in Chennai on Saturday, 18th July.

Walk-In Interview Details

Date: Saturday, 18th July
Location:
Tata Consultancy Services (TCS)
Chennai One IT SEZ, Pallavaram-Thoraipakkam 200 Feet Road
Thoraipakkam, Chennai - 600097