Azure Data Engineer - Databricks and PySpark | Walk-In Drive at TCS Chennai

About Tata Consultancy Services (TCS)

TCS is a global leader in IT and business solutions with over 612,000 employees worldwide, operating in 55 countries and generating revenues of USD 29.08 billion in 2023-24. The company provides a wide range of services, including Cloud Infrastructure, Cognitive Business Operations, Cybersecurity, Consulting, Enterprise Solutions, IoT/Digital Engineering, and Data Analytics. TCS is recognized as one of India's largest equal opportunity employers, with a workforce comprising over 100,000 women, and consistently ranks among the most respected companies in the country.

Position Overview

We are hiring experienced Azure Data Engineers with 7-12 years of expertise in technologies such as Databricks, PySpark, Python, PL/SQL, and Azure Data Factory (ADF). The role requires building scalable end-to-end data pipelines, developing data transformation workflows, and delivering cloud-based data solutions to enable enterprise analytics and enhance business intelligence capabilities.

Key Responsibilities

• Architect, develop, and maintain comprehensive data pipelines utilizing Microsoft Azure technologies.
• Design and optimize ETL/ELT processes leveraging Azure Data Factory (ADF).
• Create large-scale data transformation workflows using Databricks and PySpark.
• Integrate diverse data sources into unified enterprise data platforms.
• Develop and optimize complex SQL and PL/SQL code including queries, procedures, and packages.
• Conduct data quality checks, cleansing operations, and automate processes.
• Collaborate effectively with business stakeholders, data architects, and analytics teams.
• Monitor system performance and troubleshoot issues in data pipelines.
• Ensure adherence to data security best practices, governance, and compliance standards.
• Support initiatives related to cloud migration and modernization of data infrastructure.

Mandatory Skills

• Proficient in Azure Databricks and PySpark development.
• Hands-on experience with Azure Data Factory (ADF) for pipeline development.
• Strong programming skills in Python and PL/SQL.
• Expertise in SQL and data warehousing concepts.
• Solid understanding of ETL/ELT development and Azure Cloud platform capabilities.
• Familiarity with Git or equivalent version control systems.

Preferred Skills

• Knowledge of Azure Synapse Analytics and Delta Lake technologies.
• Experience with Azure Data Lake Storage (ADLS) and Power BI.
• Understanding of Azure DevOps and CI/CD pipeline configurations.
• Skills in Spark optimization and data modeling techniques.

Candidate Profile

• 7 to 12 years of hands-on experience in Data Engineering and Integration projects.
• Demonstrated expertise in Databricks and PySpark for big data processing.
• Experience managing Azure Data Factory pipelines and cloud native data architectures.
• Strong SQL/PLSQL programming capabilities with agile project experience.
• Excellent analytical thinking, problem-solving aptitude, and communication skills.

Walk-In Details

Eligible and interested candidates should attend the walk-in interview scheduled for Saturday, 18th July at Tata Consultancy Services, Chennai One IT SEZ, Pallavaram-Thoraipakkam 200 Feet Road, Thoraipakkam, Chennai - 600097.

Eligibility

Applicants must hold a graduate degree to be considered for this role.