AWS Spark Scala Data Engineer

Role overview

This position is for an AWS Spark Scala Data Engineer with Tata Consultancy Services in Pune. The role centers on creating and supporting data engineering solutions on AWS, with a strong focus on Spark, Scala, SQL, and scalable pipeline design.

What you will do

• Create, enhance, and support scalable data pipelines using Apache Spark with Scala.
• Develop and fine-tune ETL and ELT workflows in the AWS environment.
• Handle both structured and unstructured datasets at scale.
• Build data solutions using AWS tools such as S3, EMR, Glue, Redshift, Athena, and Lambda.
• Apply best practices for data security, governance, and compliance.

Technical skills and experience needed

• Strong knowledge of AWS-based data engineering.
• Practical experience with Spark and Scala.
• Working exposure to AWS cloud services including S3, EMR, Glue, Redshift, Athena, and similar tools.
• Good understanding of distributed computing concepts.
• Strong SQL skills.
• Experience with data pipeline orchestration tools such as Airflow and Step Functions.

Eligibility

Any graduate can apply.

Additional information

Company: Tata Consultancy Services Ltd.

Location: Pune, India.