T
AWS Data Engineer
Kolkata, West Bengal, India · Jornada completa
Sé el primero en postularte
- Experiencia
- Más de 6 años
- Salario
- —
- Vacantes
- 1
- Al corriente
- Hace 6 horas
- Modo de trabajo
- En la oficina
- Educación
- Cualquier graduado
- Elegibilidad
- Graduates from any discipline can apply.
- Reanudar
- Se requiere solicitud
Dónde trabajarás
Descripción del trabajo
Overview
Tata Consultancy Services Ltd. is seeking an experienced Data Engineer for locations in Pune, Bengaluru, NCR, Kolkata, and Hyderabad. This role requires over 6 years of professional experience and strong expertise in AWS ecosystem, Python programming, PySpark, and Databricks platforms to develop scalable data processing systems.
Key Duties
- Create and maintain ETL/ELT data pipelines using AWS technologies including Lambda, Step Functions, Glue, and S3 alongside Python scripting.
- Develop and optimize data transformation workflows leveraging PySpark and Databricks.
- Design and implement complex data transformation engines to handle large datasets efficiently.
- Manage PostgreSQL and MongoDB databases ensuring performance and reliability.
- Collaborate with software engineering teams and other stakeholders to align on data solution design.
- Participate actively in code reviews, technical discussions, and planning sessions.
- Drive automation efforts supporting continuous integration and deployment processes.
- Create and maintain technical documentation and follow industry best practices for software development.
Mandatory Expertise
- Advanced programming skills in Python.
- Good command over AWS services such as Lambda, Step Functions, Glue, S3.
- Experience in PySpark and Databricks for data processing.
- Proficient with SQL, PostgreSQL, and MongoDB databases.
- Hands-on development of ETL/ELT pipelines with large-scale data.
- Data modeling and transformation to support analytics and reporting.
Preferred Skills
- Experience with AWS Glue.
- Understanding of CI/CD and DevOps methodologies.
- Knowledge of data quality and monitoring frameworks.
- Version control using Git.
Educational Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or related fields; however, equivalent experience is also considered.
Certifications
- Optional but preferred AWS certifications including AWS Certified Cloud Practitioner, Developer Associate, and Data Engineer Associate.