- Experience
- 10+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 2 weeks ago
- Work mode
- In office
- Education
- Bachelor’s degree in Computer Science or related field
- Resume
- Required to apply
Job description
Overview
We are seeking a highly experienced Hadoop Architect with over 12 years of expertise in data engineering roles, primarily focusing on Cloudera Data Platform technologies. This position is based in Chennai and requires immediate joining.
Key Responsibilities and Skills
- Hands-on expertise with Cloudera Data Platform suite (version 7.1 and later), including CDP, CDE, CDW, Ozone, Airflow, and SDX.
- Proficient in PySpark and SQL for creating and optimizing complex data pipelines and querying distributed datasets efficiently.
- Strong knowledge of distributed data systems, Hive Metastore, and data governance frameworks like Apache Ranger.
- Experience handling file formats including Iceberg and Parquet, as well as implementing effective partitioning and bucketing strategies.
- Understanding of financial data structures, accounting operations, and compliance with regulatory standards.
Qualifications
- Bachelor’s degree in Computer Science, Data Engineering, or a related discipline.
- Extensive experience (over a decade) in data engineering or similar fields.
- Preferred expertise in modernizing enterprise finance systems within regulated sectors.
- Awareness of Open Data Contract Standard (ODCS) and its practical application.
- Familiar with continuous integration and delivery (CI/CD) tools and processes relevant to data engineering workflows.
- Exposure to cloud platforms such as AWS or Azure for data engineering tasks.
Additional Information
The role demands immediate availability with a preference for candidates currently able to join without delay. The position is located in Chennai, India.