Senior Data Engineer
Noida, Uttar Pradesh, India · ಪೂರ್ಣ ಸಮಯ
ಅರ್ಜಿ ಸಲ್ಲಿಸುವವರಲ್ಲಿ ಮೊದಲಿಗರಾಗಿರಿ
- ಅನುಭವ
- 4+ ವರ್ಷಗಳು
- ಸಂಬಳ
- INR 2,500,000 – INR 3,500,000 / year
- ತೆರೆಯುವಿಕೆಗಳು
- 1
- ಪೋಸ್ಟ್ ಮಾಡಲಾಗಿದೆ
- 9 ಗಂಟೆಗಳ ಹಿಂದೆ
- ಕೆಲಸದ ಮೋಡ್
- ಕಚೇರಿಯಲ್ಲಿ
- ವಿದ್ಯಾಭ್ಯಾಸ
- ಕಂಪ್ಯೂಟರ್ ಸೈನ್ಸ್ ಎಂಜಿನಿಯರಿಂಗ್
- ಅರ್ಹತೆ
- Applicants must have a minimum of four years of professional experience and hold a degree in Computer Science Engineering.
- ಪುನರಾರಂಭ
- ಅರ್ಜಿ ಸಲ್ಲಿಸಲು ಕಡ್ಡಾಯ
ನೀವು ಎಲ್ಲಿ ಕೆಲಸ ಮಾಡುತ್ತೀರಿ
ಕೆಲಸದ ವಿವರ
About the Role
We are recruiting for a forward-thinking technology firm focused on creating sovereign, secure, and scalable digital platforms spanning AI, Web3.0, cloud computing, and health-tech sectors. The role is for an experienced Senior Data Engineer responsible for constructing and managing scalable data pipelines, lake house architectures, and analytics frameworks using advanced open-source technologies to drive data-centric insights and GenAI-enhanced analytics.
Key Responsibilities
- Design, develop and maintain robust data pipelines utilizing Airbyte from diverse data sources.
- Configure connectors for various databases including PostgreSQL, MySQL, MongoDB; also integrate APIs and SaaS applications.
- Implement Change Data Capture (CDC) for real-time data replication, including Kafka streaming techniques.
- Create and maintain incremental and full data synchronization strategies ensuring rigorous data validation and quality assurance.
- Build and manage Airflow Directed Acyclic Graphs (DAGs) to orchestrate ETL workflows incorporating error handling, retry mechanisms, and monitoring.
- Schedule complex multi-stage data pipeline executions and connect workflows with databases, APIs, and external platforms.
- Architect and optimize ClickHouse OLAP database schemas, author advanced SQL queries with a focus on performance tuning.
- Develop materialized views, aggregations, data partitioning policies, and retention schemes for efficient data warehousing.
- Create dedicated data marts targeted for analytics applications.
- Implement lake house architecture on object storage solutions (Cloudian), including data partitioning by date and region, leveraging Parquet/ORC file formats.
- Administer access control policies and data governance standards.
- Facilitate BI and dashboarding support utilizing Apache Superset and Power BI tools.
Eligibility Criteria
- Applicants must possess a minimum of four years professional experience.
- Candidates should have educational credentials in Computer Science Engineering or related disciplines.
Salary and Benefits
The compensation package ranges between ₹2,500,000 and ₹3,500,000 per annum. The position includes a formal job offer and an immediate start date.
Additional Information
The role is based full-time on site at Noida, Uttar Pradesh, India.