Kafka and NoSQL Database Developer

Overview

Cognizant is a leader in engineering modern enterprises, assisting clients to modernize technology, reimagine processes, and enhance experiences in a rapidly evolving environment. This role is based in Bengaluru, India and focuses on building and maintaining high-volume data streaming pipelines and distributed systems.

Key Responsibilities

• Design, develop, and implement real-time streaming pipelines using Kafka for on-premises systems supporting high volume data processing.
• Create and maintain Kafka producers and consumers to ensure fault-tolerant and high-throughput data systems.
• Build event-driven architecture based on Kafka technologies.
• Spend approximately 70% of time in designing, architecting, and coding software solutions; and 30% in mentoring, guiding, and coordinating with teams.
• Take ownership of debugging and resolving production issues related to developed code.
• Participate in technical interviews involving coding challenges in Kafka and SQL focusing on data quality and transformations within time constraints, without AI assistance.

Required Skills and Experience

• Significant experience working with Kafka and Hadoop ecosystem components including Spark, Hive, YARN, and HDFS.
• Proficiency in Scala programming language as well as Linux environments (particularly on-premise setups).
• Strong knowledge of CI/CD tools such as Jenkins and GitHub, and monitoring solutions like Dynatrace.
• Experience in scripting and ETL processes utilizing technologies such as Pandas, Pola.rs, PySpark, and Ibis.
• Hands-on experience with SQL and NoSQL databases, especially Cassandra and MongoDB.
• Understanding of core system architecture concepts including distributed systems design, data caching, replication, and data modeling.
• Excellent verbal and written communication abilities.
• Experience working in Agile methodology.
• Familiarity with cloud platforms like Microsoft Azure is advantageous.
• Knowledge of orchestration and workflow tools such as NiFi, Griffin, Hamilton, and Airflow is a plus.
• Functional domain experience in retail banking, capital markets, or securities processing will be considered beneficial.

Additional Information

Applicants must be graduates meeting the eligibility criteria, with demonstrable expertise in the listed technologies. This position demands the capacity to write optimized and correct code under time pressure as part of the interview process.