Big Data Administrator

Role Overview

We are seeking a seasoned Big Data Administrator to join our team, bringing extensive experience in big data and data platform engineering within enterprise settings. The ideal candidate will possess in-depth technical know-how across several pivotal technologies essential for managing and scaling large data ecosystems.

Key Responsibilities and Skills

• Manage and operate the Hadoop ecosystem, including HDFS, YARN, Spark, MapReduce, and HBase to ensure robust platform performance.
• Utilize Apache Kafka efficiently in environments requiring high throughput to support real-time data streaming and processing.
• Implement and maintain search and analytics systems using OpenSearch or Elasticsearch.
• Leverage AWS EMR along with comprehensive knowledge of AWS cloud services to optimize big data workflows.
• Administer Linux systems adeptly, employing scripting capabilities in Shell and Python to automate operational tasks.
• Handle security protocols involving Kerberos, data security practices, and access control governance to protect sensitive datasets.
• Demonstrate experience managing systems characterized by high data volumes and low latency, ideally in sectors like payments or trading.