Hadoop Admin

Job description

## **Key Responsibilities:** - Cluster Management - Install configure and maintain Hadoop clusters Cloudera Hortonworks or Apache Hadoop - Manage core components including HDFS YARN MapReduce - Perform cluster scaling upgrades and patching - Administration Monitoring - Monitor cluster performance health and usage - Troubleshoot and resolve cluster issues failures and bottlenecks - Implement alerting and monitoring tools Ambari Cloudera Manager Grafana - Security Governance - Configure and manage Kerberos authentication - Implement data security policies using Ranger Sentry - Handle user access controls and permissions - Data Management - Manage data storage replication and backup strategies - Optimize HDFS performance and storage utilization - Handle data ingestion and integration workflows - Performance Optimization - Tune Hadoop cluster performance memory CPU storage - Optimize YARN resource allocation and scheduling - Identify and resolve performance issues in jobs - Integration Support - Support tools in Hadoop ecosystem - Hive - Spark - HBase - Sqoop Flume Kafka - Work closely with data engineers and developers - Required Skills Qualifications - Core Technical Skills - 3 6 years of experience in Hadoop Administration - Strong knowledge of - HDFS YARN MapReduce - Hadoop ecosystem tools - Experience with Linux system administration mandatory - Big Data Ecosystem - Familiarity with - Hive Spark HBase - Kafka Sqoop Flume - Understanding of distributed computing concepts - Tools Platforms - Experience with - Cloudera Manager Ambari - Monitoring tools Nagios Prometheus Grafana - Basic scripting in Shell Python ## **Technical Requirements:** - Primary skills Technology Big Data Hadoop Hadoop Administration ## **Additional Responsibilities:** - Experience with cloud based Hadoop AWS EMR Azure HDInsight GCP Dataproc - Knowledge of DevOps practices CI CD Docker Kubernetes - Experience in high availability HA and disaster recovery DR setups ## **Preferred Skills:** Technology->Big Data - Hadoop->Hadoop Administration