Cloudera Administrator / Big Data Administrator

About the role

An experienced Cloudera Administrator is sought to manage, configure and support enterprise-grade Cloudera Hadoop environments. The role focuses on cluster stability, performance, security and availability.

Key responsibilities

• Install, configure and maintain Cloudera Data Platform (CDP) or Cloudera Distribution of Hadoop (CDH) clusters in production and non-production environments.
• Monitor cluster health, performance and resource utilization to ensure high availability and reliability.
• Administer Hadoop ecosystem components including HDFS, YARN, Hive, Impala, Spark, HBase, Kafka, Oozie, ZooKeeper, Ranger and Atlas.
• Perform cluster upgrades, patching and migrations while minimizing downtime.
• Implement security controls with Kerberos, Apache Ranger and LDAP/Active Directory integration, and manage user access, roles and permissions.
• Automate routine tasks with Python, Shell scripting or Ansible.
• Troubleshoot cluster issues, performance bottlenecks and job failures, and support backup and disaster recovery planning.
• Collaborate with Data Engineers, Developers and Architects to optimize data pipelines, and prepare reports on utilization, job performance and capacity planning.

Required profile

• Bachelor's degree in Computer Science, Information Technology or a related field, or equivalent experience.
• 4+ years of hands-on experience administering Cloudera/Hadoop ecosystems.
• Strong Linux/Unix system administration and Shell scripting skills.
• Knowledge of Hadoop security (Kerberos, Ranger, LDAP/Active Directory).
• Experience with cluster upgrades, patching, troubleshooting and performance optimization.
• Understanding of backup, disaster recovery and capacity planning.

Required skills

• Cloudera CDP/CDH cluster administration, configuration and monitoring
• HDFS, YARN, Hive, Spark, Impala, Kafka, HBase
• Ansible, Python, Shell scripting