Hadoop Administrator

Job Summary

  • Manage the Cloudera Hadoop distribution on AWS Linux instances, including configuration, capacity planning, expansion, performance tuning and monitoring
  • Work with data engineering team to support development and deployment of Spark and Hadoop jobs
  • Work with end users to troubleshoot and resolve incidents with data accessibility
  • Contribute to the architecture design of the cluster to support growing demands and requirements
  • Contribute to planning and implementation of software and hardware upgrades
  • Recommend and implement standards and best practices related to cluster administration
  • Research and recommend automated approaches to cluster administration

 

Requirements

  • Cloudera Hadoop Admin Certification
  • 5+ years’ experience with administering Linux production environment
  • 3+ years’ experience managing full stack Hadoop distribution (preferably Cloudera). Including monitoring
  • 3+ years’ experience with implementing and managing Hadoop related security in Linux environments (Kerberos, SSL…)
  • Strong knowledge of Yarn configuration in a multi-tenancy environment. Candidate should have experience with Yarn capacity scheduler.
  • Strong working knowledge of disaster recovery related to Hadoop platforms
  • Working knowledge of automation tools
  • 3+ years administration experience with Kafka, HBase, Spark, Hive and Cloudera Manager.
  • Strong written and verbal communication skills
  • Excellent analytical and problem-solving skills

 

Job Features

Job CategoryDevelopment
SkillsKafka, HBase, Spark, Hive, Cloudera Manager
Experience5+ Years

Apply For This Position

A valid email address is required.
A valid phone number is required.