Senior Cloudera Administrator
DataDoersJob Title: Senior Cloudera Administrator
Experience: 5+ Years
Location: Lahore, Pakistan (Hybrid) / Remote (Pakistan)
We are looking for a Senior Cloudera Administrator with 5+ years of experience to manage, scale, and secure our enterprise big data infrastructure. In this role, you will be responsible for the end-to-end administration of Cloudera Data Platform (CDP) and legacy CDH/HDP clusters across both on-premises data centers and cloud environments (AWS, Azure, or GCP).
You will work closely with Data Engineering, DevOps, and Infrastructure teams to ensure high availability, optimal performance, robust cluster security, and seamless cloud integration.
Key Responsibilities- Cluster Management & Operations:
- Design, deploy, configure, and maintain enterprise Cloudera clusters (CDP Private Cloud / Public Cloud / CDH).
- Manage multi-tenant cluster resources using Cloudera Manager, YARN, and Dynamic Resource Pools.
- Oversee cluster lifecycle operations, including major/minor upgrades, patching, node scaling, and migrations.
- Security, Governance & Access Control:
- Implement and maintain cluster security using Kerberos, SSL/TLS, Apache Ranger, and Knox.
- Integrate cluster authentication with enterprise Active Directory / LDAP.
- Define and manage data governance, lineage, and auditing policies via Apache Atlas.
- Cloud Architecture & Integration:
- Manage hybrid big data architectures spanning on-premises data centers and public cloud platforms (AWS, Azure, or GCP).
- Configure and maintain object storage connectors (AWS S3, Azure ADLS Gen2, or GCP GCS) with Cloudera environments.
- Support workload shifts and cloud migration initiatives.
- Performance Tuning, Monitoring & Maintenance:
- Monitor cluster health, daemon services (HDFS, YARN, Hive, Impala, HBase, ZooKeeper), and system metrics using Cloudera Manager and third-party tools (Prometheus, Grafana, Datadog).
- Conduct root cause analysis (RCA) for cluster outages, resource bottlenecks, and job failures.
- Manage backup, disaster recovery (DR), and data replication strategies across sites/regions.
- Experience: 5+ years in Big Data / Hadoop Infrastructure Administration.
- Cloudera Expertise: In-depth knowledge of Cloudera Data Platform (CDP) or CDH/HDP, Cloudera Manager, and underlying service architecture.
- Cloud Platforms: Hands-on experience administering big data services on at least one cloud provider (AWS, Azure, or GCP).
- Linux & Scripting: Strong background in Linux system administration, bash scripting, and Python automation.
- Ecosystem Components: Deep operational understanding of HDFS, YARN, Hive, Impala, HBase, Kafka, Ranger, and Kerberos.
- Networking & Security: Solid foundation in network topology, firewalls, load balancing, and security protocols.
- Cloudera Certified Associate / Administrator (CCA / CCP).
- Experience with Infrastructure as Code (Terraform, Ansible).
- Containerization experience (Docker, Kubernetes / OpenShift).