Databricks Platform Engineer/Admin
VtechsolutionsJob Description
This is a remote position.
Location: Remote – United States
Our client, a growing technology services organization supporting federal government programs, is seeking an experienced Senior Databricks Platform Engineer / Administrator to help design, deploy, govern, and support enterprise Databricks environments for a federal client.
Candidates must currently hold an ACTIVE Secret security clearance or higher. Candidates without an active Secret-level clearance cannot be considered.
The ideal candidate will bring deep hands-on experience building and administering Databricks platforms, particularly within AWS environments, with strong expertise in infrastructure automation, networking, governance, security, CI/CD, and platform operations.
Responsibilities
- Deploy and configure Databricks workspaces from the ground up using Terraform and Databricks Secure Reference Architecture across development, test, and production environments.
- Support Databricks deployments within AWS Commercial and AWS GovCloud environments.
- Design and implement supporting AWS networking architecture, including VPCs, subnets, PrivateLink, Transit Gateway, security groups, and DNS.
- Manage Databricks control-plane and data-plane connectivity.
- Administer Unity Catalog, including metastores, catalogs, schemas, external locations, permissions, grants, and row- and column-level security.
- Build and maintain CI/CD pipelines supporting infrastructure deployment and Databricks Asset Bundles.
- Establish platform governance standards, architectural guardrails, tagging strategies, naming conventions, and operating best practices.
- Automate provisioning and administration of cluster policies, secrets, service principals, SSO, and SCIM integrations.
- Monitor platform health, utilization, performance, and cost.
- Identify opportunities for rightsizing, cost optimization, and improved platform efficiency.
- Serve as an escalation point for platform incidents, troubleshooting, and root-cause analysis.
- Partner with technical and business stakeholders to provide guidance on platform architecture, governance, security, and operational decisions.
Requirements
- Active Secret security clearance or higher is required.
- U.S. citizenship required.
- 6+ years of experience engineering, administering, or supporting Databricks platforms.
- Strong hands-on experience with Databricks in AWS environments.
- Advanced Terraform experience supporting infrastructure such as networking, IAM, compute, and storage.
- Strong knowledge of Databricks Secure Reference Architecture.
- Hands-on Unity Catalog administration experience.
- Experience with Databricks Asset Bundles or comparable deployment automation frameworks.
- Strong understanding of CI/CD practices and infrastructure-as-code methodologies.
- Python proficiency.
- Linux systems administration experience.
-
Hands-on experience with AWS services including:
- VPC
- IAM
- S3
- KMS
- EC2
- CloudWatch
- VPC
- Strong troubleshooting and root-cause analysis capabilities.
- Strong communication skills with the ability to advise stakeholders on technical and platform decisions.
Preferred Qualifications
- AWS GovCloud experience.
- Experience working within regulated, security-sensitive, or compliance-heavy environments.
- Experience supporting FISMA High, FedRAMP High, or comparable federal security standards.
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.