HYBRID - Atlanta GA
Only W2 - No Corp to Corp
Open to Sponsorship
Required Skills & Experience
- 8+ years of experience in Data Engineering / Big Data.
- 5+ years of hands-on experience with Databricks.
- Strong experience with Apache Spark / PySpark.
- Strong programming skills in Python and SQL.
- Extensive experience with Delta Lake and Databricks Workflows/Jobs.
- Strong understanding of data lake and lakehouse architectures.
- Hands-on experience with Azure, AWS, or GCP.
- Strong DevOps experience with CI/CD pipelines and automation.
- Experience with Azure DevOps, GitHub, GitLab, or Jenkins.
- Experience with Terraform or Infrastructure as Code.
- Strong experience with Git and source-code management.
- Experience deploying Databricks solutions across multiple environments.
- Strong understanding of ETL/ELT concepts and data integration.
- Experience with performance tuning and optimization of Spark/Databricks workloads.
Preferred Skills
- Experience with Azure Data Factory (ADF) or similar orchestration tools.
- Experience with Kafka or other streaming technologies.
- Experience with Unity Catalog and Databricks security/governance.
- Experience with REST APIs and Databricks APIs.
- Knowledge of Docker and Kubernetes.
- Experience with automated testing and code-quality tools.
- Databricks or cloud certifications are a plus.