Senior Databricks Data Engineer

Senior Databricks Data Engineer / DWH Developer

Location: Hybrid
Workload: 100% / Full-Time
Languages: English

Position Summary

We are seeking a Senior Databricks Data Engineer / DWH Developer for a 1-year engagement. In this role, you will design, build, and optimize enterprise-scale data pipelines and data warehousing solutions leveraging modern cloud technologies and Delta Lake.
You will work closely with cross-functional data teams to transform complex data streams into reliable, high-performance analytical assets for business decision-making.

Key Responsibilities & Deliverables

• ETL Pipeline Development: Architect and maintain robust, scalable ETL/ELT pipelines for batch and real-time processing using PySpark or Scala.
  
• Lakehouse Implementation: Design and optimize data storage and processing frameworks utilizing Databricks and Delta Lake architectures.
  
• Data Warehousing & Modeling: Build production-grade data models (star schema, snowflake, Data Vault) and optimize query performance across analytical platforms.
  
• Cloud Infrastructure Integration: Deploy and manage data solutions natively within a cloud environment (AWS, Azure, or GCP).
  
• Performance Tuning & Monitoring: Monitor pipeline stability, optimize Spark job performance, reduce compute costs, and resolve data quality issues.
  

Qualifications & Skills

Required

• Databricks Expertise: Strong practical experience developing production data solutions on the Databricks platform.
  
• Programming Languages: Proficiency in PySpark and/or Scala, alongside strong advanced SQL skills.
  
• Data Lake & Storage: Deep understanding of Delta Lake transaction layer and storage optimizations (ACID transactions, time travel, Z-Ordering).
  
• Core Engineering: Proven background in traditional and modern Data Warehousing (DWH) and end-to-end ETL/ELT development.
  
• Cloud Platforms: Solid working knowledge of cloud-native data architectures (Azure Data Factory/ADLS, AWS Glue/S3, or GCP equivalents).
  

Preferred / Nice-to-Have

• Experience with CI/CD for Databricks (Databricks Asset Bundles, Terraform, GitHub Actions).
  
• Exposure to workflow orchestration tools (Airflow, Azure Data Factory, Databricks Workflows).
  
• Relevant Databricks or Cloud certifications (e.g., Databricks Certified Data Engineer Professional).