DE

Manager | Databricks + Pyspark | Mumbai | Engineering | Data Modernization & Migration

Hiring from
India
Work type
Hybrid
Posted
Is this job info correct?

605,368 remote jobs, straight from company career pages

100% free · New jobs every hour

Show job description

Role Overview: As a Manager, you will lead the technical strategy and delivery of Databricks-centric data platforms. You will bridge the gap between business requirements and technical architecture, ensuring that the Databricks ecosystem is scalable, cost-effective (FinOps), and perfectly integrated into the broader Azure data landscape.


Experience:

  • 7–10 years of experience in data engineering, with significant experience architecting solutions on Azure Databricks.
  • Expertise in designing end-to-end Data Lakehouse architectures.
  • Proven experience in Databricks FinOps (managing DBU consumption and cluster policies).
  • Strong leadership experience in managing technical teams and project lifecycles.

Key Responsibilities: Technical Skills:


  • Architect large-scale, enterprise-grade data platforms using the Databricks Data Intelligence Platform.
  • Define and enforce technical standards for data modeling, Spark optimization, and coding patterns.
  • Drive Databricks FinOps initiatives by designing efficient cluster policies and optimizing resource utilization.
  • Lead the integration of Databricks with Azure Synapse, Power BI, and advanced Machine Learning workflows.
  • Oversee the implementation of enterprise-wide data governance and security frameworks.
  • Manage technical project delivery, ensuring alignment with business timelines and quality standards.

Soft Skills:

  • Strong leadership, mentorship, and people management abilities.
  • Strategic thinking and ability to translate business needs into technical roadmaps.
  • Excellent stakeholder management and communication skills.

Preferred Qualifications:


  • Bachelor’s or Master’s degree in Computer Science or related field.
  • Databricks Solutions Architect or Azure Solutions Architect certifications.

Job Details:

  • Location: Mumbai (Hybrid)

Similar jobs