Data Engineering Principal Lead

Ciklum is looking for a Data Engineering Principal Lead to join our team full-time in India.

We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

About the role:

As a Data Engineering Principal Lead, become a part of a cross-functional development team engineering experiences of tomorrow to lead technical execution oversight, squad coordination, onboarding standardization, and scalable operationalization for a large-scale Microsoft Fabric enterprise data acquisition program. The role will focus on accelerating onboarding of enterprise data into Microsoft Fabric Bronze and Silver layers through reusable ingestion frameworks, scalable onboarding patterns, and architect-led squad execution.

You will work closely with the Business stakeholders, Delivery Managers, MS Fabric Data Engineers, Data Modelers and Governance teams to establish scalable data architecture, maintain best practices and be the technical owner for enterprise level data product delivery.

This role is execution-oriented and requires strong hands-on technical leadership across Microsoft Fabric, Lakehouse architectures, enterprise ingestion frameworks, operationalization patterns, and distributed squad coordination.

Responsibilities:

• Technical Delivery & Squad Coordination
  • Orchestrate technical execution across enterprise onboarding squads, overseeing ERP systems and platform integration into Microsoft Fabric
  • Standardize delivery across Bronze and Silver layers using reusable ingestion frameworks and metadata standards
  • Manage technical risk with Delivery Managers to resolve blockers, track timelines, and mentor Data Engineering teams
• Microsoft Fabric Solution Architecture
  • Design end-to-end solutions in Fabric (Lakehouse, Warehouse, OneLake) utilizing Medallion Architecture principles
  • Engineer scalable patterns for master data and pipeline orchestration to support downstream analytics and AI enablement
  • Govern architecture standards with Enterprise Architects to ensure scalability and alignment with organizational controls
• Engineering Standards & Operationalization
  • Enforce rigorous practices for pipeline standards, coding, lineage tracking, and refresh orchestration
  • Enhance platform reliability via monitoring and observability frameworks while partnering with QA to ensure high data quality
  • Drive synergy through architecture reviews and planning with stakeholders, Data Modelers, and Governance teams

Requirements:

• Experience: 10–15 years total; 5+ years in Data Engineering, Cloud Platforms, or Architecture
• Technical Expertise
  • Enterprise Data Engineering: Delivering large-scale platforms using MS Fabric and Lakehouse architectures
  • Data Architecture: Expert in Medallion Architecture and scalable ingestion frameworks
  • Governance & Controls: Mastery of metadata, lineage, and enterprise-grade governance
  • Leadership: Managing distributed/offshore squads with a focus on execution and troubleshooting
• Technical Stack
  • Platforms: MS Fabric (OneLake, Lakehouse, Warehouse), Synapse, Snowflake, Databricks
  • Tools: Fabric Pipelines, Data Factory, PySpark, dbt, Delta Lake
  • Ops: Microsoft Purview, Metadata frameworks, CI/CD, and DataOps
  • Analytics: Power BI Semantic Enablement
• KPIs
  • Onboarding: Integrating enterprise datasets into Fabric; reducing cycle times
  • Reliability: Ensuring pipeline stability and operational excellence
  • Standardization: Enforcing metadata compliance and Silver-layer readiness
  • Efficiency: Maximizing technical output and framework reuse across squads
• Education: BE in CS or IT

What’s in it for you?

• Strong community: Work alongside top professionals in a friendly, open-door environment
• Growth focus: Take on large-scale projects with a global impact and expand your expertise
• Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications
• Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies
• Care: We’ve got you covered with company-paid medical insurance, mental health support, and financial & legal consultations

About us:

At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress.

India is a strategic innovation hub for Ciklum, with growing teams in Chennai and Pune leading advancements in EdgeTech, AR/VR, IoT, and beyond. Join us to collaborate on game-changing solutions and take your career to the next level.

Explore, empower, engineer with Ciklum!

Interested already? We would love to get to know you! Submit your application. We can’t wait to see you at Ciklum.