Lead Data Engineer (10+ years with MS Fabric, Azure, ADF, Data Platforms only)
- Hiring from
- India
- Work type
- Hybrid
- Posted
617,947 remote jobs, straight from company career pages
100% free · New jobs every minute
Show job descriptionHide job description
Job Summary
We are looking for a Lead Data Engineer to help shape and grow our next-generation data engineering capability.
This is a hands-on technical leadership role for an experienced engineer who can set technical direction, establish engineering standards, mentor and elevate other engineers, and build enterprise-scale data solutions.
You will help design and evolve a modern, scalable, cloud-based data platform that may span technologies such as Microsoft Fabric, Databricks, Snowflake, and cloud-native services. Rather than being tied to a single technology stack, we are looking for someone who understands modern data architecture principles and can make thoughtful technology choices based on business, data, scalability, interoperability, and operational needs.
Just as importantly, we are looking for an AI-first engineering leader who can help the team rethink how we design, build, test, operate, and continuously improve data products using AI.
Key Responsibilities
Lead Engineering Excellence
- Provide hands-on technical leadership for a growing team of data engineers.
- Set engineering standards and reusable patterns across architecture, coding, testing, data modeling, documentation, observability, security, and deployment.
- Lead architecture discussions, technical design reviews, and code reviews.
- Mentor engineers and develop technical depth, ownership, problem-solving, and engineering judgment across the team.
- Translate complex initiatives into clear technical approaches and guide teams from design through production.
- Foster a culture of ownership, collaboration, curiosity, experimentation, continuous learning, and accountability.
Build & Evolve a Modern Data Platform
- Lead the architecture and engineering of scalable, secure, and governed enterprise data platforms.
- Design solutions across lakehouse, data warehouse, data lake, streaming, and data-product architectures based on the needs of the use case.
- Build batch, incremental, near-real-time, and event-driven data processing solutions.
- Create reusable engineering frameworks for ingestion, transformation, orchestration, data quality, metadata, and data delivery.
- Design scalable data models supporting operational, analytical, reporting, and AI use cases.
- Establish patterns that promote interoperability and reduce unnecessary platform and vendor dependencies.
- Evaluate technology choices based on performance, scalability, reliability, security, cost, maintainability, and business value.
- Remain hands-on and contribute directly to engineering solutions when needed.
Champion AI-First Engineering
- Champion the use of AI across the engineering lifecycle, including requirements, architecture, development, testing, documentation, troubleshooting, and operations.
- Establish responsible practices for reviewing, validating, securing, and governing AI-generated engineering artifacts.
- Promote spec-driven development, using well-defined requirements, data contracts, acceptance criteria, and automated tests.
- Design data platforms and products that are ready to support AI agents, RAG, semantic models, machine learning, and conversational analytics.
- Evaluate emerging AI and data technologies through focused experimentation and translate successful approaches into reusable engineering patterns.
- Help engineers use AI to increase productivity and innovation without compromising security, quality, or engineering accountability.
Build Reliable & Trusted Data Products
- Establish automated data quality, reconciliation, validation, and testing practices.
- Build observability across data pipelines, datasets, APIs, and platform services.
- Define operational expectations and reliability measures for critical data products.
- Lead root-cause analysis for significant issues and ensure corrective actions address systemic problems.
- Continuously improve platform reliability, resilience, performance, and operational efficiency.
- Treat data as a product with clear ownership, quality expectations, documentation, and consumer needs.
Design Enterprise Integration & Data Access
- Design secure, scalable integration patterns across enterprise applications, data platforms, and external data sources.
- Develop and guide the implementation of REST and GraphQL APIs.
- Design event-driven and serverless integration solutions.
- Establish standards for API lifecycle management, authentication, versioning, monitoring, and governance.
- Enable data access through appropriate patterns including APIs, data sharing, event streams, and governed analytical interfaces.
- Apply modern identity and access patterns such as OAuth 2.0, OpenID Connect, JWT, managed identities, service principals, or equivalent approaches.
Embed Governance, Security & Compliance
- Build data governance, lineage, metadata, data quality, security, privacy, and auditability into platform designs.
- Ensure engineering solutions align with applicable governance, risk, security, and compliance requirements.
- Apply appropriate engineering rigor to KYC, UCC, public-record, and other regulated or sensitive data domains.
- Partner with architecture, cybersecurity, governance, and compliance teams to address risks early in the engineering lifecycle.
- Maintain clear architectural decisions, data contracts, lineage, transformation logic, and operational documentation.
Partner & Influence Across the Organization
- Partner with product, architecture, analytics, AI, operations, and business teams to translate business opportunities into scalable technical solutions.
- Communicate architectural decisions, tradeoffs, risks, dependencies, and opportunities clearly to technical and non-technical audiences.
- Influence technical direction through expertise and collaboration rather than authority alone.
- Balance strategic platform modernization with near-term product and operational needs.
- Help establish a strong engineering community where ideas, patterns, and lessons are shared across teams.
Required Qualifications
· Bachelor’s degree in Computer Science, Engineering, Information Systems, or related discipline, or equivalent practical experience.
· 10+ years of experience in data engineering, software engineering, data platforms, or related disciplines.
· Demonstrated experience providing technical leadership, mentoring engineers, and leading complex initiatives from architecture through production.
· Strong understanding of modern data platform and distributed data architecture principles.
· Advanced SQL skills and strong expertise in data modeling, database design, and performance optimization.
· Deep hands-on experience designing and building scalable ETL/ELT pipelines and reusable data engineering frameworks.
· Significant experience with one or more modern cloud data platforms, such as Databricks, Microsoft Fabric, Snowflake, or comparable platforms.
· Strong programming experience using Python, PySpark, Scala, Java, C#, or comparable languages.
· Experience with cloud architecture and services across Azure, AWS, GCP, or comparable cloud environments.
· Experience with APIs, distributed processing, event-driven architectures, and modern integration patterns.
· Experience with automated testing, CI/CD, source control, observability, and modern DevOps practices.
· Understanding of data governance, lineage, security, identity, and data quality practices.
· Practical experience incorporating AI-assisted tools into engineering workflows.
· Strong communication, technical judgment, problem-solving, and stakeholder-influence skills.
Preferred Qualifications
· Experience architecting solutions that span or integrate multiple data platforms or cloud technologies.
· Experience with lakehouse architectures, Apache Spark, Delta Lake, Apache Iceberg, or other open data technologies.
· Experience designing data products and applying data-as-a-product principles.
· Experience with interoperable data-sharing patterns and open data architectures.
· Experience building governed APIs or external data-delivery capabilities.
· Experience supporting AI-oriented data architectures including semantic models, RAG, data agents, machine learning, or conversational analytics.
· Experience with streaming and messaging technologies such as Kafka or comparable cloud-native services.
· Experience with API management and enterprise integration architecture.
· Familiarity with Infrastructure as Code and cloud automation.
· Experience working with sensitive or highly governed data in financial services, legal, compliance, or regulatory environments.
· Familiarity with KYC, UCC, public-record, GRC, or SOC 2 concepts.
· Experience leading data platform modernization or migration initiatives.
Key Skills
Modern Data Platforms | Data Lakehouse & Warehousing | Databricks | Microsoft Fabric | Snowflake | Cloud Data Services | SQL | Python / PySpark | Apache Spark | Delta Lake / Apache Iceberg | Data Modeling | ETL/ELT | Data Products | REST & GraphQL APIs | Event-Driven Architecture | Data Quality & Observability | Data Governance & Lineage | CI/CD & DevOps | AI-Assisted Engineering | AI Agents & RAG
Our Interview Practices
To maintain a fair and genuine hiring process, we kindly ask that all candidates participate in interviews without the assistance of AI tools or external prompts. Our interview process is designed to assess your individual skills, experiences, and communication style. We value authenticity and want to ensure we’re getting to know you—not a digital assistant. To help maintain this integrity, we ask to remove virtual backgrounds and include in-person interviews in our hiring process. Please note that use of AI-generated responses or third-party support during interviews will be grounds for disqualification from the recruitment process.
Applicants may be required to appear onsite at a Wolters Kluwer office as part of the recruitment process.
Be the Difference
If making a difference matters to you, then you matter to us.
Join us, at Wolters Kluwer, and be part of a dynamic global technology company that makes a difference every day.
We’re innovators with impact. We provide expert software and information solutions that the world’s leading professionals rely on, in the moments that matter most. You’ll make a real difference in the lives of millions of people. Together with our customers, we help to advance sustainability, health, justice, prosperity, and commerce around the world.
You can thrive at Wolters Kluwer, where diversity is core to our collective strength and high performance. Be your unique self, share your creative ideas, do your best work, and take time to grow in our caring and inclusive culture where you can belong.
About Wolters Kluwer
Wolters Kluwer reported 2025 annual revenues of €6.1 billion. The group serves customers in over 180 countries, maintains operations in over 40 countries, and employs more than 21,000 people worldwide.
Our customers work in industries that impact the lives of millions of people every single day. Our mission is to empower our professional customers with the AI-powered solutions they need to make critical decisions, achieve successful outcomes, and increase productivity.
We deliver trusted, AI-powered expert solutions that combine deep domain knowledge, proprietary content, and advanced technology to provide expert-validated insights, automate workflows, and drive better outcomes. Today, nearly 70% of our digital revenues come from AI-powered solutions, reflecting our strategic focus on embedding AI into professional workflows and delivering measurable productivity gains.
We are committed to helping professionals navigate complexity, improve the way they work, and solve critical challenges through cloud-based, AI-powered platforms that integrate seamlessly into their workflows and ecosystems. Our solutions are designed to deliver impact when it matters most, especially in high-stakes environments where accuracy and trust are essential.
With a nearly 190-year legacy, Wolters Kluwer continues to evolve its portfolio of digital solutions and services to meet the changing needs of professionals worldwide, enabling them to work faster, make smarter decisions, and deliver better outcomes.
For more information about our solutions and organization, visit www.wolterskluwer.com, or follow us on LinkedIn, Instagram and Facebook.
Tips & Tricks - Resumes
Wolters Kluwer has a dedicated team of experienced talent acquisition professionals who are ready to hear what makes you tick and share how Wolters Kluwer can help you achieve your goals and ambitions. Here Rasi Fawaz shares some tips on what recruiters are looking for on a resume.
Building Diverse Teams
As a global organization, we recognize that solving a wide range of complex problems requires diverse perspectives and innovative thinking. We know that bringing our best to our customers, communities, and other key stakeholders requires a highly engaged and talented workforce – one that represents the diversity of those we serve and the communities where we live and work.
We aim to provide a welcoming environment and equitable opportunities for all employees regardless of background, nationality, race, ethnicity, gender, gender identity, age, sexual orientation, marital status, disability, or religion.
This principle is ingrained in our company values and articulated in our Code of Business Ethics.
Our Global Well-being Program
At Wolters Kluwer, you’ll feel valued for your contributions, and you’ll know that your health, safety, and well-being are important to us. Our well-being benefits provide tools, programs, and resources to help our diverse employees feel healthy, happy, safe, and prosperous.
Our global Together we thrive well-being program reflects our commitment to supporting colleagues across physical, mental, social, and financial well-being. That commitment has been recognized externally through Ragan’s Top Places to Work for Employee Wellbeing: Large Organization in 2024.
More recently, Wolters Kluwer was recognized by Forbes as one of America’s Best Large Employers 2026 and America’s Best Employers for Engineers 2026. In 2025, Wolters Kluwer was also recognized by Forbes as one of America’s Best Employers for Women.
Equal Opportunity Employer
To ensure we continue to drive innovation that enables us to develop products and services to best serve our customers, we cultivate a workplace culture rooted in mutual respect, bringing forward insights from a wide range of backgrounds, perspectives, and experiences. We are also committed to complying with laws requiring equal opportunity in hiring, promotion, and other employment decisions.
All qualified applicants will receive consideration without regard to race, color, religion, sex (including pregnancy, gender identity, transgender status, and sexual orientation), national origin, disability, age, genetic information, veteran status, or any other characteristic protected by applicable law, and we do not tolerate discrimination on any of these bases.
Careers Privacy and Cookies
Wolters Kluwer (“we” or “us”) wants to inform you about the ways we process your personal information. In this Privacy & Cookie Notice we explain what personal information we collect, use and disclose. You'll find details related to GDPR and other data privacy policies on our Careers Privacy and Cookies page.
