Senior Data Engineer

Overview Senior Data Engineer Location: Poland remotely Employment: Permanent Role Overview: Morgan IT is responsible for running the digital transformation for Morgan, implementing a target IT architecture (consisting of several global platforms), that will underpin and future proof the technical landscape supporting Business operations stability and enabling business growth. The importance of the data as part of this journey has been recognised and is being addressed through the implementation of a Global Data Platform. We are seeking a highly skilled and experienced Microsoft Fabric and Azure Data Engineer to join our dynamic Global Data & Analytics Platform team. The ideal candidate will be responsible for designing, implementing, and optimizing scalable data solutions Microsoft Fabric. This role demands proficiency in programming, data modelling, and data pipeline orchestration, as well as expertise in Azure-specific tools and technologies. Strong soft skills are also essential to effectively manage the data engineering team, collaborate with cross-functional teams and communicate complex technical concepts to non-technical stakeholders. Responsibilities Key Responsibilities: Platform Design and Delivery - Design, build and maintain scalable ingestion and transformation pipelines across Microsoft Fabric, including Lakehouse, Warehouse, OneLake and Fabric Data Factory, alongside the existing Azure Data Factory and Synapse Analytics environment. Migration - Plan and execute the migration of existing Synapse and Azure Data Factory workloads onto Fabric, including dedicated SQL pool warehouses, Synapse Spark workloads and ADF pipelines, minimising disruption to live reporting and analytics services. Data Modelling - and Performance Develop and maintain dimensional and medallion-layer data models to meet business reporting requirements, and optimise queries, workloads and semantic models — including Power BI Direct Lake models — to meet agreed performance standards. AI - and Advanced Analytics Enablement Develop and maintain the interfaces through which the Company's AI tooling accesses governed enterprise data, including Model Context Protocol (MCP) servers and equivalent integrations. Ensure that access control, lineage and cost governance are maintained where automated systems rather than individuals are the consumers of data. Software Engineering - Practice Write and maintain production-grade Python, PySpark and SQL. Apply source control, automated testing, monitoring and CI/CD practices to all data assets, using Azure DevOps or GitHub Actions and infrastructure-as-code tooling. Data Governance and Security - Implement data governance controls including lineage, cataloguing, classification and access management, using Microsoft Purview and Microsoft Entra ID, ensuring compliance with applicable regulatory and internal requirements. Capacity and Cost Management - Size, monitor and optimise Fabric capacity consumption, managing the balance between workload performance and platform cost, and reporting on utilisation to the Global Data Platform Owner. Documentation - Maintain accurate documentation of architecture decisions, data models, pipeline specifications and operational runbooks to a standard that supports continuity of service within the team. Team Leadership - Act as line manager to junior data engineers, providing technical guidance, mentoring and performance management. Define and enforce best practice for pipeline design, development and maintenance. Act as the point of escalation for complex data engineering issues, and coordinate with the solution architect to ensure the platform meets current and future requirements. Qualifications Requirements: Minimum six years' experience in data engineering, with substantial exposure to Azure cloud services Demonstrable hands-on experience delivering production workloads on Microsoft Fabric, including Lakehouse, Warehouse, OneLake and Fabric Data Factory Proven experience migrating Azure Synapse and Azure Data Factory workloads onto Microsoft Fabric within a live environment Strong programming capability in Python and SQL, applied to production systems Practical experience with Apache Spark and PySpark at scale Working knowledge of Azure Synapse Analytics, including dedicated and serverless SQL pools and Spark pools Experience of dimensional modelling and lakehouse architecture Experience applying source control and CI/CD practices to data engineering deliverables Experience mentoring or line-managing engineers Ability to communicate technical concepts clearly to non-technical stakeholders across operational and commercial functions Professional working proficiency in English Desirable Experience with Model Context Protocol, agent tooling, retrieval-augmented generation pipelines or vector stores Experience with dbt or comparable transformation-as-code tooling Experience with Terraform or Bicep Experience with Microsoft Purview or comparable data governance tooling Experience of manufacturing, engineering or industrial data sources, including IoT, MES and ERP systems Relevant Microsoft certification (DP-203, DP-600 or Fabric equivalents) Scala Degree in computer science, information technology, engineering or a related discipline, or equivalent professional experience Morgan Advanced Materials is an EEO/AA/M/W/D/V Employer Ind-1 Morgan Advanced Materials is a business rich in history and innovation. Founded in the UK in 1856, we have grown into a global organisation with 70 sites in 18 countries. Our model to serve our customers where they need us has led to a diversified product range using our unparalleled expertise in ceramic and carbon materials, which we exploit to solve difficult problems for our customers across a diverse range of markets. We are a purpose driven organisation. Our purpose is to use advanced materials to make the world more sustainable and to improve the quality of life. We deliver on that purpose through the products that we make, and the way that we make them. We help our customers push the limits of their processes and products to meet the demanding requirements they face, from higher process temperatures to higher product performance to increasing miniaturisation. Key Figures: Revenue £1,100.7m (2024), ~8,000 employees, manufacturing in 20+ countries, and a global customer portfolio. A UK PLC with head office located in Windsor, Berkshire UK. Listed on London Stock Exchange; Member of the FTSE 250 Index.