Data Engineer

Contract Senior Data Engineer

6-week contract | Remote | Outside IR35 | Active SC required | Immediate start

I’m supporting a client looking for a hands-on Senior Data Engineer to join a high-impact programme building a secure, AI-ready data platform.

You’ll design and deliver production-grade data pipelines across batch and real-time workloads, helping create a trusted knowledge layer that supports AI applications and autonomous agents.

What you’ll be doing

• Building scalable distributed data pipelines
• Developing batch and streaming ingestion processes
• Creating robust data models for structured and unstructured data
• Implementing data lineage, provenance and metadata management
• Supporting knowledge graphs, entity resolution and data fusion
• Integrating data platforms with AI and agent-based applications
• Deploying services in secure cloud and containerised environments

What they’re looking for

• Strong Python
• Spark / PySpark
• Kafka, Flink, Iceberg and Trino
• Data modelling, lineage and provenance
• Knowledge graphs and entity resolution
• AWS or Azure
• Docker and Kubernetes
• Experience with geospatial or time-series data
• Experience delivering in secure environments
• Active SC clearance
• Available to start immediately