Data Engineer

Data Engineer The Data Engineer is responsible for building and maintaining scalable, reliable, and high-quality data pipelines and infrastructure that power data products and analytics across the organisation. The role focuses on ensuring data is accurate, timely, and consistently processed, particularly in environments involving high-volume transactional and API-driven systems. Key Responsibilities 1. Data Pipeline Development Design, build, and maintain ETL/ELT pipelines Ingest data from internal systems and external APIs Develop scalable data processing workflows (batch and/or real-time) Ensure pipelines are reusable, efficient, and maintainable 2. Data Integration Integrate data from various sources, including transactional flows Handle complex data scenarios such as: Event sequencing (e.g. bet → resolve) Idempotency and duplicate handling Partial or delayed data Ensure consistency between source systems and analytical datasets 3. Data Transformation & Modelling Support Implement transformation logic aligned with architectural data models Build and maintain structured data layers for analytics consumption Collaborate closely with the Data Architect on model implementation 4. Data Quality, Monitoring & Reliability Implement data validation, monitoring, and alerting mechanisms Identify and resolve data inconsistencies or failures Ensure high levels of data accuracy and availability 5. Performance & Scalability Optimise pipelines for performance and cost-efficiency Support scaling of data infrastructure as volumes grow Ensure low-latency data availability where required 6. Collaboration Work closely with Data Architect, Analysts, and Manager Support Analysts by ensuring availability of curated datasets Contribute to continuous improvement of data platform capabilities Required Skills & Experience 3–7+ years experience in data engineering, backend engineering, or similar roles Strong programming skills (e.g. Python, SQL) Solid understanding of ETL/ELT processes and data pipeline design Experience working with APIs and integrating distributed systems Experience handling transactional or event-based data Strong understanding of: Data transformation techniques Data warehousing concepts Data modelling fundamentals Experience with data orchestration and workflow tools Ability to build robust, fault-tolerant systems Strong problem-solving skills with attention to detail and data accuracy Nice to Have Experience in iGaming, fintech, or high-volume transactional environments Experience with event streaming technologies (e.g. Kafka) Familiarity with modern data stack tools (e.g. Snowflake, BigQuery, dbt, Airflow) Experience with real-time or near real-time data processing Understanding of idempotent processing and event ordering Exposure to CI/CD and infrastructure-as-code practices Experience supporting analytics or BI teams Success Metrics Reliability and uptime of data pipelines Data freshness and latency Reduction in data errors and inconsistencies Performance and scalability of data processing Availability of high-quality, curated datasets for analysts What’s in it for you? Experience a dynamic and team-orientated work environment. Opportunities for personal growth and learning An open, inclusive and supportive team where you will be valued, and your suggestions will be welcome. 26 days paid holiday per year. This is in addition to local bank holidays. Competitive salary €400 annual wellness Allowance Hybrid Working Risk Benefits such as pension, Life Assurance (4x annual salary), Private Medical Insurance Team Building Opportunities Flexible core hours between 10am – 4pm Receive support whenever you need it with our Employee Assistance Program, available 24/7. Local discounts and more. Department Platform Integrations and Data Role Data and Insights Locations Hammersmith Remote status Hybrid Language requirement English