Senior Data Engineer

Department: Product Development Location: Ireland (Dublin) Employment Type: Full-Time, Permanent Reports to: VP of Engineering Work Model: Hybrid, 3 days per week in the Dublin office Senior Data Engineers own the department's data integration and analytics platform, modelling data with SQL Transformation Layer on Amazon Redshift, curating the QuickSight / SPICE presentation layer, and integrating external sources such as Salesforce into the central data warehouse. They also make the warehouse and its semantic layer AI-ready, well-modelled, documented and governed so GenAI tooling (e.g. natural-language-to-SQL on AWS Bedrock) and downstream AI features can consume trusted data safely. Key Objective / Role Lead the design and delivery of data-enablement solutions on the AWS ecosystem, liaising with internal and external stakeholders to define and ship high-quality data pipelines that power our reporting and analytical capabilities. Own the Redshift warehouse, the RapidRatings ELT service and orchestration, the QuickSight semantic and reporting layer, observability and production data quality on business-critical marts, increasingly designing data products that power AI-native and internal GenAI tooling, in line with our AI-Driven Development Lifecycle (AI-DLC) delivery model. Key Working Relationships Product, Business and Operations stakeholders, requirements, data-quality reporting and sign-off. Platform & Application engineering squads, AI / ML and platform initiatives such as Bedrock / GenAI tooling, semantic-layer definition and AI data-governance. QA and external data providers for integration and end-to-end testing of data deliverables. Essential Duties and Responsibilities Design & operate the data warehouse and ELT : build, run and operate the AWS data warehouse and analytics environment; develop and maintain our SQL Transformation Layer on models across staging → intermediate → mart layers (incremental models, tests, auto-generated docs); integrate new external sources in and move curated data out to applications and affiliates, using GenAI to accelerate model/test generation under human review and CI guardrails. Run the AWS analytics stack : operate Glue Data Catalog, S3 / Athena, Redshift and the QuickSight / SPICE presentation layer; build reports and visualisations; and manage performance and cost through retention / cold-archiving policies and query-performance tuning. Orchestrate & observe pipelines : schedule, orchestrate and monitor batch / ELT jobs; manage job dependencies, failures and end-to-end pipeline observability. Own production data quality : monitor and remediate mart-refresh and reconciliation defects on business-critical marts, and report data-quality status to product and business. Apply governance, privacy & security controls : implement best-in-class security alongside PII anonymisation, right-to-erasure (member deletion / archival), dashboard-export restrictions and QuickSight group / permission management (RBAC). Build the semantic / metrics layer : maintain the semantic layer and curated, documented datasets that serve as trusted context for GenAI tooling and downstream AI features. Deliver AI-native data capabilities : deliver and operate natural-language-to-SQL / analytics-assistant capabilities on AWS Bedrock (RAG over warehouse metadata and lineage) with evaluation, guardrails, monitoring and cost controls (accuracy, hallucination and PII / data-leakage safeguards); and prepare feature-ready datasets and embeddings / vector stores that keep outputs explainable and auditable. Mentor & collaborate : help engineers across the department troubleshoot SQL, Python and AI, acting as a strong technical collaborator who raises the team's overall data-engineering capability. Key Competencies SQL, data modelling & data warehousing : deep SQL and dimensional / data-warehousing expertise, with proven ETL/DWH delivery of end-to-end data integration for large-scale warehouses. SQL Transformation & modern ELT modelling : hands-on SQL and modern ELT / warehouse modelling (dimensional and medallion-style layering). AWS data stack : strong across Glue, S3, Athena, Redshift / PostgreSQL and QuickSight. Orchestration, observability & data quality : pipeline orchestration, scheduling and observability, with ownership of production data quality, defect resolution and the maintenance of systems, processes, code and pipelines across varied sources and types. Data management & quality frameworks : Data Quality Profiling, Metadata Management, Master Data Management and cleansing / standardising, with strong general data-manipulation skills (clean, transform, recode, merge and reshape). Data visualisation : experience with visualisation tools (QuickSight, Power BI, Yellowfin), including advanced data visualisation and mapping. Data governance, PII & RBAC : governance, PII handling and role-based access control in a regulated member-data environment. GenAI / LLM for analytics : working knowledge of GenAI / LLM services (e.g. AWS Bedrock), prompt engineering, RAG and vector / embedding stores, and how to structure semantic / metrics layers so AI can query data reliably. About RapidRatings RapidRatings is a leading fintech company providing enterprises with the financial health intelligence they need to manage supplier risk, protect working capital, and build more resilient supply chains. We serve global organisations across manufacturing, consumer goods, financial services, and infrastructure. We're growing fast. Our Values Integrity, Innovation, Accountability, Resilience, Community Some of our Benefits: Health insurance via RapidRatings with a generous allowance. Workplace pension with matched contributions up to 5%. 25 days of paid time off (PTO) RapidRatings International Inc. (“RapidRatings”) is proud to be an equal opportunities employer. We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We may access publicly available information as part of RapidRatings review of your application. This online application feature is hosted in the United States by RapidRatings, Inc., and we may process your application and information relating to you in the United States, Ireland and other RapidRatings locations, as we deem appropriate under the circumstances. If you are interested in this role, please submit your CV in English. We will carefully consider your application during the initial screening and will make decisions based on your experiences and skills. We will contact you if your qualifications meet our requirements and you are selected to continue for the next stage of the recruitment process. If you have a disability and need an adjustment during the application and hiring process, including support for the interview or onboarding process, please let us know on your CV. Protecting your privacy and the security of your data is a top priority for RapidRatings. Please consult our Privacy Notice (https:// https://www.rapidratings.com/privacy-policy ) to know more about how we collect, use and transfer the personal data of our candidates.