Senior Data Engineer (remote EU only) — Azure Databricks + dbt

We are looking for a Senior Data Engineer to join a long-term project with a Danish client in the pharmaceutical/biotech domain.

📍 Location: Remote, but EU residency is mandatory (we cannot consider candidates outside the European Union).

🗣 Language: English B2+

What you'll do:

• Build and maintain multi-layer pipelines (Landing → Raw → Enriched → Curated) on Azure Databricks (Spark, Delta Lake).
• Orchestrate pipelines via Databricks Jobs/Workflows: dependencies, retries, alerting.
• Implement batch and API-based data ingestion.
• Apply schema enforcement and handle schema drift; run data quality checks at ingestion.
• Work hands-on with dbt for pipeline observability and data governance.
• Monitor job failures, data freshness, and pipeline health against SLA targets.
• Set up alerts, logging, and retry strategies for production pipelines.
• Work within a controlled Dev/Test/Prod environment: access control, audit trails, pipeline documentation, traceability to requirements.
• Contribute to CI/CD and MLOps/AI pipelines on Databricks.

Must-haves:

• Strong hands-on experience with Azure Databricks: Spark, Delta Lake.
• Multi-layer pipelines: Landing → Raw → Enriched → Curated.
• Schema enforcement and schema-drift handling.
• Data quality checks at ingestion.
• Orchestration via Databricks Jobs/Workflows: dependencies, retries, alerts.
• Batch and API-based data ingestion.
• Strong hands-on experience with dbt.
• Monitoring job failures, data freshness, and pipeline health.
• SLA-based data delivery.
• Alerts, logging, and retry strategies.
• Access control models, audit trails, lineage, traceability.
• Data contracts, pipeline documentation, controlled environments (Dev/Test/Prod).
• EU residency.
• English B2.

Nice-to-have:

• CI/CD & DevOps for Data (Git-based development, CI/CD pipelines for data workflows).
• AI/MLOps — MLOps/AI pipelines on Databricks.
• Exposure to regulatory domains (GxP, clinical trials, pharmacovigilance).
• Strong SQL engineering / modular, reusable dbt models.
• Dimensional modeling: star schema, OBT, curated marts.
• Tabular Editor, Power BI.
• Pharma/biotech industry experience.

Candidate’s Portrait:

This is a senior, independent role: the ideal candidate is comfortable taking ownership with minimal oversight and has a flexible, self-driven mindset.

🌍 Joining Valletta Software Development means:

A Global, Thriving Team

Join remotely 100+ specialists from 20+ countries, united by a passion for outstanding IT solutions.

Diverse projects: Fintech, MedTech, AI/ML, e-commerce, and more. Switch teams or industries to broaden your skills.

Support at Every Step Client interview prep: We train you to succeed + give actionable feedback.

Strategic stability: Well-structured processes, strong management, and long- term vision.

Core values: Honesty, flexibility, innovation, and a people-first approach.

Regular salary.