Data Engineer - SAS / Databricks Migration

Assignment description

For our client we are looking for Data Engineers to migrate SAS workloads to the Databricks Lakehouse Platform.

You will translate legacy SAS data processing into PySpark and SparkR, design scalable pipelines, and optimize Delta Lake tables for performance and reliability. Collaborate with analysts and data scientists to ensure functional equivalence between SAS and Databricks implementations, implement CI/CD with Git and Azure DevOps, and validate data through automated testing and data quality checks.

Key Responsibilities

• Migrate SAS workloads to the Databricks Lakehouse Platform.
• Translate legacy SAS data processing into PySpark and SparkR
• Design scalable pipelines - Optimize Delta Lake tables for performance and reliability
• Collaborate with analysts and data scientists to ensure functional equivalence between SAS and Databricks implementations
• Implement CI/CD with Git and Azure DevOps, and validate data through automated testing and data quality checks.

Required Experience Mandatory:

• Databricks

Good experience to have:

• PySpark
• SAS, Basics
• ETL
• SQL

Language requirements:

Finnish mandatory

English Fluent

Start date: As soon as possible after candidate is chosen End date: 31.12.2029 strong possibility for extension.

Scope/hours per week: 37.5

Location: Remote candidates can work 100% remotely from home but should be based in Finland, fluent Finnish is essential for this position.