Data Engineer Databricks

Data Engineer - Azure Databricks



Build the future of data

Data is the foundation of better insights and smarter business decisions. An international organisation within the healthcare sector is investing in a modern data platform that will support its future analytics, reporting and data-driven decision-making.

To support this transformation, we are looking for a Data Engineer who enjoys taking ownership, solving complex data challenges and building scalable, reliable data solutions.

In this role, you will play a key part in the further development of an Azure Databricks environment. You will work closely with the Belgian Data Analyst, international data teams and business stakeholders, with the autonomy to make technical decisions and continuously improve the platform.

Your role

As a Data Engineer, you will contribute to the development, maintenance and optimisation of the data platform. You will combine hands-on engineering with technical problem-solving, while helping shape the future of the organisation's data architecture.

Your responsibilities will include:

• Developing, maintaining and optimising scalable data pipelines within Azure Databricks.

• Integrating data from various sources, including databases, APIs and files.

• Building and maintaining the Bronze, Silver and Gold layers within a Lakehouse architecture.

• Supporting the migration from legacy infrastructure to a modern data platform.

• Ensuring data quality, reliability and performance while troubleshooting technical issues.

• Optimising data processing and cloud costs, with a focus on scalability and maintainability.

• Delivering reliable datasets for reporting, Power BI and self-service analytics.

• Implementing best practices around automation, documentation, data governance and deployment.

• Identifying opportunities to improve processes and explore AI capabilities within the data environment.

Beyond day-to-day development, you will have the opportunity to think strategically about how the data platform can become more efficient, robust and future-proof.

Your profile

We are looking for an independent and curious Data Engineer who enjoys taking ownership and feels comfortable working in an environment that is still evolving.

You will ideally bring the following experience and skills:

• Relevant experience as a Data Engineer or Analytics Engineer.

• Experience with Azure Databricks or a comparable modern cloud-based data environment.

• Strong SQL skills and experience with Python and/or PySpark.

• Experience developing and maintaining ETL/ELT processes and data pipelines.

• A solid understanding of data integration and transforming raw data into reliable, usable datasets.

• Knowledge of modern data architectures, such as the medallion and Lakehouse architectures.

• Strong analytical and problem-solving skills, with the ability to investigate and resolve technical issues independently.

• Excellent communication skills in English. Knowledge of Dutch is a plus.

• A proactive mindset, a sense of ownership and a continuous improvement mentality.

Experience that will set you apart: familiarity with Azure Data Factory, Delta Lake, Git, Azure DevOps, Power BI or Databricks AI capabilities. An interest in AI and its applications within data engineering is also an advantage.

What you can expect

• Technical ownership: Take an active role in shaping the future of the organisation's data platform.

• An exciting transformation journey: Contribute to the migration from legacy infrastructure to a modern Azure Databricks environment.

• International collaboration: Work closely with colleagues and data teams in Belgium and across the wider organisation.

• Autonomy and impact: Have the freedom to develop technical solutions independently and drive meaningful improvements.

• A hybrid working environment: Work from the Gent area, with flexibility to work from home in agreement with the team. Ideally, you will be in the office two to three days per week.

• An international environment with local impact: Join an organisation that combines international expertise with a strong presence in the Belgian market.

The employment package will be tailored to your experience and expertise.

Interested?

Would you like to help build a future-ready data platform and put your technical expertise to work in an organisation that is investing heavily in data?

Get in touch with Visser & Van Baars to explore whether this opportunity is the right next step for you.