Data Engineer – Azure & Databricks
- Hiring from
- Belgium
- Work type
- Hybrid
- Posted
625,904 remote jobs, straight from company career pages
100% free · New jobs every minute
Show job descriptionHide job description
Our client, a leading organization in the energy sector, is seeking a professional to drive data-driven decision-making through advanced platform engineering. This role involves developing robust data pipelines and storage structures while contributing to a modern data ecosystem organized around agile principles.
Responsibilities
Responsibilities
- Develop and maintain scalable data pipelines and efficient storage structures using diverse analytical technologies.
- Create powerful materialized views and data exchange endpoints for business users.
- Collaborate with product teams to integrate governance aspects such as data lineage, quality, and modeling.
- Optimize data storage and exchange processes to improve service quality for end-users.
- Mentor and coach team members as a technical reference within the agile data organization.
- Engage in transversal initiatives to maximize data coherence and reuse across the enterprise.
- 5+ years of experience in data engineering with Microsoft Azure data services and data platform technologies.
- 5+ years with Databricks, PySpark, Delta Lake, and medallion architecture patterns.
- Expertise in Azure SQL and SQL performance tuning including execution plans, indexing, and advanced T-SQL.
- 1+ years of experience leading, mentoring, or coaching data engineers within a team environment.
- You possess experience with Azure Data Factory for orchestration and data pipeline development.
- You bring practical knowledge of Parquet files and lakehouse-style data storage.
- You have experience with version control, CI/CD, automated deployment, and monitoring practices.
- You're a proactive team player with an analytical approach to problem-solving and a product-oriented mindset.
- You are fluent in English.
- Experience with Unity Catalog and data governance in Databricks.
- Knowledge of Kafka or event-driven data ingestion patterns.
- Experience with Azure cost optimization, cluster optimization, and FinOps practices.
- Familiarity with Azure DevOps, infrastructure-as-code, and platform automation.
- Proficiency in German.
- Start date: ASAP
- Work regime: Full-time
- Location: Brussels
- Working model: Hybrid (2 days per week onsite)
- Contract: open to both permanent employees and freelancers