Azure Databricks / Python-PySpark Engineer

Contract: 12 months (subject to extension).

Location: Amsterdam, Netherlands.

Salary: Not a constraint for the right candidate!

Experience: 8-10 years.

Hybrid: 2 days Work from Home 3 days Work from Office

Your Profile & DNA:

We are looking for an experienced Azure Databricks / Python-PySpark Engineer to join our team in Amsterdam.

This role is ideal for a hands-on engineer with deep practical expertise in Azure Databricks, Python, and PySpark, who enjoys building reliable, scalable, and maintainable data processing solutions.

Roles & Responsibilities

• Design, develop, and maintain robust data processing solutions using Azure Databricks, Python, PySpark, and SQL.
• Build and manage both batch and streaming data processing pipelines within Databricks.
• Design appropriate and scalable data models for processing and consumption within the Databricks environment.
• Manage multiple parallel data processing workloads operating on shared source data.
• Ensure data processing solutions are reliable, performant, maintainable, and scalable.
• Analyze technical challenges and implement pragmatic solutions based on business and technical requirements.
• Monitor, troubleshoot, and optimize Databricks workloads and data processing processes.
• Contribute to improving the overall stability, quality, and maintainability of the data platform.
• Work with Azure cloud services and implement deployment processes using YAML-based CI/CD pipelines.
• Contribute to Infrastructure as Code (IaC) using ARM/Bicep.
• Identify and address technical debt proactively.
• Collaborate closely with other engineers, architects, and stakeholders in an Agile environment.
• Continuously improve development practices, processes, performance, and solution quality.

Qualification & Experience

• A Bachelor's or Master's Degree or equivalent.
• Strong hands-on experience with Azure Databricks
• Deep expertise in Python, PySpark, and SQL
• Proven experience with batch and streaming data processing
• Experience designing and managing data processing solutions in Databricks
• Experience managing multiple parallel processes using shared source data
• Strong Azure experience
• Experience with YAML-based CI/CD pipelines
• Experience with Infrastructure as Code (ARM/Bicep)
• Experience working in an Agile environment

Nice to Have

• Broader understanding of end-to-end data solutions
• Experience with complex data architectures
• Data processing performance optimization

What do we offer?

If your profile matches the job requirement and you are interested to be presented to our clients, then please apply and don’t forget to attach your updated CV in line with the JD!

This position is for 1 year with possibility of extension. We offer competitive Gross Salary in line with the market standard.

Besides that, we offer following benefits, such as:

• 20 days of holiday per year
• Encourage Personal Development - Certification (Certification Charges reimbursed)
• Income Tax Return Filing
• We provide Visa Sponsorship for Candidate & Dependants
• Possibility of bonus

Who we are:

A2G Consulting also known as "A2G Technologies" is one of the fastest growing staffing companies in North Brabant region, Netherlands. We cater to Asia and Europe market focusing on high tech & non-high-tech clientele; headquartered in Eindhoven, Netherlands with a branch office in India (Bangalore & Pune) & Dubai. We successfully find a candidate and ensure that they get opportunities in line with their aspirations. We offer visa sponsorship for local & international candidates for career-enhancing opportunities. We strongly believe in equal opportunities and hence have a pool of resources with diversified ethnicity.

You will be deployed and work at one of our client sites.