Senior Data Engineer (Candidates Based in the Netherlands)
- Hiring from
- Netherlands
- Work type
- Hybrid
- Posted
621,007 remote jobs, straight from company career pages
100% free · New jobs every minute
Show job descriptionHide job description
Key Responsibilities
-
Design, build, and maintain scalable real-time data pipelines and event streaming solutions using Apache Kafka, Apache Spark, and GCP.
-
Develop event refinement, transformation, and event combination solutions to support multiple operational business use cases.
-
Build and optimize streaming applications using Java and/or Scala, with a focus on Apache Spark Structured Streaming.
-
Contribute to the modernization of legacy SQL/SSRS reporting systems, migrating operational reporting to a modern real-time data platform.
-
Develop and enhance real-time monitoring and reporting solutions, taking projects from Proof of Concept (PoC) to production-ready MVP.
-
Design scalable data architectures and ensure reliable integration between streaming platforms, NoSQL databases, and cloud services.
-
Develop clean, maintainable, well-tested, and documented code following strong engineering practices.
-
Collaborate with engineering teams and business stakeholders, independently taking ownership of technical solutions in a complex enterprise environment.
Requirements
-
Medior/Senior-level Data Engineering experience, with a strong focus on real-time data processing and event-driven architectures.
-
Strong programming skills in Java and/or Scala.
-
Hands-on production experience with Apache Spark, particularly Structured Streaming.
-
Strong experience with Apache Kafka, including topics, producers, consumers, and streaming pipelines.
-
Hands-on experience with Google Cloud Platform (GCP).
-
Experience working with NoSQL databases.
-
Strong understanding of real-time data processing, event transformation, data integration, and scalable data architectures.
-
Experience developing reliable, production-grade data pipelines with appropriate testing, monitoring, and documentation.
-
Ability to work independently, solve complex technical challenges, and take end-to-end ownership of solutions.
-
Strong communication skills and the ability to collaborate with technical and business stakeholders, even with limited business support.
