Senior / Lead Data Engineer – Real-Time Streaming (Flink · Kafka · AWS)

Senior / Lead Data Engineer – Real-Time Streaming (Flink · Kafka · AWS) | Porto, Hybrid

Do you like building data products that run in real time and in production?

We are looking for Data Engineers to join a Group Data Platform team at an international client in the financial sector, in Porto. You will build streaming data products end to end: ingestion, stream processing, APIs, monitoring and production support.

Two levels are open:

• Senior Data Engineer (7+ years): you design, build and run real-time pipelines, and support less experienced engineers.
• Tech Lead Data Engineer (10+ years): you also lead architecture decisions, technical reviews, engineering standards and mentoring.

What you will do

• Build real-time and batch pipelines with Apache Flink and Apache Kafka
• Develop event-driven microservices, REST APIs and OpenAPI specifications for data consumers
• Work with AWS: MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS/EKS, S3, IAM
• Put in place data quality, schema management, validation and automated tests
• Set up CI/CD (GitLab CI, GitHub Actions) and observability (CloudWatch, Prometheus, Grafana, OpenTelemetry)
• Support production: incidents, performance and root-cause analysis
• Write technical designs, API documentation and runbooks, and review your peers’ work

What we are looking for

• Proven experience delivering real-time data products in production
• Strong hands-on experience with Apache Flink and Apache Kafka
• Production experience with AWS data and application services
• Good knowledge of APIs, microservices, event-driven systems and schema management
• Experience with CI/CD, testing, observability and cloud security
• Fluent English (international technical and business teams)

Porto, hybrid (3 days per week on site)

Interested? Apply here or send us a message. We read every application.