Data Platform Engineer
- Hiring from
- Probably Worldwide
- Work type
- Remote
- Posted
604,743 remote jobs, straight from company career pages
100% free · New jobs every minute
Show job descriptionHide job description
Job Description
This is a remote position.
We are looking for a Data Platform Engineer to join our team which grew out of a traditional DBA team, has evolved from database administration to engineering modern data platforms. We manage over 400 data platforms and services, from databases and data streaming to stateful workloads on Kubernetes and managed services (DBaaS), increasingly delivered through automation, infrastructure as code, and self-service.
Responsibilities:
· Collaborate closely with internal and external stakeholders, developers, and managers to ensure timely deliverables.
· Design, deploy, and operate data platforms, including real-time streaming and processing (Kafka, Flink, Debezium/CDC), on Kubernetes and as managed services.
· Operate and evolve cloud-native data services, from databases on Kubernetes using operators (e.g. CloudNativePG for PostgreSQL) to managed data platforms (DBaaS), evaluating and prototyping new technologies and providers while ensuring security and compliance.
· Apply DevOps and SRE principles with a strong focus on automation and scalability, managing infrastructure as version-controlled, reviewed, and tested code (Terraform/Terragrunt, Ansible, GitLab CI/CD, Argo CD, Vault, Python, Bash).
· Build reusable modules, automation, and golden paths that let development teams provision and consume data services through self-service.
· Reduce manual processes, operational toil, and technical debt, and contribute to migration and modernisation of remaining legacy data systems.
· Design for resilience, high availability, and fault tolerance, including backup, recovery, and failover strategies.
· Monitor and improve reliability and performance using observability tooling (Prometheus, Grafana). Analyse, troubleshoot, and resolve complex incidents, and address root causes to prevent recurrence.
· Analyse resource usage, growth patterns, and capacity, and promote cost efficiency and FinOps principles across data platforms.
Participate in the 24/7 rotational hotline to maintain system resilience
Requirements
Must have:
• Proven experience operating production databases (e.g. PostgreSQL, MongoDB, Valkey): replication, high availability, backup and recovery, and upgrades.
· Hands-on experience with data streaming and real-time processing technologies (e.g. Kafka, Flink).
· Solid experience applying DevOps principles in production, including CI/CD, automation (Python, Bash, or similar), and Infrastructure as Code (e.g. Terraform, Terragrunt, and Ansible).
· Strong SQL skills and experience with database performance tuning (queries, indexing, engine configuration).
· Operational experience with public cloud, preferably Azure.
Working knowledge of Kubernetes and containers.
· Strong autonomy and critical thinking skills, with a sense of ownership, a continuous-improvement mindset, and the ability to work in cross-functional teams.
· Excellent communication skills (written, listening, and speaking), a collaborative mindset, and a proactive attitude.
Nice-to-have:
· Strong Kubernetes/AKS knowledge, particularly with stateful or data-intensive workloads and database operators (e.g. CloudNativePG), including storage and autoscaling.
· Good Linux administration and troubleshooting.
· Experience with managed data services (DBaaS), e.g. managed PostgreSQL, Kafka, or MongoDB offerings.
· Experience with CDC (e.g. Debezium).
· Proficiency with GitLab CI/CD and GitOps.
If this sounds like you, share your CV with us and let’s talk!
