DataOps Engineer

DataOps Engineer Purpose of the job The DataOps Engineer will play a critical role in ensuring the reliability, security and operational excellence of Collinson's modern data platform. As a key member of the Data & Analytics team, you will be responsible for automating platform operations, maintaining cloud infrastructure, supporting CI/CD pipelines and ensuring the platform remains secure, scalable and highly available. In this hands-on role, you will work closely with Data Engineers, Security, Infrastructure and Product teams to support enterprise-wide data initiatives through automation, observability and platform standardisation. Key Responsibilities · Manage and maintain Snowflake, Kafka, AWS, MongoDB and supporting data platform infrastructure. · Build and maintain CI/CD pipelines and deployment automation. · Develop and maintain Infrastructure as Code using Terraform. · Manage AWS networking including VPCs, VPC Peering, PrivateLink and secure private networking. · Work with the Central Network team to implement and support enterprise networking solutions. · Support Confluent Kafka platform operations and event-driven data integration patterns. · Perform platform patching, upgrades, and lifecycle management. · Ensure timely remediation of security vulnerabilities and compliance with security standards. · Implement monitoring, alerting and observability using Datadog and platform monitoring tools. · Support production incidents, root cause analysis, and operational improvements. · Maintain platform documentation, operational runbooks, and engineering standards. · Optimize platform performance, reliability, and cloud costs. · Support platform governance, access management, and disaster recovery activities. · Evaluate emerging technologies and recommend improvements to platform engineering practices. · Own operational excellence of the data platform. · Define and improve platform reliability standards. · Drive automation and reduce manual operational effort. · Improve developer experience for data engineering teams. · Develop and maintain operational metrics, SLAs and SLOs to improve platform reliability and availability. Knowledge, skills and experience required Mandatory Technical Skills DataOps & Platform Engineering AWS fundamentals Snowflake Administration MongoDB Confluent Kafka Platform Python SQL Git CI/CD pipelines Infrastructure as Code (Terraform) Data Observability and Monitoring (Datadog) Incident Management Production Support Security Patching Vulnerability Management Performance optimisation Cost optimisation AWS Networking VPC VPC Peering AWS PrivateLink Route 53 Security Groups IAM Private networking Central Network integration Preferred Skills AWS Transit Gateway AWS Direct Connect / VPN concepts Datadog dashboards and alerting Airflow Platform Engineering / SRE practices Nice to Have Generative AI fundamentals LLM integration patterns AI Agent frameworks Machine Learning platform awareness Real-time analytics architectures Person Specification • Self-motivator with a desire to learn new skills and embrace new technologies in a constantly changing technology landscape • Strong problem-solving and analytical skills. • Passion for automation, reliability and secure platform operations. • Self-motivated with a continuous learning mindset. • Strong stakeholder management and communication skills. • Ability to communicate technical concepts to non-technical audiences. • Collaborative team player who thrives in agile environments. • Quality-focused with strong attention to detail. • Ability to balance business priorities with technical excellence. • Proactive in identifying opportunities for improvement and innovation. • Comfortable working across global teams and multiple business domains. Division Data, BI & Analytics Locations Mumbai Remote status Hybrid Mumbai About Collinson We use our expertise and products to craft customer experiences. Our range of services helps global brand acquire, engage and retain choice-rich customers. © 2023 Collinson International Limited. Registered in England & Wales under registration No. 2577557 Registered address : 3 More London Riverside, London, SE1 2AQ, United Kingdom.