99brightminds logo

Azure Data Platform Engineer

Hiring from
Egypt, Jordan
Work type
Remote
Posted

618,065 remote jobs, straight from company career pages

100% free · New jobs every minute

Show job description

We are hiring an Azure Data Platform Engineer to administer, secure and automate Azure data platforms. You will keep services such as Data Factory, Synapse, Databricks, Cosmos DB and Event Hub stable, secure and performant across Development, Test, Pre-production and Production environments, with a strong focus on automation, monitoring and incident management.

- Administer Azure data services: Data Factory, Synapse Analytics, Databricks, Cosmos DB, ADLS Gen2, Event Hub, Key Vault, Function Apps, Logic Apps and App Services.

- Provision and manage infrastructure as code with ARM templates and Terraform, including VNets, subnets, service endpoints and private endpoints.

- Run containerized workloads with Docker and Azure Kubernetes Service (AKS).

- Set up monitoring, logging and alerting with Azure Monitor, Log Analytics and Application Insights.

- Design and implement backup, disaster recovery and failover for critical workloads

- Define, schedule and monitor job flows; troubleshoot failed Databricks and Data Factory jobs and apply root-cause fixes

- Build and maintain Azure CI/CD pipelines with Azure DevOps and Jenkins.

- Automate provisioning, scaling and operations with Python and shell scripting.

- Monitor VM resources (CPU, memory, OS, storage, network) and review log files.

- Plan capacity of Azure resources and advise developers on improving job and workflow performance.

Requirements

- Hands-on experience administering Azure platform and data engineering services.

- Experience with distributed systems and streaming tools such as Event Hub.

- Strong Terraform and ARM template skills. - Experience with Docker and AKS.

- Automation skills in Python and shell scripting, plus Jenkins and Azure DevOps.

- Experience designing Azure CI/CD pipelines.

- Strong troubleshooting and root-cause analysis skills.

- Knowledge of agile delivery. -

Based in Jordan or Egypt.

Nice to have - Knowledge of Tableau and Power BI. - Experience with other cloud platforms.

Similar jobs

Apply for this job100% free