Data Engineer – Senior

Job Description Data Engineer – Senior Client: Government of Alberta – Technology and Innovation Project: Digital Regulatory Assurance System (DRAS) Location: Edmonton, Alberta – 9942 108 ST, Edmonton, AB T5K 2J5 Contract & Work Schedule Hours: 36.25 hours/week Daily: 7.25 hours/day Schedule: Monday–Friday, 8:15 AM–4:30 PM Alberta Time Work Mode: Primarily remote Location Requirement: Must work from within Canada Onsite: Edmonton meetings approximately 3–4 times per fiscal month or more , as required Extension: Up to 6 months Role Overview The Senior Data Engineer will primarily support the DRAS program , designing and operating reliable data pipelines and data products. The role focuses on data ingestion, integration, transformation, governance, quality, and delivery of trusted analytics-ready datasets for regulatory, compliance, reporting, and future AI use cases. Key Responsibilities Design scalable, secure Microsoft Azure data architectures Build data ingestion and transformation pipelines using Azure Data Factory, Azure Databricks and Azure Synapse Manage Azure Data Lake Storage Gen2 Integrate data from ServiceNow, geospatial systems and other source systems Develop data models and semantic layers Build and optimize ETL/ELT workflows using Python, PySpark and SQL Develop secure APIs and data services using Azure API Management Implement data governance, metadata, classification and lineage Apply security controls including RBAC, encryption and data masking Monitor and troubleshoot data pipelines and integrations Use AI and automation for pipeline development, testing, monitoring and documentation Curate standardized, high-quality datasets for advanced analytics and AI. Requirements Must-Have Requirements Skill / Qualification Required Experience Analytics-ready data solutions, semantic layers, data marts & data products 3+ years Git / GitHub version control 4+ years Azure Storage, SQL, Synapse, networking & secure authentication 3+ years Python / PySpark & SQL Data Engineering 5+ years Azure Databricks & Delta Lake 3+ years AI for code generation, data analysis & automation 1+ year Nice-to-Have Data requirements analysis / transformation / cleansing / wrangling – 6 years Microsoft SQL Server – 6 years Microsoft Fabric – 2 years Government of Alberta Cloud environment – 1 year RESTful API design/integration – 3 years ActiveMQ / Azure Service Bus / Message Queueing – 3 years Cross-functional software and data product development – 5 years