Azure Data Engineer

Position - Data Engineer

Location - Canada (Remote)

Contract - Long term

Working Hours - PST

Key Responsibilities

• Design, develop, and maintain scalable batch and real-time data pipelines.
• Build and optimize ETL/ELT workflows using Azure Data Factory, Databricks, and Apache Spark.
• Develop complex SQL queries and perform data transformation, validation, and optimization.
• Integrate data from multiple internal and external sources using REST APIs and other integration methods.
• Work with structured and unstructured data to support analytics and reporting requirements.
• Collaborate with data analysts, data scientists, and business teams to deliver reliable data solutions.
• Implement data quality, governance, and security standards across data platforms.
• Optimize data pipelines for performance, scalability, and reliability.
• Work with Power BI and other visualization tools to support reporting and analytics.

Required Skills & Qualifications

• Good years of experience in Data Engineering or Data Platform Development.
• Strong hands-on experience with Microsoft Azure services.
• Proficiency in Azure Data Factory (ADF).
• Strong experience with Azure Databricks and Apache Spark.
• Advanced SQL skills and experience with database development.
• Experience building and maintaining ETL/ELT data pipelines.
• Knowledge of Python and PySpark.
• Experience with REST APIs and batch/real-time data integration.
• Familiarity with Azure Synapse Analytics, Snowflake, or similar cloud data platforms.
• Exposure to Power BI or Tableau.
• Understanding of data governance tools such as Microsoft Purview or Unity Catalog.
• Strong analytical, problem-solving, and communication skills.

Preferred Qualifications

• Experience working in financial services or banking environments.
• Knowledge of data warehousing and cloud-based data architecture.
• Exposure to streaming data and large-scale data processing.