Senior Data Engineer

Salary range

The salary range for this position is CAD $46.37 - $66.66 / hour

Why Fraser Health?

At Centre for Advanced Analytics, Data Science, and Innovation (CAADSI) department of Fraser Health, we are looking for a Senior Data Engineer to join our agile and fast paced team. Reporting to the Director, Data Engineering, this position is part of the team responsible for developing and maintaining ETL pipelines, developing data models and supporting the creation of a hybrid cloud model. A Senior Data Engineer leads the team across our data strategy, analysis, data integration, and data management.

The work performed has a significant impact on the delivery and use of our data products to the organization. The Senior Data Engineer will rely on extensive background and experience in data modeling and building traditional and distributed data pipelines to help guide and explore new grounds in adopting new tools to improve CAADSI’s Data Lake and relevant infrastructure.

Job duties:

• Lead the evolution and ensure the performance of our CAADSI Data Lake
• Prepare technical documents and oversee technical issues
• Identify areas for improvement and provide solutions
• Clarify program intent and requirements with various personnel, and suggest changes
• Guide cloud migration from on premise SQL servers to MS Fabric
• Liaise with various data source teams and stakeholders, assisting with data and technical issues
• Develop and align ETL/ELT processes to current and developing architecture
• Perform complex programming and data structure alterations
• Strive for code quality improvement and self-learn new technologies
• Translate business issues into technical terms and implement best practices
• Collaborate with cross-functional teams to produce optimal solutions
• Anticipate system challenges and propose solutions
• Contribute to work estimates and participate in design and code reviews
• Provide mentorship for Data Engineering team members.

Qualifications:

• Bachelor's degree in Health Information Science, Computer Science, Software Engineering or a related study
• Seven (7) years of related experience in a large complex organization
• A good understanding of modern data platforms with proven experience in assembling large, complex sets of data that meets non-functional and functional business requirements using a variety of languages.

An equivalent combination of education, training and experience may be considered.

Preference will be given to candidates with experience in:

• Five years of data engineering experience or equivalent combination of education, training, and experience.
• Hands-on experience with scripting, analytics, Microsoft Azure, and Microsoft BI tools (SQL, Python, PowerShell, JavaScript, SSIS, SSAS, SSRS, PowerBI)
• Understanding of data platforms including data lakes and data warehouses
• Experience assembling large, complex data sets that meet business requirements
• Proficiency in integration, modelling, and orchestration of complex data; optimization and automation skills required
• Expertise in designing and optimizing data table structures, reports, and queries
• Knowledge of performance tuning and troubleshooting in ambiguous environments
• Experience with Microsoft Fabric, Azure DevOps, Azure Data Factory, and Azure Synapse is a plus
• Ability to design, implement, and monitor best practices for Dev framework
• Experience with large volume data; Healthcare data experience is a plus

This position is located at our Central City office in Surrey, BC and has option for remote/hybrid work.

Curious to learn what it’s like to work here? Like us on Facebook (@fraserhealthcareers), follow us on Twitter & Instagram (@FHCareer), or connect with us on LinkedIn (fraserhealthcareers) for first-hand employee insights.

#LI-DNI

Detailed Overview

Supporting the Vision, Values, Purpose and Commitments of Fraser Health including service delivery that is centered around patients/clients/residents and families:The Senior Data Engineer provides senior consulting to Fraser Health executive within an assigned portfolio in the areas of data and data management, decision support and in corporate business areas which may include the development and implementation of application architecture. Leads enterprise-wide information systems projects; manages timelines and resources; provides leadership to team members and may facilitate change management strategies as part of the project. Coordinates the procurement and management of external services. Manages assigned staff. A Senior Data Engineer leads the team across our data strategy, analysis, data integration, and data management.

Responsibilities

Provides senior data engineering services to all disciplines and partners within an assigned portfolio by keeping abreast of the initiatives and issues within the business areas assigned and leading the business area through developing business cases, process reengineering initiatives, etc. Formulates project plans with the business areas and/or provides input into operational or strategic plans.

Ensures that projects and initiatives are aligned with the Fraser Health's Strategic direction.

Provides project leadership to a variety of large, complex projects including a number of diverse disciplines and/or affecting multiple partners; develops and manages project timelines; facilitates change management strategies; defines tasks; identifies, sources and manages resources such as contractors, staff or dollars; identifies and mitigates project related risks; provides guidance to team members.

Ensures project closure by providing post-implementation evaluation; measuring key outcomes, assessing project related staff, ensuring customer satisfaction, obtaining project sign off, and documenting lessons learned.

Provides leadership to staff assigned to lead small to medium scale projects by providing guidance on project requirements, budget management, or technical issues; receives updates from assigned team leaders on project status.

Provides input into project budget development and, once approved, manages the budget dollars by approving required contractors, purchasing software and hardware. Monitors and reports on budget variances if necessary and discusses with project sponsor as required.

Liaises and communicates with project sponsors and partners by monitoring and reporting on all phases of projects to ensure success and to increase overall quality of products implemented. Provides updates on project status and all aspects of the project as required.

Manages assigned projects using standard documentation methodologies.

Manages assigned staff by selecting, supervising, and evaluating staff; assigns, evaluates and monitors work assignments; disciplines staff as necessary and initiates terminations; assesses and recommends staffing requirements; orients staff; authorize leaves of absences and approves overtime as necessary.

Champions data management methodologies and best practices through mentoring, coaching, and communicating with team members, business units and staff.

Researches and analyzes market, technology, and industry trends and standards related to technologies for the purposes of collaboration in problem solving merging business needs with a focus on leveraging data. Provides recommendations on the use and evolution of applications and tools.

Provides expert advice and consultation by performing or managing the research, analysis, and recommendations for proposed technology changes. Provides input into development and into the use of new technology for inclusion in the technology architecture. Provides consultation and advice to senior management on technology alternatives and solutions.

Develops annual goals and objectives for the area of responsibility, in collaboration with the Manager, ensuring consistency with department plans and authority objectives and strategies.

Responsible for collaborating with teams to advise, design, and implement the data infrastructure and systems to support the organization's data-driven initiatives.

Responsible for developing and maintaining ETL pipelines, developing data models and supporting the creation of a hybrid cloud model.

Applying performance tuning and optimization, perform bottleneck problems analysis, and technical troubleshooting.

Participates in assigned Fraser Health, Provincial, and Federal committees; chairs and/or leads discussion as required.

Performs other related duties as required.

Qualifications

Bachelor's degree in Health Information Science, Computer Science, Software Engineering or a related study or equivalent combination of education, training and experience. Seven (7) years of related experience in a large complex organization. A good understanding of modern data platforms with proven experience in assembling large, complex sets of data that meets non-functional and functional business requirements using a variety of languages.COMPETENCIES:

Demonstrates the leadership practices of the Fraser Health Leadership Framework of Clear, Caring and Courageous and creates the conditions for people to succeed.

Professional/Technical Capabilities

• Ability to provide leadership to a variety of large project teams in an environment that constantly changes and that has fluctuating priorities.
• Advanced knowledge of information management, business processes, technologies and applications.
• Knowledge of all components of a technical architecture.
• Ability to translate business needs into application architecture requirements.
• Ability to quickly comprehend the functions and capabilities of new technologies.
• Demonstrated knowledge of the project management process and the systems development life cycle.
• Ability to be organized, goal-oriented, proactive, solution-oriented, pragmatic, and the ability to understand the long-term and short-term perspectives.
• Diplomatic negotiation skills and the ability to influence.
• Understanding of and the ability to manage the political climate of the organization.
• Ability to provide input into project budget development, manage assigned dollars and estimate financial impact of application architecture alternatives.
• Demonstrated decision making ability within complex and diverse issues.
• Physical ability to perform the duties of the position.