Data Enigneer-III

Role: SDE III Data Engineer
Location: Remote
Employment Type: Contractor (6 months)

Application Stack

· Python/ PySpark

· Apache AirFlow

· Snowflake

· SQL Database

· MLOps

· Snowpark

· Azure/AWS Functions

· Blob Storage

· XML, JSON

· GitHub

Essentials for Being Successful in This Role

· Minimum 5 years of experience in software development and system design

· Minimum 2 years of experience as a Data Engineer focused on data modelling, governance, and platform administration.

· Expertise in Snowflake or similar MPP databases.

· Strong SQL skills.

· Experience with multiple database technologies (MSSQL, PostgreSQL, OLAP, OLTP).

· Familiarity with ETL/ELT tools and methodologies.

· Experience with database health monitoring, stored procedures, and schema design.

· Practical understanding of data governance principles.

· Experience with cloud environments (SaaS, PaaS, IaaS).

· Strong communication skills, both written and verbal.

· Experience in technical design and documentation.

· Proficiency with source control systems (Git, Gitflow).

· Experience with Agentic AI (Claude, GPT, etc.).

Desirables (Nice to Have)

· Familiarity with Generative AI and Spec-Driven Development.

· Experience with test automation.

· Experience with Kafka, Azure Event Hubs, Azure Service Bus.

· Knowledge of CI/CD practices.

· Ability to work independently and within Agile teams.

· Experience with Azure cloud services.

· Exposure to Master Data Management (MDM).

· Python skills for data transformation and pipeline automation.

· Understanding data mesh principles.

· Strong prioritization and multitasking abilities.

Roles & Responsibilities

· Designing, building, testing, and maintaining scalable data models using Apache Airflow and Python.

· Administering Snowflake environments, monitoring system health and performance.

· Managing and optimizing Snowflake virtual warehouses for efficiency and cost-effectiveness.

· Managing the MLOps workflow through Snowflake registrations and Snowpark.

· Promoting self-service and decentralized data ownership across teams.

· Enforcing data governance policies to ensure standardization, quality, and compliance.

· Providing technical assistance and cross-training to team members.

· Participating in design sessions and creating technical design documents and diagrams.

· Conducting code reviews and offering constructive feedback.

· Mentoring engineers to support team growth and development.

· Collaborating with senior engineers in the Architecture Review Board.

· Ensuring delivery quality and supporting production services.