Data Engineer (Snowflake & Python)

Seniority: Junior to Mid - level Individual Contributor
Core Focus: Python, SQL, Snowflake, Matillion, ETL/ELT, LLM Integration
Project: Data & Reporting Transformation
Location: Johannesburg, South Africa
Employment Type: Full Time
Company: PYGIO

About the Role

PYGIO is looking for a Junior to Mid-Level Data Engineer to join a client project building and maintaining data pipelines in Snowflake.

You'll own pipelines end to end, from ingesting data out of sources like Oracle and SharePoint to delivering dashboards and automated reports. You'll also get the chance to build LLM-powered capabilities, including AI agents, into those workflows. You'll work alongside experienced engineers and business stakeholders to deliver reliable, scalable data solutions.

Key Responsibilities

• Build and maintain ETL/ELT pipelines in Matillion, ingesting data from Oracle, SharePoint and flat files into Snowflake.

• Develop and deploy Snowflake data models, transformations, warehouses and scheduled jobs.

• Extract data from invoices and contracts using Document AI, and validate the results.

• Build dashboards and automate reporting, including email and SharePoint-based reports.

• Write Python and SQL for transformation, automation and validation.

• Implement data quality checks and validation processes.

• Support deployment, monitoring, troubleshooting and optimisation of data solutions.

• Translate business requirements into practical technical solutions.

• Contribute to LLM initiatives, including prompt engineering, tool use and function calling.

• Build native web applications using Python (FastAPI) and/or React.

• Maintain technical documentation and follow established development practices.

Required Skills & Experience

Must have:

• Practical experience with Python and SQL.

• ETL/ELT pipeline development and maintenance, ideally with Matillion or a comparable tool, ingesting from multiple sources (databases, SharePoint, files).

• Snowflake development and deployment: data models, transformations, warehouses and scheduled jobs.

• Automated document data extraction (Document AI or similar), including validation of results.

• Dashboard development and automated reporting,

• Understanding of data quality, validation, and production deployment practices.

• Good analytical and problem solving skills.

• Ability to learn quickly, collaborate effectively, and take ownership of assigned tasks.

• Good communication skills and the ability to work with technical and non-technical stakeholders.

Nice to have:

• Entity resolution: matching records across sources where the same entity is represented differently, including rematching cycles when data changes.

• LLM solution development: AI agents, MCP connectors (e.g. Google Drive and Snowflake), prompt engineering and function calling.

• Building, deploying and maintaining Python web applications (FastAPI, React).

• Experience integrating AI capabilities into data products or workflows.

• Exposure to data science or predictive analytics.

Ideal Candidate

You are a developing Data Engineer with a strong foundation in Python and SQL and an interest in building reliable, production-ready data solutions. You are comfortable working with data pipelines, eager to deepen your Snowflake expertise, and able to contribute to real-world engineering projects.

Experience developing web apps using any popular web applications (including the use of LLMs) will help you stand out, but the key requirement is a solid data engineering foundation and the ability to learn and deliver.