Data Engineer
- Hiring from
- South Africa
- Work type
- Hybrid
- Posted
627,534 remote jobs, straight from company career pages
100% free · New jobs every minute
Show job descriptionHide job description
Wild Impact (www.wildimpact.earth) is a non-profit organisation supporting the conservation of 14 biodiversity landscapes and seascapes, and the sustainable development of the communities that are the custodians of these areas. These areas are situated in South Africa, Namibia, Botswana, Mozambique, Tanzania, Kenya, Bhutan and Chile. Wild Impact works in close collaboration with &Beyond (www.andBeyond.com), with a shared Impact Vision guiding and shaping the development and implementation of all projects.
About The Role
Reporting to the Senior Manager: Impact Insights and based at Wild Impact's Johannesburg Head Office, the Data Engineer will design, build and maintain the organisation's data infrastructure. This is an experienced, above-entry-level role for a hands-on professional who can work independently, guide junior team members, and partner effectively with programme, GIS and Data team, and organisational stakeholders. The successful candidate will create reliable data pipelines and a secure central data platform, improve data quality and accessibility, and enable recurring programme reporting, ad hoc analysis and biannual Impact overview reports across Wild Impact's global portfolio.
Key Responsibilities
About The Role
Reporting to the Senior Manager: Impact Insights and based at Wild Impact's Johannesburg Head Office, the Data Engineer will design, build and maintain the organisation's data infrastructure. This is an experienced, above-entry-level role for a hands-on professional who can work independently, guide junior team members, and partner effectively with programme, GIS and Data team, and organisational stakeholders. The successful candidate will create reliable data pipelines and a secure central data platform, improve data quality and accessibility, and enable recurring programme reporting, ad hoc analysis and biannual Impact overview reports across Wild Impact's global portfolio.
Key Responsibilities
- Data platform, pipelines and operational data ownership (approx. 35%)
- Act as technical owner of the organisation's operational data and data platform, accountable for its integrity, availability, security and day-to-day running, and agree data ownership and stewardship roles with programme and business teams.
- Keep data systems running reliably: monitor them, fix problems quickly, manage changes carefully and document how they work.
- Design, build and maintain scalable, secure and cost-efficient batch and near-real-time data pipelines, including from field collection tools (e.g. ODK, SurveyCTO, Survey123, Microsoft Forms).
- Establish and maintain a central data platform in Azure, including data lakes, warehouses (e.g. Azure SQL Database and/or Microsoft Fabric) and curated data outputs that support programme and organisational impact review reporting.
- Develop and orchestrate ETL/ELT processes that ingest, transform and integrate structured and unstructured data from programme, GIS and operational systems.
- Take responsibility for building well-designed relational databases and managing the workflows involved in moving from a spreadsheet-based system to them, including planning the migration and cleaning, validating and loading existing spreadsheet data.
- Optimise data solutions for performance, scalability, maintainability and cloud cost.
- Operational and M&E data modelling and quality (approx. 20%)
- Define and maintain data models, schemas, metadata, documentation (including a data dictionary and data flow maps) and data lineage to improve accessibility and consistent use of information.
- Turn well-structured operational data into M&E data: map operational records to results frameworks and indicator definitions, build and maintain the transformation logic that derives indicators, and validate the outputs with the Impact Insights team.
- Manage data imports, cleansing, reconciliation and master-data practices, including unique beneficiary identifiers, and resolve the root causes of recurring quality issues.
- Work with the Impact Insights team to digitise and version data collection forms and keep them aligned to indicator changes.
- Reporting and analytics (approx. 15%)
- Build automated dashboards and reports in Power BI for programme managers, executives, the board and funders.
- Automate recurring reporting to reduce manual spreadsheet work.
- Respond to ad hoc data requests with clear documentation of sources and assumptions.
- Data governance, security and POPIA compliance (approx. 15%)
- Apply appropriate access controls (Microsoft Entra ID), encryption, backup and recovery practices, with particular care for children's and health data.
- Support compliance with data governance, privacy and security requirements, including POPIA, the organisation's data protection policy and funder requirements, working with the Information Officer.
- Support consent management and data subject requests and assist with breach response procedures.
- Contribute to data-sharing agreements with partners, government departments and evaluators.
- Collaboration, capacity building and team support (approx. 15%)
- Partner with programme teams, the GIS Insights and Systems Officer, analysts and other stakeholders to translate requirements into practical data solutions, and recommend improvements to data collection, tracking and presentation.
- Provide training and technical support to Johannesburg-based and regional programme teams to strengthen data literacy and accurate data capture.
- Support the recruitment, mentoring and day-to-day technical guidance of Junior Data Analysts, in collaboration with the GIS Insights and Systems Officer.
- Recommend fit-for-purpose, cost-effective tools, making full use of Microsoft non-profit licensing, and stay current with sector practice in operational data management, digital M&E and responsible data use.
Essential
Qualifications and experience
Area
What We Look For
SQL and data modelling
Strong SQL; dimensional and relational data modelling, schema design, query optimisation and database performance tuning
Databases
Microsoft SQL Server and Azure SQL Database, or similar; exposure to NoSQL
Programming
Python-based data engineering and automation using appropriate libraries and testing frameworks; Git version control
Integration and orchestration
Tools such as Azure Data Factory or Microsoft Fabric pipelines, Apache Airflow, dbt, Ab Initio or SAS ETL; Logic Apps and Power Automate; Apache Spark or a comparable distributed-processing framework is advantageous
Data formats and interfaces
CSV, JSON, Parquet, APIs and secure file transfer
Reporting and visualisation
Power BI (DAX, Power Query), Tableau or equivalent; advanced Excel
Microsoft 365
Excel, Word, PowerPoint, Teams, Forms, Outlook and Power Automate
Data protection
POPIA, role-based access, anonymisation and pseudonymisation, secure data transfer
Communication
Clear written and verbal English; sound stakeholder engagement; explains technical ideas plainly to programme staff, managers and funders
Problem-solving
Strong attention to detail, analytical thinking and a structured approach to problem-solving
Ways of working
Organised and self-directed; manages competing priorities in a small team
Values
Integrity with sensitive data, respect for beneficiaries and commitment to social impact
Key relationships
Qualifications and experience
- Bachelor's degree in computer science, Data Engineering, Information Systems or a closely related field.
- 3 to 5 years' relevant experience in data engineering or a closely related role.
- Demonstrated experience designing, building and maintaining data warehouses, data lakes and robust ETL/ELT pipelines.
- Strong proficiency in SQL and Python, including data transformation, automation, testing and performance tuning.
- Practical experience with relational databases and exposure to NoSQL technologies.
- Hands-on experience with at least one major cloud platform, preferably Microsoft Azure.
- Experience with version control, code review, automated testing, CI/CD and infrastructure-as-code practices.
- Working knowledge of POPIA and good data protection practices.
- Valid South African driver's licence and willingness to travel to programme sites.
- A relevant postgraduate qualification.
- Advanced Python, including PySpark for large-scale data processing in Microsoft Fabric or Azure.
- Relevant cloud, DevOps, data engineering or data science certification (e.g. Microsoft Fabric Data Engineer Associate, Azure Data Fundamentals or Power BI Data Analyst).
- Familiarity with M&E concepts: logframes, theories of change, indicators, baselines and evaluations.
- Experience with mobile data collection platforms and workflows.
- Proficiency in an additional South African language.
Area
What We Look For
SQL and data modelling
Strong SQL; dimensional and relational data modelling, schema design, query optimisation and database performance tuning
Databases
Microsoft SQL Server and Azure SQL Database, or similar; exposure to NoSQL
Programming
Python-based data engineering and automation using appropriate libraries and testing frameworks; Git version control
Integration and orchestration
Tools such as Azure Data Factory or Microsoft Fabric pipelines, Apache Airflow, dbt, Ab Initio or SAS ETL; Logic Apps and Power Automate; Apache Spark or a comparable distributed-processing framework is advantageous
Data formats and interfaces
CSV, JSON, Parquet, APIs and secure file transfer
Reporting and visualisation
Power BI (DAX, Power Query), Tableau or equivalent; advanced Excel
Microsoft 365
Excel, Word, PowerPoint, Teams, Forms, Outlook and Power Automate
Data protection
POPIA, role-based access, anonymisation and pseudonymisation, secure data transfer
Communication
Clear written and verbal English; sound stakeholder engagement; explains technical ideas plainly to programme staff, managers and funders
Problem-solving
Strong attention to detail, analytical thinking and a structured approach to problem-solving
Ways of working
Organised and self-directed; manages competing priorities in a small team
Values
Integrity with sensitive data, respect for beneficiaries and commitment to social impact
Key relationships
- Internal: Head of Impact Insights, the GIS Insights and Systems Officer, Junior Data Analysts, Johannesburg-based and regional programme teams, fundraising and partnerships team, finance, the Information Officer and executive leadership.
- External: funders and their reporting teams, implementing partners, government departments, external evaluators, and technology vendors or consultants.
- A documented central data platform in Azure, with automated pipelines from field collection, GIS and operational systems.
- Core indicator dashboards live for management and the board, with donor reports drawn from them.
- Manual reporting time measurably reduced against an agreed baseline.
- A current data dictionary, data flow map and POPIA-aligned access controls in place.
- The chance to shape the data foundations of an organisation delivering measurable public benefit.
- Hybrid working and exposure to programmes across multiple sectors.
- Professional development support, including relevant certifications.
- [Leave, medical aid, retirement fund and other benefits to be confirmed.]
