Data Engineer
- Hiring from
- Pakistan
- Work type
- Hybrid
- Posted
539,456 remote jobs, straight from company career pages
100% free · New jobs every hour
Show job descriptionHide job description
Job Grade: AVP
Reports to: Head DWH Reporting & Analytics
Department: Digital Financial Services
Location: Head Office, Islamabad
Job Purpose
To build and maintain Mobilink Bank's Medallion Architecture (Raw → Curated → Semantic) on a MinIO-based Delta Lake, enabling reliable, well-governed and high-performance data for analytics, Business Intelligence and Machine Learning. The role will design and deliver scalable batch and streaming data pipelines, integrate data across multiple source systems, and ensure that data is discoverable, trusted and ready for downstream consumption.
The position carries end-to-end accountability for the design, implementation, performance and quality of the Bank's data lake zones and the pipelines that feed them, in line with the Bank's data governance, security and compliance standards.
Key Responsibilities
1. Data Platform Architecture and Medallion Design
- Design, build and maintain the Raw, Curated and Semantic Zones of the Data Lake in line with the Medallion Architecture.
- Own the Delta Lake on MinIO storage layer, ensuring scalable, reliable and cost-effective object storage.
- Define zone-level standards for data structure, partitioning, retention and promotion from Raw to Curated to Semantic.
- Integrate multi-system data into a unified, analytics-ready platform that supports BI, analytics and ML use cases.
- Ensure the platform design supports structured and federated querying across data zones.
2. Data Pipelines, Ingestion and Processing
- Develop and manage end-to-end data pipelines covering ingestion (Kafka, Sqoop, Trino), transformation (Spark) and enrichment (Delta Lake on MinIO).
- Enable scalable processing and curation using Apache Spark, covering both batch and Structured Streaming workloads.
- Automate ETL processes using Python and R, replacing manual and repetitive data handling with reliable, scheduled workflows.
- Support structured and federated queries across data zones using Trino.
- Monitor pipeline health and resolve failures, latency and data-delivery issues promptly to protect downstream consumers.
3. Data Modelling, Analytics and BI Enablement
- Implement data models in OLAP columnar formats, such as Parquet, to optimise BI query performance.
- Design and maintain the Semantic Zone so that business users and analysts can consume trusted, consistent and well-defined datasets.
- Partner with Analytics, BI and Data Science teams to deliver datasets that support dashboards, reporting and machine-learning models.
- Enable reporting and data visualisation in Tableau through performant, well-structured data sources.
- Apply data warehousing and data lake principles to keep models scalable, reusable and easy to maintain.
4. Data Governance, Quality and Lineage
- Collaborate with governance teams to ensure data is discoverable, high-quality and catalogued through OpenMetadata.
- Contribute to data quality frameworks, including validation rules, monitoring and issue resolution across all zones.
- Establish and maintain data lineage tracking from source systems through to consumption.
- Apply data security, access control and compliance standards across the data lake and its pipelines.
- Ensure data integrity and traceability so that downstream analytics and ML outputs can be trusted and audited.
5. Performance, Collaboration and Continuous Improvement
- Drive performance tuning across Spark jobs, SQL queries, storage layouts and Trino federated queries.
- Optimise databases and queries across Oracle 19c, PostgreSQL and MySQL source systems to support efficient ingestion.
- Work closely with Technology, Data, Analytics, BI, Risk and Compliance teams to deliver data solutions within agreed timelines and quality standards.
- Evaluate and adopt emerging Big Data and cloud storage technologies that improve scalability, reliability and cost-efficiency.
- Operate effectively in an agile, fast-paced environment, contributing to documentation, knowledge sharing and engineering best practices.
Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology or a related field.
Experience
- Minimum 3 to 5 years of relevant professional experience in data engineering, ETL development or related fields.
- Strong experience in SQL development and database optimisation across Oracle 19c, PostgreSQL and MySQL.
- Proven hands-on experience building batch and streaming pipelines with Apache Spark (PySpark) or Trino.
- Working knowledge of object stores (MinIO, S3) and Delta Lake architecture.
- Demonstrated experience implementing the Medallion Data Architecture (Raw → Curated → Semantic).
- Practical experience with Trino, Sqoop, Delta Lake and MinIO for data processing and storage.
- Hands-on experience with Python and R for data manipulation and ETL automation.
- Experience with Tableau for data visualisation and reporting.
- Strong understanding of data warehousing concepts, data lakes and cloud storage solutions.
- Knowledge of data governance, security and compliance standards.
Key Skills and Competencies
- Medallion Data Architecture (Raw → Curated → Semantic)
- Apache Spark (PySpark), batch and Structured Streaming
- Trino / Presto and data federation
- Delta Lake and object storage (MinIO, S3)
- Data modelling and columnar OLAP stores (Parquet)
- SQL development and database optimisation
- Data ingestion (Kafka, Sqoop)
- Python and R for ETL automation
- Big Data and distributed computing
- Data warehousing, data lakes and cloud storage
- Data governance, security and compliance
- Data quality, lineage and metadata management (OpenMetadata)
- Tableau reporting and visualisation
- Problem-solving in an agile, fast-paced environment
- Collaboration and cross-functional communication
About Mobilink Bank
Mobilink Bank is providing banking services to over 64.22 million registered users including 21 million monthly active customers across Pakistan. With a hybrid model that combines traditional microfinance with mobile/digital banking technologies, the bank now operates with over 132 branches and 324,000 branchless banking agents and provides a USSD (GSM) based digital channel offering savings, micro enterprise (MSME) loans, small housing loans, remittances, collection (utility bills and loan instalments), mobile wallets, insurance, G2P, B2B & B2P payments; thus, playing a leading role in the promotion of financial inclusion. Mobilink Bank is committed to fostering a positive and productive workplace, and our core values reflect this focus. These values include promoting innovation and entrepreneurship, encouraging teamwork and collaboration, and prioritizing a customer-centric approach in all aspects of our business.
Why Join Mobilink Bank?
This is an opportunity for someone who is passionate about making a difference and playing a key role in driving transformative change. Our team is committed to empowering millions with the tools necessary to succeed in the digital age, and we're looking for a talented individual to join us in this endeavour.