Data Engineer

Experience & Competencies: Previously worked closely with data architect or data modellers, can independently work on data analysis, data modelling. Proficient in manipulating data and drawing insights from large data sets using SQL Highly proficient in data preparation and integration, able to design, develop and modify data models and troubleshoot performance issues. Good in doing downstream analysis and understanding end to end data flow when multiple systems are involved. Experienced with working on Agile delivery. Expected to have strong at least 3 to 4 years of hands-on experience in SQL. Familiarity with data governance, data quality and control frameworks would certainly be useful in this role. Able to creatively use data and insights to uncover new opportunities, identify root causes and underlying risks to recommend solutions to the business. Technical Skills: Advanced data engineering skills with strong experience using Spark, SQL, Python and Airflow Strong knowledge of big data querying tools such as Presto or Trino. Experience in data architecture principles, including data access patterns and data modelling. Experience with data quality measurement and monitoring Experience with metadata, including control totals and check sums for load assurance. Comfortable taking ownership of issues and driving resolution. Familiar with cloud computing concepts (AWS) including any or all of EC2, S3, IAM, EKS and RDS and Linux Good understanding of Data Warehousing/ETL concepts Experience with CI/CD tools Experienced with DevOps approaches