Lead Software Engineer – ETL SDET

Hello,

Please find the below JD and let me know your interest with an updated resume.

Lead Software Engineer – ETL SDET

Halifax, Canada – Remote 100%

12+ Months Contract

Skill Cluster : Data-Snowflake with AWS Native Services, ETL.

Primary Skill : SQL, ETL, PySpark

Experience : 10 years

Job Description :

Job Requirements SDET Position Summary:

• The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows.
• This role involves designing and implementing automated tests to validate data transformation and migration, as well as collaborating with data engineers and developers to identify and resolve data quality issues.
• The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity.
• Minimum Qualification: At least 8 years of IT experience with minimum 5 years of experience in below skills:
• Tech Skills Proficiency in ETL Testing and developing automation framework & testcases in atleast one scripting language.
• Strong SQL skills, with experience in handling big data using ETL tools (e.g., Informatica).
• Mandatory work experience with PySpark Testing experience in cloud environment (AWS) S3, SSS, Glue, EMR, Data Catalog, Crawler, SQS, ETL Jobs, Event Bridge.
• Athena, Redshift Spectrum Databases.
• AWS Commands for running the jobs, file process and movements.
• Experience with Test Automation and DevOps practices in ETL and Cloud Systems.
• Domain Knowledge: Strong knowledge and hands-on experience in Healthcare Finance domain, including healthcare financial processes, billing, claims, payments, and related financial workflows.
• Work experience in a Big Data ecosystem processing data in data lakehouse.
• Experience providing testing oversight in the Agile team.
• Should have excellent business communication to interact with Business teams and cross-functional teams.
• Work Experience 7-10Years