ETL Modernization Developer

Job Description – ETL Modernization Developer Location: Across USA any Location – Remote Only Independent Visa Holders Role Overview We are seeking an experienced ETL Modernization Developer to join our Data Management team supporting customer’s Enterprise AI & Data initiatives. The role involves modernizing legacy ETL/ELT pipelines, migrating large-scale data workloads, and ensuring operational readiness in a cloud-native environment. The developer will work closely with business, application, and technical teams to deliver high-quality, governed, and production-ready data solutions. Key Responsibilities Assessment & Planning Analyze existing ETL/ELT jobs, databases, and data warehouses for migration readiness. Document requirements and migration artifacts for approval. Design & Development Redesign and re-engineer legacy IBM DataStage jobs into modern frameworks (Databricks Spark on AWS preferred). Develop, test, and deploy ETL pipelines using Python, Unix scripting, and cloud-native tools. Implement CI/CD pipelines for automated build, test, and deployment. Testing & Validation Conduct parity checks, unit testing, functional testing, UAT, and performance testing. Ensure schema validation, data quality, regression, and performance test coverage. Execution & Cutover Support migration cutover, go-live, and post-migration stabilization (hypercare). Coordinate with application teams for redeployment and complete testing. Decommissioning Plan and execute decommissioning of legacy DataStage jobs and artifacts. Knowledge Transfer & Training Deliver operational readiness documentation and conduct KT sessions with Customer engineers. Provide training support for application and business teams. Required Skills & Experience Technical Skills Strong experience in IBM DataStage development. Experience in Databricks, Delta Lake, Unity Catalog, Photon Proficiency in PySpark, SQL, Shell Scripting and Python. Hands-on experience with Databricks Spark (DBX) on AWS for job verification and pipeline development. Familiarity with AWS services such as Glue, Lambda, Redshift. Knowledge of CI/CD tools (GitLab, ADO, JIRA) and automated testing frameworks. Automated ETL Testing tools, PyTest and XML/JSON parsing. Domain Knowledge Expertise in ETL/ELT migration and modernization. Understanding of large-scale DB/DWH workloads and complex pipelines. Experience in hypercare support and KT with application teams. Soft Skills Strong communication and collaboration skills to work with cross-functional teams. Ability to document requirements, test plans, and operational readiness artifacts. Problem-solving mindset with focus on quality and continuous improvement. This is a remote position. Compensation: $50.00 - $55.00 per hour