AWS Data Engineer

Benefits: Hybrid Long Term Opportunity for advancement Job Title: AWS Data Engineer Location: Dallas, TX (Hybrid – 3 days per week in-office) Interview Process: In-Person Interview Profiles Required: 8–12 Years of Experience Locals & Non-Locals Can Apply Core Skills: Strong AWS Services, Python/PySpark, Advanced SQL Submission Details: Resume, LinkedIn URL, Work Authorization, Location Details Job Description Our esteemed client is seeking an experienced AWS Data Engineer with strong expertise in ETL testing, cloud migration, and Python programming in a production-grade AWS environment. You will design and maintain scalable data pipelines, ensure data quality through rigorous ETL testing, and play a key role in large-scale cloud migration initiatives. This role is ideal for someone passionate about building efficient, secure, and reliable data solutions, applying functional design principles, and leveraging automation to deliver business impact. Key Responsibilities - Develop and maintain scalable ETL pipelines within the AWS ecosystem. - Conduct ETL testing to ensure data integrity, accuracy, and performance. - Lead and support large-scale cloud migration projects. - Use Python (primary language) along with SQL and PySpark to develop data processing and automation solutions. - Orchestrate data workflows using Apache Airflow (including MWAA). - Collaborate with cross-functional teams to design data models and implement industry-standard data security and classification methodologies. - Monitor, troubleshoot, and optimize pipelines for reliability and performance. - Document design, conduct code reviews, and apply test-driven development (TDD) practices. - Work in Agile environments, participating in sprint planning and daily stand-ups. - Ensure a smooth transition of data during cloud migrations, applying DevOps and CI/CD practices where needed Qualifications - 8–12 years of experience in Data Engineering, focusing on ETL, Cloud Migration, and Python development. - 5+ years of hands-on experience with Python (primary), SQL, and PySpark, applying functional design principles and software design patterns. - 5+ years building and deploying ETL pipelines across on-prem, hybrid, and cloud environments, with orchestration experience using Airflow. - 5+ years of production-level AWS experience (MWAA, Glue/EMR (Spark), S3, ECS/EKS, IAM, Lambda). - Solid understanding of core statistical principles, data modeling, and data security best practices. - 5+ years working in Agile development with unit testing, TDD, and design documentation. - 2+ years of DevOps/CI-CD experience, including Terraform or other Infrastructure-as-Code (IaC) platforms. - Excellent problem-solving skills, with the ability to troubleshoot complex data and performance issues. - Strong communication skills and ability to work effectively in a hybrid model (3 days onsite in Dallas). Flexible work from home options available. Compensation: $60.00 - $65.00 per hour About Us We work to deliver profitability in your business – with effective communication, consulting, and interactive solutions. Following an Agile Work Approach, we make sure you get the ideal solutions at minimum expenses. Work Approach Our Philosophy Our Philosophy starts-and-ends at the Client-first approach. Be it understanding your business requirements to choosing the right technologies, we work as a collective team that takes all the possible steps to grow continuously towards our common goal. Work Policy We promote a collaborative work environment. We involve everyone working in the organization in community decisions and encourage them to think from a broader perspective. Our work process promotes flexibility and we maintain a high level of discipline at different levels of execution. The Future SelectMinds have years of experience in the domain helps us understand the need-of-the-hour better. This understanding drives us to a better future with every minute ticking. We believe we will be taking off major businesses from their flagship positions, with the products we are eyeing today.