Data Engineering Consultant - PySpark, ADF 2387122 | Hyderabad, Telangana

The UnitedHealth Group Careers website will be undergoing planned maintenance. There will be downtime on Friday, March 27th 5:00 PM Central - Saturday, March 28th 5:00 PM Central. Blogs Job seeker resources Login Bookmarked jobs ( 0 ) Career areas Life here Join our talent community Clinical › Corporate and business operations › Customer and support services › Early careers › Sales and account management › Technology and data › Physicians › Advanced practice clinicians › Pharmacy › Behavioral health › Nursing › Medical coding › Clinical support › U.S. › Ireland & UK › India › Philippines › Culture of Belonging › Employee Benefits › Blog Job seeker resources Login Bookmarked jobs ( 0 ) Career areas Clinical Physicians Advanced practice clinicians Pharmacy Behavioral health Nursing Medical coding Clinical support Corporate and business operations Administrative support Consulting Finance and business analytics Legal and compliance Marketing and communications People team Project management Customer and support services Billing Claims Customer Service Data entry Early careers Sales and account management Account management Sales Sales management Technology and data Artificial intelligence Architecture Business systems analysis Data analytics Data engineering Data science Network infrastructure Product management & development Security and risk Software engineering Life here U.S. Culture of Belonging Employee Benefits Military Fellowship Program Ireland & UK Culture of Belonging Employee Benefits India Culture of Belonging Employee Benefits Philippines Culture of Belonging Employee Benefits Join our talent community Search Jobs Open search form Keyword or job number Location Go Explore remote jobs Pursue your passion and potential Data Engineering Consultant - PySpark, ADF Hyderabad, India Apply Internal apply Bookmark job Jump to Our values Job description Benefits Testimonial Awards & recognitions Related content Caring. Connecting. Growing together. With these values to guide us, our people are committed to making a meaningful difference in the lives of those we are honored to serve. Integrity Compassion Inclusion Relationships Innovation Performance Back to nav Data Engineering Consultant - PySpark, ADF Requisition number: 2387122 Job category: Technology Primary location: Hyderabad, India Date posted: 09/17/2026 Overtime status: Exempt Travel: No Share this job Facebook X LinkedIn Email Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. As a Data Engineering Consultant within our technology organization, you will lead the design, development, and modernization of legacy applications using PySpark and Databricks. You will drive the migration of legacy processes to cloud-native data engineering frameworks and define technical architecture, standards, and best practices for scalable data solutions. In this role, you will collaborate with architects, product owners, and business stakeholders to translate business requirements into technical solutions while mentoring data engineers and ensuring robust data governance, security, and quality across data platforms. Primary Responsibilities: Lead the design, development, and modernization of legacy applications using PySpark and Databricks Define technical architecture, standards, and best practices for scalable data solutions Mentor and guide data engineers, ensuring high-quality delivery and technical excellence Drive migration of legacy processes to cloud-native data engineering frameworks Design and optimize large-scale data pipelines for performance, reliability, and scalability Collaborate with architects, product owners, and business stakeholders to translate requirements into technical solutions Ensure data governance, security, quality, and compliance across data platforms Lead code reviews, technical design discussions, and production support activities Implement CI/CD, automation, and monitoring to improve operational efficiency Evaluate emerging technologies and drive continuous improvement in data engineering capabilities Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so Required Qualifications: Undergraduate degree or equivalent practical experience 5+ years of data engineering and ETL/ELT pipeline development experience 4+ years of hands-on experience with PySpark, Apache Spark, and Databricks 4+ years of experience with Advanced SQL, data modeling, and performance tuning 3+ years of experience with Cloud Data Platform Architecture, including Azure Data Lake Storage (ADLS) and Azure Data Factory (ADF) 3+ years of experience working with Delta Lake and Lakehouse Architecture 3+ years of experience with CI/CD, Git, and DevOps practices in a data engineering environment Technical leadership experience, including leading code reviews and technical design discussions Preferred Qualifications: Experience with Apache Kafka or streaming technologies Experience with Azure Synapse Analytics Experience with Infrastructure as Code (IaC) using Terraform Experience with Machine Learning Pipeline Integration Experience with Kubernetes and Containerization Experience delivering projects in an Agile/Scrum environment Healthcare data domain knowledge Familiarity with Data Governance and Data Quality Frameworks Solid Python programming skills At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission. Apply Internal apply Bookmark job Back to nav Benefits Our mission of helping people live healthier lives extends to our team members. Learn more about our range of benefits designed to help you live well. Life Resources and support to focus on what matters most to you, in every facet of your life. Emotional Education, tools and resources to help you reduce and manage stress, build resilience and more. Physical Health plans and other coverage to support wellness for you and your loved ones. Financial Benefits for today and to help you plan for the future, including your retirement. Learn more Back to nav Since joining Optum, my professional growth has been significant. The dynamic environment has enhanced my problem-solving abilities, and the company’s commitment to innovation and continuous learning motivates me to stay. Optum provides continuous training, mentorship, and a clear path for advancement, all while supporting a healthy work-life balance. Anurag J. Senior Software Engineering Manager Back to nav We’re honored to be recognized for our exceptional work culture Back to nav Discover our family of businesses See how we’re structured to help build a modern, high-performing health system. Learn more Explore our hiring process Learn what to expect when you pursue an opportunity with us. Learn more How we’re transforming care Find out how we’re making care smarter and more personalized. Learn more Back to nav Connect with us Facebook Instagram YouTube LinkedIn Do not sell or share my personal information Social responsibility Fraudulent activity Cookie management Site map Privacy Policy Family & Medical Leave Act (PDF) Equal Employment Law Poster (PDF) SMS Terms & Conditions (PDF) Employee Polygraph Protection Act (PDF) E-Verify Participation Poster (PDF) Pay Transparency Nondiscrimination Provision (PDF) Immigrant and Employee Right to Work Poster (PDF) Health Plan Notices (PDF) County of LA Fair Chance Ordinance (PDF)