Sr. Data Engineer, Onboarding

Most job postings are the same (and can be pretty boring, right?!). That's why we want to start out by telling you what's in it for you:

• We have an amazing platform that maximizes revenue for thousands of healthcare organizations across the country!
• We embrace diversity in a serious way! We are committed to building a team that represents a variety of backgrounds, perspectives, and skills. The more inclusive we are, the better our work will be.
• We celebrate and promote career growth and advancement.
• We have an awesome on-demand learning program.
• We do fun stuff like remote Cooking Classes, Yoga Sessions & Mixology Classes because we like to have fun!
• We have an awesome benefits package with Medical, Dental & Vision Coverage & 401K (with company match).
• We have an unlimited vacation policy - that's right, take vacation when you want and come back to work refreshed!
• We have cool Peer Nominated Awards & Recognition because we like to celebrate our employees!

The Senior Data Engineer, Onboarding designs, builds, and maintains the data pipelines that bring customer healthcare data, including 837 (claims), 835 (remittance), and EMR data, into the MDaudit platform and its analytic and operational applications supporting revenue cycle and compliance initiatives. This is an internal engineering role that partners closely with Implementation, Product, Support, and IT teams to onboard customer data quickly and keep onboarding projects on track.

The role centers on hands-on engineering with a modern cloud data stack: Databricks, PySpark, Python, and Snowflake. The Senior Data Engineer, Onboarding also converts data from legacy systems, builds automation that reduces manual onboarding effort, monitors and maintains customer data feeds, and mentors less experienced engineers. The ideal candidate brings strong healthcare revenue cycle management (RCM) knowledge, including healthcare billing, the claims lifecycle, and reimbursement, along with working knowledge of healthcare EDI and electronic medical record systems.

Essential Duties and Responsibilities Include but not limited to the following:

• Design, develop, and maintain scalable ETL/ELT pipelines on Databricks using PySpark and Python, following a Bronze/Silver/Gold lakehouse pattern.
• Onboard customer data by ingesting, parsing, and transforming 837I/P/D (Institutional/Professional/Dental) claims, 835 remittance advice, and EMR data, and map it accurately to the MDaudit data model.
• Build and optimize Snowflake data models, SQL transformations, and warehousing processes.
• Convert and migrate data from legacy systems and databases (such as Microsoft SQL Server) to the modern data platform.
• Develop reusable frameworks, tools, and automation in Python, PySpark, and SQL to streamline ETL, reduce manual onboarding effort, and improve data accessibility.
• Implement automated data validation, quality checks, and reconciliation, and resolve discrepancies promptly.
• Monitor, maintain, and troubleshoot customer data feeds and file processing after setup, using processing metrics to identify further automation and performance and cost improvements.
• Integrate and validate EMR data (e.g., Epic, Cerner, Meditech, Athenahealth) with claims data to support comprehensive reporting.
• Collaborate with Implementation, Product, Support, and IT teams to clarify requirements, data mapping, and delivery priorities.
• Resolve onboarding escalations on data ingestion and integration issues quickly, performing root-cause analysis and permanent fixes.
• Keep onboarding work items on track in project management tools (e.g., Monday.com), raise risks early, and provide regular status updates to internal stakeholders.
• Document pipelines, data flows, and runbooks, and transition completed work to Support with the documentation needed to operate it.
• Mentor junior engineers, conduct code reviews, and share technical knowledge across the team.
• Adhere to and support HIPAA and other regulatory requirements and maintain data integrity and security.
• Other duties as needed.

Required Skills

• Strong analytical and problem-solving skills with attention to detail.
• Strong written and verbal communication with technical and non-technical colleagues.
• Collaborative, team-oriented working style.
• Strong understanding of healthcare revenue cycle processes and experience with SaaS applications.
• Comfort working in a fast-paced environment.

Education & Experience

• Bachelor’s degree in computer science, Data Science, Health Informatics, Information Systems, or a related field, or equivalent experience.
• 8+ years of experience in data engineering, ETL/ELT, and data warehousing.
• 3+ years of programming experience with Python and advanced SQL.
• 2+ years of hands-on experience with Databricks (Delta Lake, notebooks, jobs/workflows) and PySpark.
• Working experience with Snowflake, including data modeling and SQL transformations.
• 2+ years of experience in the healthcare industry, preferably in revenue cycle management (RCM), with a solid understanding of billing processes, the claims lifecycle, and reimbursement models.
• Working knowledge of healthcare EDI (X12) transaction data and how it is used in claims and remittance processing.
• Experience with cloud platforms (AWS or Microsoft Azure).

Notice of AI Use in Job Application Review

As part of our commitment in creating a fair, efficient, and consistent hiring process we may use artificial intelligence (AI) to help our recruiting teams organize, summarize, and analyze information provided by candidates, including resumes, application responses, and other materials submitted during the application process.AI may be used to identify patterns, highlight relevant skills, and experience, and assist in comparing a candidate’s qualifications with the requirement of a specific role. These tools are to improve efficiency and consistency while supporting more informed hiring decisions, which will ultimately be made by the hiring team.