Senior Data Engineer

At SCP Health, what you do matters

As part of the SCP Health team, you have an opportunity to make a difference. At our core, we work to bring hospitals and healers together in the pursuit of clinical effectiveness. With a portfolio of over 8 million patients, 7500 providers, 30 states, and 400 healthcare facilities, SCP Health is a leader in clinical practice management spanning the entire continuum of care, including emergency medicine, hospital medicine, wellness, telemedicine, intensive care, and ambulatory care.

Why you will love working here:

- Strong track record of providing excellent work/life balance.

- Comprehensive benefits package and competitive compensation.

- Commitment to fostering an inclusive culture of belonging and empowerment through our core values - collaboration, courage, agility, and respect.

Responsibilities:

• Platform architecture & technical direction: Define and evolve reference architectures and standards for ingestion, transformation, orchestration, and serving layers (Snowflake + dbt and adjacent tooling); lead design reviews and set guardrails that enable teams to deliver scalable, secure, observable, and maintainable solutions.
• Highest-impact data products (ownership & service levels): Own end-to-end delivery and operational excellence for the most critical datasets and pipelines that support revenue cycle, physician scheduling, billing, and performance monitoring; define SLAs/SLOs, error budgets (where applicable), and support models for sustained reliability.
• Complex integrations & facility onboarding at scale: Lead strategy and implementation for complex, multi-facility integrations (EHR extracts, HL7, FHIR, APIs, flat files), including backfills, reconciliation, and long-term maintainability; establish repeatable onboarding playbooks and reusable patterns adopted across teams.
• Medallion lifecycle standards & governance leadership: Own and enforce platform-wide conventions across Bronze/Silver/Gold layers (naming, modeling, testing, documentation, lineage, certification); drive alignment on canonical definitions and patterns to reduce ambiguity and rework across domains.
• Operational ownership & major-incident leadership: Serve as an escalation point for major incidents impacting critical pipelines or multiple domains; lead triage, coordinate cross-team resolution, run blameless post-incident reviews, and drive systemic fixes (alerting, runbooks, resilience patterns, and backlog priorities) to prevent recurrence.
• Performance, reliability & FinOps leadership: Lead Snowflake performance and cost optimization initiatives (warehouse/workload design, scheduling, resource monitors, query tuning); establish team practices and decision frameworks that balance reliability, latency, and consumption, and communicate tradeoffs and drivers to stakeholders.
• Governance, security & compliance architecture: Architect and implement HIPAA-aligned controls for PHI/PII (least-privilege RBAC, masking, row/column policies, auditing, secure sharing); partner with Security/Compliance on access patterns, periodic reviews, audits, and remediation for platform-level controls.
• Data quality strategy, testing & observability: Define and operationalize platform-level data quality strategy (tests, reconciliation, anomaly detection, freshness/completeness targets) and observability standards; ensure measurable coverage for critical pipelines and data products and guide teams toward consistent adoption.
• Cross-team technical leadership: Lead technical discovery with stakeholders; clarify ambiguous requirements; propose implementation options; and align on definitions, acceptance criteria, change impacts, and rollout plans across multiple teams and initiatives.
• Mentorship & technical bar-raising: Mentor Data Engineers I–III through coaching, pairing, and feedback; raise the engineering bar via code/design reviews, reusable libraries/macros, documentation standards, and pragmatic guidance on tradeoffs.
• Release engineering & SDLC improvements: Lead improvements to data CI/CD and release practices (testing gates, automated checks, environment promotion, release strategy, rollback planning) that reduce defects and improve delivery predictability across teams.
• Technical roadmap partnership: Partner with the Data Engineering Manager and stakeholders to shape the platform roadmap, identify systemic risks and dependencies, and propose investments that improve scalability, reliability, governance, and team velocity.

Knowledge, Skills, and Abilities:

• Expert SQL & data engineering craft: Expert-level ability to design, optimize, and troubleshoot complex SQL workloads; diagnose performance at the query and system level; and define scalable patterns for data access and transformation.
• Snowflake platform leadership: Deep expertise with Snowflake architecture and operations, including workload strategy, governance controls, performance tuning, cost optimization, and operational monitoring; ability to set standards and coach others using usage and query analytics.
• dbt proficiency & platform conventions: Advanced proficiency with dbt project organization, macros, testing and documentation strategy, incremental modeling, and environment promotion; ability to define, enforce, and evolve conventions that scale across teams.
• Data modeling & domain architecture: Ability to define canonical models and data products across domains (e.g., dimensional/domain-oriented), manage change over time (SCDs), and drive alignment on definitions that reduce ambiguity across the organization.
• Reliability & operations leadership: Define SLAs/SLOs and availability targets; design monitoring/alerting and runbooks; lead incident response and postmortems for critical issues; and drive systemic improvements through problem management.
• Integration patterns & scalable onboarding: Advanced knowledge of batch and near-real-time patterns (watermarking, CDC, replay/backfill strategy, idempotency), APIs and authentication, and semi-structured/columnar formats (JSON, Parquet); ability to build reusable onboarding patterns adopted across multiple facilities and domains.
• Governance, security & privacy: HIPAA-aligned design for PHI/PII, least-privilege access models, masking and row/column policies, auditability, and secure sharing; ability to partner with Security/Compliance to design controls and lead remediation when gaps are found.
• Influence & enablement: Lead discovery and design reviews, make pragmatic tradeoffs, and influence without authority; drive adoption through enablement (documentation, office hours, templates), clear communication, and consistent standards.
• Strategic thinking & platform roadmap: Identify systemic issues and investment opportunities, articulate multi-quarter technical plans, evaluate build vs. buy tradeoffs, and sequence work to reduce risk and increase long-term leverage.
• Executive-ready communication: Communicate clearly with technical and non-technical partners, align on definitions and expectations, and provide transparent status, risk, and tradeoff updates for cross-team initiatives.

EDUCATION (Required and/or Preferred):

• Bachelor’s degree (BA/BS) in MIS, Computer Science, or a related field; or equivalent combination of education and experience.

FIELD OF STUDY:

• Degree preferred in MIS, Computer Science, or business discipline with appropriate exposure to information technology concepts, processes, and systems.

WORK EXPERIENCE/QUALIFICATIONS:

• 8+ years of progressive professional experience in Data Engineering, Analytics Engineering, or a related technical role, including ownership of production data pipelines and data products across multiple domains and leadership of complex cross-domain initiatives.
• 4+ years of hands-on experience building and operating solutions within the Snowflake ecosystem, including performance tuning and practical cost management.
• Experience in Healthcare, Revenue Cycle (RCM), and/or integrating clinical data feeds is strongly preferred; experience working with PHI/PII and regulated data is expected.
• Experience working in an Agile/Scrum environment, including technical leadership across initiatives (design reviews, estimation, delivery coordination) and mentoring other engineers through implementation and support.

CERTIFICATES AND LICENSES:

• Relevant certification or license in Data, Analytics, Cloud, or Security is a plus.
• SnowPro Advanced: Data Engineer (preferred) or SnowPro Core Certification.
• dbt Analytics Engineering Certification (preferred), with demonstrated experience operating dbt in production.
• HIPAA Security/Privacy training (required) and/or related healthcare compliance certifications (preferred).

WORK ENVIRONMENT AND PHYSICAL DEMANDS:

• Professional setting.
• Continuous sitting.
• Continuous oral & written communication and listening skills.
• Continuous computer use.
• Occasional bending, kneeling, lifting, pulling & pushing up to 10 pounds.
• Minimum travel, when applicable.
• Job requires a high level of mental awareness.

PRIMARY LOCATION:

• Lafayette, LA (Corporate HQ)

SECONDARY LOCATION(S):

• Atlanta, GA
• Dallas, TX

Pay Range:

This range represents the anticipated base salary for this role. Actual compensation will be determined based on experience, qualifications, and internal equity considerations.

-

We offer a comprehensive benefits package designed to support your health, financial well-being, and work-life balance, including medical dental, vision insurance, a 401(k) plan with a company match, paid time off and holidays, professional development support, and employee wellness resources.

Visit our website for further information. https://myscpbenefits.com/

Login name: corp-guest

Password: weheal

Why work here?

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

About Us

Our Work Experience is the combination of everything that's unique about us: our culture, our core values, our company meetings, our commitment to sustainability, our recognition programs, but most importantly, it's our people. Our employees are self-disciplined, hard working, curious, trustworthy, humble, and truthful. They make choices according to what is best for the team, they live for opportunities to collaborate and make a difference, and they make us the #1 Top Workplace in the area.