Senior Data Engineer

Binariks is looking for a Senior Data Engineer to connect an emerging AI platform to large-scale healthcare and pharma data. The role will build the pipelines, curated facts and semantic models that feed both AI agents and a knowledge graph.

The project is an emerging AI decision-intelligence platform for pharmaceutical commercial teams, developed for a US healthcare data and analytics company. It turns daily specialty-pharmacy, hub, payer and clinical data into AI-generated recommendations that show why they were made and who acts on them, then measures whether they worked. The role will join a senior Binariks team working alongside the client's product and engineering teams on AWS.

What we are looking for:

• 5+ years in data engineering with a solid track record in client-facing environments

• Strong practical experience architecting and running production environments on Databricks (Delta Lake, Unity Catalog, Workflows)

• Proficiency in Python (PySpark) and advanced SQL for complex data transformations and high-performance querying (PostgreSQL / Amazon RDS)

• Proven hands-on track record building robust batch and streaming architectures on AWS (experience with GCP is also considered)

• Experience defining business metrics, data abstraction layers, or knowledge graph feeds

• Deep understanding of data observability, lineage, metadata management, and data quality tooling

• Familiarity with entity resolution algorithms, record deduplication, and master data management practices

• Strong communication and collaboration skills, with the ability to work effectively within a cross-functional team

• Working proficiency in English (B2)

Your Responsibilities:

• Design, build, and maintain Databricks Lakehouse components using Delta Lake, Unity Catalog, and orchestrated Databricks Workflows

• Develop and optimize both batch and event-driven data pipelines across the AWS ecosystem (S3, AWS Glue, Athena, AWS Lambda, and streaming services)

• Perform robust SQL development and data modelling (including PostgreSQL / Amazon RDS), along with semantic lakehouse modelling for business entities and metrics powering knowledge graphs

• Implement and oversee automated data quality frameworks, data lineage tracking, and governance standards across the platform

• Lead master data management (MDM) initiatives and entity resolution pipelines to consolidate core entities (such as patients, healthcare professionals/HCPs, and healthcare accounts)

Will Be a Plus:

• Familiarity with healthcare standards and terminologies (FHIR, HL7, OMOP, RxNorm, SNOMED)
• Experience in Pharma, Life Sciences, or HealthTech domains