Surgical Video Annotation Program Lead Job Description: Surgical Video Annotation Program Lead (Team Lead) Location: USA (Remote/Hybrid) Type: Full-time Reports to: Head of Delivery / Program Director Role goal: Own end-to-end delivery of a high-throughput, clinically defensible, audit-ready surgical video annotation program—driving automation-first workflows, quality (IRR/QA), and on-time dataset releases. About Us At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology. What you will own Program delivery (E2E): Stand up and run the annotation “factory” from intake → de-ID → task orchestration → annotation → QA/IRR → adjudication → dataset release + evidence pack. Ontology + guidelines execution: Partner with clinical SMEs to operationalize a procedure-specific ontology (phases/steps, tools, anatomy, events) and convert it into clear labeling guidelines and UI rules. Automation-first operations: Drive pre-labeling + verification workflows (not manual-from-scratch), implement routing based on model confidence/uncertainty, and continuously reduce human effort per labeled minute. Quality system: Implement and enforce: Multi-rater sampling strategy IRR reporting by label type (kappa/alpha; IoU/Dice where applicable) Calibration loops and retraining for annotators QA gates + sampling plans with acceptance thresholds Adjudication governance: Run the disagreement workflow, manage escalation to senior annotators/clinical reviewers, track ambiguity categories, and ensure guideline updates close recurring issues. Dataset release management: Own versioning, provenance, and release discipline—ensuring every dataset is reproducible and ships with an audit-ready Evidence Pack (provenance, QA, IRR, adjudication trail, sign-offs). Security + compliance coordination: Ensure labeling operations follow enterprise security requirements (access control, logging, retention, de-identification review) and support audits/vendor risk requests. Client-facing cadence: Lead weekly operating reviews, present throughput/quality metrics, manage scope changes, and ensure PoCs convert into scaled programs. What you will build and run Team: L1 annotators, L2 senior annotators, QA auditors, adjudicators; coordinate with clinical reviewers and ML/data engineering. Operating system: SOPs, training curriculum, calibration playbooks, quality scorecards, escalation paths, and release checklists. Metrics: Throughput, cycle time, rework rate, IRR trends, defect density, acceptance pass rate, cost per labeled hour/minute, and automation leverage (pre-label acceptance rate). Required qualifications 6–10+ years in annotation operations / data operations / QA-led delivery, with at least 2+ years in a lead role managing teams and SLAs. Hands-on experience with video annotation (temporal segmentation + event labeling) and familiarity with bounding boxes/segmentation concepts. Demonstrated ability to implement multi-rater workflows, compute/interpret IRR, and run calibration to improve consistency. Strong program management skills: planning, staffing, throughput modeling, risk management, and stakeholder communication. Comfort working with tooling/APIs and structured data exports; ability to translate guidelines into tool-enforceable rules. Experience in regulated or sensitive-data environments (healthcare preferred): privacy-first mindset, audit trails, process discipline. Preferred qualifications (strong plus) Healthcare domain familiarity: surgical workflows, OR video sources (endoscopy/robotic), common quality issues (smoke, blur, blood occlusion). Experience coordinating de-identification workflows for video/audio and supporting enterprise security reviews (SOC2/ISO-type controls). Exposure to automation/ML-assisted labeling: pre-labeling, confidence routing, active learning basics. Prior work on dataset versioning and “release” discipline (e.g., DVC-like thinking, evidence packs, reproducible builds). Note- Please apply via our official careers portal only, as applications sent directly to executives may not be considered.
Expert Opportunity - Program Manager / PMO Lead ($70/hr, up to $1,400/week)
Ethos
Program Leader - Data and Analytics 2
Genpact
Lead Customer Program Manager
Fictiv
Data Scientist - AI/ML (Remote)
Jobs Ai
Data Engineer
Daimler Truck
Sr Software Engineer
Exo1000exo