Principal AI Engineer, GenAI Platform Operations
- Salary
- $105K–$181.7K
- Hiring from
- United States
- Work type
- Hybrid
- Posted
625,555 remote jobs, straight from company career pages
100% free · New jobs every minute
Show job descriptionHide job description
At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at jnj.com
As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world. We provide an inclusive work environment where each person is considered as an individual. At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.
Job Function:
Technology Product & Platform ManagementJob Sub Function:
Intelligent Automation EngineeringJob Category:
Scientific/TechnologyAll Job Posting Locations:
Raritan, New Jersey, United States of AmericaJob Description:
We are searching for the best talent for a Principal AI Engineer, GenAI Platform Operations to be located in Raritan, NJ
Principal AI Engineer, GenAI Platform Operations
Job title Principal AI Engineer, GenAI Platform Operations
Category Principal AI Engineer, Functional Engineering (ST7)
Location Raritan, New Jersey, United States of America
Work pattern Hybrid Work
Description
At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at jnj.com
As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world. We provide an inclusive work environment where each person is considered as an individual. At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.
Job Function:
Technology Product & Platform Management
Job Sub Function:
Functional Engineering
Job Category:
Scientific/Technology
All Job Posting Locations:
Raritan, New Jersey, United States of America
Job Description:
At Johnson & Johnson, we believe health is everything. We're tackling the world's toughest health challenges, building a world where complex diseases are prevented and cured, treatments are smarter and less invasive, and solutions are personal. Across Johnson & Johnson Innovative Medicine and Johnson & Johnson MedTech, our work is grounded in a single purpose: changing health for humanity. Johnson & Johnson is ranked #1 in healthcare across S&P 500 companies in the AIDE Institute's AI adoption index, which assesses how AI is applied in practice across workforce, operations and business outcomes, including work in surgical robotics, digital surgery analytics and imaging systems. At J&J, AI accelerates innovation, improves how we operate, and delivers better outcomes for patients.
The Principal AI Engineer, GenAI Platform Operations is the senior technical authority for how agents run on the enterprise GenAI platform: you set the operations strategy and build the capabilities that observe and control agents in production. That platform includes the MCP (Model Context Protocol) Gateway, the agentic runtime, conversational AI and content-generation services, and Enterprise Knowledge Graph and GraphRAG retrieval services, deployed across Microsoft Azure and AWS and relied upon by scientific, commercial, supply chain and manufacturing teams across our segments. As agents move from pilots into production, keeping the platform available is no longer enough: we need to know what every agent is doing, how well it is performing, and how to intervene while it runs. This is a hands-on technical leadership role: you define that strategy and design and build the control capabilities that deliver it: observability and performance telemetry for agents, a map of agent performance and dependencies across the estate, reliability checks carried out by agents rather than by hand, and a runtime control plane that can throttle, pause, roll back or stop an agent, a tool or a model in seconds, including a tested kill switch. You also own agent lifecycle management at runtime, from registration and promotion through versioning, suspension and retirement, and you lead the platform's support and incident management teams. Because this platform supports regulated and patient-adjacent work, these controls are a quality and safety obligation as much as an engineering one, and you will partner closely with Quality and Compliance and with Information Security & Risk Management (ISRM) so that every control is validated, every control action is traceable, and the platform remains inspection-ready.
You lead the GenAI platform support and incident management teams, and you work with the site reliability, operations and platform engineers, setting the technical standards they operate to and mentoring them through the hardest failure modes. You set the runtime readiness criteria every agent must meet before it is promoted to production, and you turn agent performance signals, including quality regressions, failing tools, unreliable dependencies, runaway cost and unsafe behavior, into prioritized input for the Azure and AWS platform engineering, agentic engineering, model engineering, and AI security and governance teams. Guided by Our Credo, you build an inclusive work environment where each person is considered as an individual, diversity and dignity are respected, merit is recognized, and on-call and escalation work is distributed justly and sustainably.
This position will report into the Senior Manager, TS GenAI platform engineering.
Key Responsibilities:
· Define and own the GenAI platform operations strategy and roadmap — the operating model for running agents in production across Azure and AWS, the observability and control capabilities the platform needs, and the sequence for building them — and publish the agent operations review that turns performance, reliability, risk and cost trends into prioritized platform commitments.
· Build the agent observability platform — end-to-end traces across multi-step agent runs, gateway-mediated MCP tool calls, model calls and retrieval, built on OpenTelemetry and its generative AI semantic conventions — and define the instrumentation contract every agent must implement before it reaches production.
· Monitor agent performance in production: task completion, answer quality and groundedness from online evaluation, tool-call and MCP success rates, latency, token use and cost per task, guardrail interventions, and drift or regression against each version's baseline — with SLOs and error budgets set per agent and per risk tier.
· Map agent performance across the estate: an authoritative agent registry linking each agent to its owner, versions, tools, MCP servers, models, data sources and risk tier; dependency maps that show blast radius; and performance scorecards that let consumers and governance compare agents and act on the weakest.
· Agentify reliability checks: design and deploy operations agents that run health checks, synthetic probes, anomaly triage, evidence gathering and first-line remediation, with defined autonomy limits, human approval for consequential actions and complete audit trails — reducing manual toil and time to detect.
· Build the runtime control plane that influences the platform while it runs — kill switches at agent, tool, MCP server, model and platform level; circuit breakers, rate limits, budget caps, throttling and quarantine; and policy enforcement at the gateway — validated under GxP-compliant change control with Quality and Compliance and ISRM, tested regularly, and with every control action recorded as inspection-ready evidence.
· Own agent lifecycle management at runtime: registration and admission, runtime readiness gates, promotion between environments, versioning, canary and shadow releases, automated rollback on regression, suspension, deprecation and retirement — so no agent runs in production without an owner, a version and an off switch.
· Lead the GenAI platform support team for reliability: L1 and L2 intake, triage runbooks, routing and escalation to L3 engineering, response and resolution commitments, knowledge articles and known-error records — feeding recurring issues back to engineering and documentation, SDK and onboarding gaps to the team that owns the developer-facing surface.
· Lead the incident management team: major incident command, severity classification, bridge coordination, stakeholder communication and restoration, using the runtime control plane to contain agent incidents; and chair blameless reviews and problem management until recurring failure modes are engineered out, with corrective actions owned and closed.
· Lead, hire, coach and develop the support, incident management and reliability engineers in an inclusive, Credo-grounded environment — with an equitable, sustainable on-call rotation — and manage the cloud, observability and agent operations vendors and the managed service provider for L1 support.
Qualifications:
· Minimum of 10 years of progressive technology experience, including at least 5 years in enterprise-scale services, and 3 years of formal people leadership managing engineering, operations or support teams.
· Minimum of a Bachelor's degree in Computer Science, Engineering, Information Systems or a related technical discipline; Master's degree preferred.
· Demonstrated experience defining and technically delivering an operations, reliability or observability strategy and roadmap for a platform serving multiple internal consumer teams.
· Track record of designing and building observability platforms — tracing, metrics, logs, alerting and service health reporting — and using that data to drive engineering prioritization.
· Practical experience operating AI, machine learning or LLM-based services in production, including monitoring their quality and performance, not only their availability.
· Experience building runtime controls for production systems, such as feature flags, circuit breakers, rate limiting, traffic management, emergency stop or automated rollback.
· Hands-on operational experience with workloads running on Microsoft Azure and/or AWS, including containerized services and managed data and networking services.
· Experience operating technology in a regulated environment, with working knowledge of GxP change control, computer system validation, and the evidence expected in internal audits or health authority inspections.
· Experience automating operational work at scale, including health checks, triage and auto-remediation, and reducing toil through engineering.
· Demonstrated accountability for a 24x7 production service, including running ITIL-aligned incident and problem management and an L1/L2 support function for a platform serving multiple internal consumer teams.
· Experience building and leading support, incident management or reliability teams, including hiring, coaching, performance management and creating an inclusive environment where each person is considered as an individual.
· Ability to explain agent behavior, risk and control decisions clearly to senior Technology, business, Quality and governance stakeholders, including when an agent must be paused or stopped.
· Willingness to participate in an escalation rotation supporting a 24x7 platform, including runtime control decisions, and to coordinate across global time zones during major incidents.
Required Skills:
· Agent and LLM observability: tracing multi-step agent runs and tool calls with OpenTelemetry, using tooling such as Azure Monitor and Application Insights, Amazon CloudWatch, Grafana, Datadog or Splunk
· Production evaluation of LLM and agent quality, including online evaluation, LLM-as-judge scoring, groundedness and task-success metrics, and drift and regression detection
· Site reliability engineering practice: SLI and SLO definition, error budget management, capacity planning, failure testing and toil reduction
· Incident command and major incident management, including severity models, escalation paths and executive communications
· ITIL-aligned incident, problem and change management and L1/L2 support operations, with hands-on use of an enterprise ITSM platform such as ServiceNow
· Runtime control engineering: kill switches, feature flags, circuit breakers, rate limiting, budget and quota enforcement, traffic shifting and automated rollback
· Agent lifecycle and release engineering: registries, versioning, canary and shadow releases, promotion gates and retirement
· Building operations agents or AI-assisted automation with defined autonomy limits, human-in-the-loop approval and audit trails
· MCP Gateway and API gateway operations, including policy enforcement, authentication and tool-level access control
· Kubernetes and container operations on AKS and/or EKS, including scaling, upgrades, resource governance and production troubleshooting
· Operational depth in Azure and AWS platform services, including identity, networking, private connectivity, and quota and reserved capacity management
· Infrastructure as code and CI/CD for controlled, auditable releases using Terraform, GitHub Actions or Azure DevOps Pipelines
· Production-grade Python or Go for building operational tooling, automation and control services
· GxP change control and validation documentation practice, including traceable approvals and audit evidence for production controls and changes
· People leadership fundamentals: hiring, onboarding, coaching, performance management, equitable workload and on-call design, and building an inclusive team environment consistent with Our Credo
· Contractor, vendor and managed service provider management.
Preferred Skills:
· Experience operating agentic or tool-calling workloads in production, including debugging multi-step agent executions and gateway-mediated MCP tool calls
· Familiarity with Arize, LangSmith and Langfuse
· Familiarity with agent runtimes and frameworks such as Amazon Bedrock AgentCore, Microsoft Foundry Agent Service, LangGraph or Strands Agents
· Experience designing an agent registry, catalog or inventory, including ownership, risk tiering and dependency mapping
· Familiarity with AI risk and governance frameworks such as the NIST AI Risk Management Framework, ISO/IEC 42001 or the EU AI Act, and how they translate into runtime controls
· Chaos engineering and resilience testing, including game days that exercise kill switches and failover
· FinOps for AI workloads, including token and inference cost monitoring, budget enforcement and cost per task
· Experience managing a service desk or L1/L2 function delivered in partnership with a managed service provider
· Healthcare, pharmaceutical or medical device industry experience, with familiarity with 21 CFR Part 11, EU Annex 11 and Computer Software Assurance approaches
· Relevant certifications such as Azure or AWS professional-level certifications, Certified Kubernetes Administrator, or ITIL 4
#JNJTECH
Johnson & Johnson is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, protected veteran status or other characteristics protected by federal, state or local law. We actively seek qualified candidates who are protected veterans and individuals with disabilities as defined under VEVRAA and Section 503 of the Rehabilitation Act.
Johnson & Johnson is committed to providing an interview process that is inclusive of our applicants’ needs. If you are an individual with a disability and would like to request an accommodation, external applicants please contact us via https://www.jnj.com/contact-us/careers , internal employees contact AskGS to be directed to your accommodation resource.
Required Skills:
Preferred Skills:
Advanced Analytics, AI Judgement Integration, Coaching, Computer Programming, Critical Thinking, Human-Computer Interaction (HCI), Industry Analysis, Innovation, Manufacturing Technologies, Organizing, Presentation Design, Problem Solving, Prototyping, Quality Assurance (QA), Robotic Automation, Science, Technology, Engineering, and Math (STEM) Application, Software Development Management, Solution Architecture, Technical Credibility, Technical WritingThe anticipated base pay range for this position is :
$105,000 - $181,700Additional Description for Pay Transparency:
Subject to the terms of their respective plans, employees and/or eligible dependents are eligible to participate in the following Company sponsored employee benefit programs: medical, dental, vision, life insurance, short- and long-term disability, business accident insurance, and group legal insurance. Subject to the terms of their respective plans, employees are eligible to participate in the Company’s consolidated retirement plan (pension) and savings plan (401(k)). Subject to the terms of their respective policies and date of hire, Employees are eligible for the following time off benefits: Vacation –120 hours per calendar year Sick time - 40 hours per calendar year; for employees who reside in the State of Washington –56 hours per calendar year Holiday pay, including Floating Holidays –13 days per calendar year Work, Personal and Family Time - up to 40 hours per calendar year Parental Leave – 480 hours within one year of the birth/adoption/foster care of a child Condolence Leave – 30 days for an immediate family member: 5 days for an extended family member Caregiver Leave – 10 days Volunteer Leave – 4 days Military Spouse Time-Off – 80 hours Additional information can be found through the link below. https://www.careers.jnj.com/employee-benefitsAbout Us
At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at https://www.jnj.com/.
Our Credo calls on us to respect the dignity of every individual and create an environment for all people to thrive. Throughout the recruitment process - from application through hiring - we are committed to providing reasonable accommodations/adjustments for qualified candidates with disabilities. If you need support at any stage of the recruitment process, please complete our candidate accommodation request form so we can assist you.
