Senior AIOps Reliability Engineer
- Salary
- $114K–$253K
- Hiring from
- United States
- Work type
- Hybrid
- Posted
626,343 remote jobs, straight from company career pages
100% free · New jobs every minute
Show job descriptionHide job description
In your career, let’s prove what’s possible.
At Lam Research, we create equipment that drives technological advancements in the semiconductor industry. Our innovative solutions enable chipmakers to power progress in nearly all aspects of modern life, and it takes each member of our team to make it possible.
Across our organization, our employees come to work and change the world. We take on the toughest challenges with precision and accuracy. We push for the next big semiconductor breakthrough. We lead the way in one of the most critical and fast-moving industries on the planet. And we do it together, with deep connections and limitless collaboration.
The impact we have on the world is made possible by focusing on our people. So we recognize and celebrate our teams’ achievements. We strive to create an inclusive and diverse culture where everyone’s contribution and voice has value. We evaluate and evolve our offerings, so our people receive the support and empowerment to do meaningful things for their lives, careers, and communities.
Because at Lam, we believe that when people are the priority and they’re inspired to unleash the power of innovation for a better world together, anything is possible.
The group you’ll be a part of
The Global Information Systems Group is dedicated to the success of Lam through providing best-in-class and innovative information system solutions and services. Together, we support users globally with data, information, and systems to achieve their business objectives.
The impact you’ll make
You will design and ship LLM-based agents, retrieval-augmented knowledge pipelines, and machine-learning anomaly detection that find, triage, and remediate incidents across public cloud, private cloud, and on-premises data centers, all resting on strong SRE and network engineering fundamentals.
Our environment spans Azure, AWS, and Google Cloud alongside on-premises data centers, colocation sites, and manufacturing and HPC facilities, so cloud-agnostic design and hybrid network fluency matter more than depth in any single provider. This is a deep individual-contributor role: you will write the code, instrument the telemetry, tune the models, and own the reliability of both the infrastructure and the AI systems operating on it.
What you’ll do
AI and Agentic Operations
- Build agentic AI workflows using LLM agents, tool and function calling, and orchestration frameworks such as LangGraph, Semantic Kernel, AutoGen, or the Model Context Protocol, applied to autonomous fault detection, triage, and remediation.
- Develop the AIOps intelligence layer: time-series anomaly detection, dynamic baselining, alert deduplication and correlation, event clustering, and predictive failure and capacity forecasting across infrastructure, network, and application telemetry from both cloud and on-premises sources.
- Engineer the retrieval knowledge fabric by chunking, embedding, and indexing runbooks, post-mortems, architecture documents, CMDB and ServiceNow records into a vector store, then tuning retrieval quality against measurable evaluations.
- Ship AI-assisted incident response: automated summarization, root-cause hypothesis generation, blast-radius analysis, and telemetry-grounded draft post-mortems wired into the paging and ITSM toolchain.
- Automate remediation safely through event-driven pipelines and configuration-management runbooks invoked by agents, with human-in-the-loop approval gates, scoped least-privilege boundaries, rollback paths, and complete audit trails for every autonomous action.
- Own AI safety and governance in production: guardrails, prompt-injection defense, hallucination and drift monitoring, PII redaction, and evaluation harnesses that gate every model or prompt change.
- Run LLMOps and MLOps, covering prompt and model versioning, offline and online evaluation, shadow and A/B testing, inference logging, token cost and latency observability, and CI/CD for every AI component.
- Instrument AI systems as first-class services with OpenTelemetry GenAI tracing, model SLOs, and quality, cost, and latency dashboards for every agent in production.
What you'll do (continued)
Reliability, Observability, and Hybrid Networking
- Define and operate SLIs, SLOs, and error budgets across cloud services, on-premises systems, network paths, and AI services, driving burn-rate alerting and reliability work from the data.
- Build observability pipelines that unify cloud-native monitoring, Prometheus and Grafana, OpenTelemetry collectors, log analytics platforms, synthetic monitoring, and paging tools into a single stack an agent can query.
- Instrument cloud network telemetry: virtual network and VPC flow logs, transit and hub routing, load balancer and DNS health, private connectivity endpoints, and inter-region path analysis, with machine-learning traffic anomaly detection.
- Instrument on-premises and hybrid network telemetry: NetFlow, sFlow, IPFIX, SNMP, and streaming telemetry from campus, data center, and WAN devices, plus BGP and OSPF routing health, MPLS and SD-WAN circuits, firewalls, load balancers, DNS and DHCP, and wireless infrastructure.
- Monitor the hybrid interconnect end to end, including ExpressRoute, Direct Connect, Cloud Interconnect, and site-to-site VPN circuits, with synthetic path testing and latency, loss, and jitter baselines between data centers, fabs, and cloud regions.
- Automate away toil with event-driven self-healing, remediation playbooks, and infrastructure-as-code modules that measurably reduce detection and recovery times across both estates.
- Support disaster recovery and business continuity execution: multi-region and data-center failover validation, DNS and traffic-manager failover, replication health, and periodic drills scored against RTO and RPO targets, including recovery of AI and vector-store assets.
- Validate backup and restore across cloud and on-premises workloads through automated restore testing, cross-site and cross-region copy verification, and immutability and retention checks.
- Respond to P1, P2, and P3 incidents as a senior technical responder, lead blameless post-mortems, and drive action items to closure.
- Set technical direction through design reviews, coding standards, and mentoring for engineers adopting AI-assisted operations. This role leads through influence and has no direct reports.
Who we’re looking for
- BS, MS, or PhD in Computer Science, Engineering, or a related field, or equivalent practical experience.
- Eight or more years in SRE, DevOps, infrastructure, observability, network engineering, or platform engineering, with a track record of shipping production systems yourself.
- Production experience with LLM applications: prompt engineering, retrieval-augmented generation, embeddings and vector databases, function and tool calling, and agent orchestration.
- Practical use of machine learning for anomaly detection, forecasting, event correlation, and alert noise reduction on real operational telemetry.
- Experience deploying and operating production AI platforms.
- Hands-on production experience with at least one major public cloud and the ability to design portable, cloud-agnostic patterns across the others, covering identity and access boundaries, compute, storage, managed databases, serverless functions, and event services.
- Solid on-premises infrastructure background across virtualization, storage, data-center operations, and private cloud platforms.
- Strong networking fundamentals spanning both worlds: TCP/IP, BGP and OSPF, VLANs and overlays such as VXLAN and EVPN, MPLS and SD-WAN, firewalls, load balancers, DNS, and cloud virtual network, VPC, and transit routing constructs.
- Strong Python, with Go as a plus, for tooling, automation, data pipelines, and AI integrations.
- Deep hands-on experience with OpenTelemetry and metrics, logs, and traces pipelines, plus at least two of Prometheus, Grafana, Datadog, Splunk, Elastic, SolarWinds, or ThousandEyes.
- Proven experience defining SLIs and SLOs and managing error budgets in production.
- Terraform, Ansible, CI/CD, and Kubernetes in production, on managed cloud services and on self-managed on-premises clusters.
- Hands-on failover testing, RTO and RPO validation, and backup restore verification across cloud and on-premises environments.
- P1, P2, and P3 incident management with ITSM integration, ServiceNow preferred, including automated ticket enrichment.
- Awareness of responsible-AI practice: PII handling, model risk, evaluation, and auditability under frameworks such as the NIST AI Risk Management Framework and ISO/IEC 42001.
- The ability to explain AI capability, limits, and risk clearly to engineers, product partners, and executives.
Preferred qualifications
- You have taken an operations workflow from AI-assisted to safely AI-autonomous, with a measured reduction in mean time to recovery.
- AI-assisted network fault detection, anomaly correlation, and auto-remediation across hybrid network estates.
- Evaluation harnesses, golden datasets, and regression suites built for agent and retrieval quality.
- Fine-tuning, distillation, or small-language-model deployment for domain-specific operations use cases, including private or air-gapped inference.
- Real-time telemetry pipelines using Kafka, event streaming, or Flink feeding machine-learning inference at scale.
- Network automation and source-of-truth tooling such as NetBox, Nautobot, Batfish, or intent-based verification.
- Contributions to OpenTelemetry, Prometheus, LangGraph, or other open source observability and AI projects.
- Global WAN resilience strategies for multi-region and multi-site enterprise environments.
- Compliance-driven disaster recovery and business continuity programs covering InfoSec audits, SOX, and ISO 22301.
- Cost observability across clouds and data centers, including egress and circuit optimization and LLM token and inference cost control.
- Cloud and networking certifications, for example Azure AZ-700 or AZ-305, AWS ANS-C01 or SAP-C02, Google Professional Cloud Network Engineer or Architect, CCNP or CCIE, and AI certifications such as Azure AI-102 or AWS MLA-C01.
- HPC, GPU cluster operations, semiconductor manufacturing IT, or other latency-sensitive on-premises environments.
Our commitment
We believe it is important for every person to feel valued, included, and empowered to achieve their full potential. By bringing unique individuals and viewpoints together, we achieve extraordinary results.
Lam Research ("Lam" or the "Company") is an equal opportunity employer. Lam is committed to and reaffirms support of equal opportunity in employment and non-discrimination in employment policies, practices and procedures on the basis of race, religious creed, color, national origin, ancestry, physical disability, mental disability, medical condition, genetic information, marital status, sex (including pregnancy, childbirth and related medical conditions), gender, gender identity, gender expression, age, sexual orientation, or military and veteran status or any other category protected by applicable federal, state, or local laws. It is the Company's intention to comply with all applicable laws and regulations. Company policy prohibits unlawful discrimination against applicants or employees.
Lam offers a variety of work location models based on the needs of each role. Our hybrid roles combine the benefits of on-site collaboration with colleagues and the flexibility to work remotely and fall into two categories – On-site Flex and Virtual Flex. ‘On-site Flex’ you’ll work 3+ days per week on-site at a Lam or customer/supplier location, with the opportunity to work remotely for the balance of the week. ‘Virtual Flex’ you’ll work 1-2 days per week on-site at a Lam or customer/supplier location, and remotely the rest of the time.
Salary
CA San Francisco Bay Area Salary Range for this position: $114,000.00 - $253,000.00.
The above salary range for this position is relevant to applicants that reside or work onsite in the California, San Francisco Bay Area only. Salary offers will depend on factors that include the location you work from, your level, education, training, specific skills, years of experience and comparison to other employees already in this role. Actual salary may vary from salary offered due to numerous factors including but not limited to unpaid time off, unpaid leave, company mandated shutdown, and other relevant factors.
Our Perks and Benefits
At Lam, our people make amazing things possible. That’s why we invest in you throughout the phases of your life with a comprehensive set of outstanding benefits.
Discover more at Lam Benefits