Senior AI DevOps Engineer

We’re hiring a Senior AI DevOps Engineer in Austin, Texas to build and run generative AI applications for an enterprise financial services client. If you’re a DevOps, platform or cloud engineer who has started shipping LLM features, this role uses both skills. You’ll write backend services, connect them to models like Claude, and own the AWS infrastructure they run on.

Location: Austin, TX (hybrid)
Job type: Full-time
Salary: $114,000 – $123,500 per year
Experience: 6+ years

What you’ll do

• Build production AI applications and agentic workflows using LLM APIs (Anthropic Claude, OpenAI, AWS Bedrock), including RAG pipelines, tool calling and custom guardrails
• Write backend microservices in .NET/C# (or Java), with Python for model integration and data orchestration
• Build CI/CD pipelines with GitHub Actions and run containerized workloads on Amazon EKS (Kubernetes)
• Manage AWS environments as code with Terraform
• Set up monitoring, security controls and cost tracking, including LLM token optimization

What we’re looking for

• 6+ years of hands-on DevOps or cloud engineering on AWS: Kubernetes (EKS), Terraform and GitHub Actions
• Strong skills in .NET/C# or Java, including packaging, containerization and backend integration
• Experience deploying generative AI in production: LLM APIs, RAG pipelines, prompt frameworks, model serving
• Python and shell scripting for automation and AI integrations
• A focus on security, secrets management, cloud cost control, latency and observability

Nice to have

• Multi-step tool-calling agents and the Claude API
• Vector databases (Pinecone, pgvector, OpenSearch) or AWS Bedrock
• Financial services or other regulated-industry experience
• AWS Solutions Architect or DevOps Engineer certification

• Work on live, mission-critical generative AI projects for top enterprise clients
• Full-stack ownership, from backend architecture to cloud runtime
• Small, collaborative teams and open communication with leadership
• Unlimited PTO, medical, dental and vision coverage, disability and life insurance, mental health support, annual bonus, ESPP, mentorship and generous parental leave

How to apply: Send your resume and a line or two about the most interesting system you’ve deployed. A GitHub or LinkedIn link is enough.

We are an equal opportunity employer. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status or any other protected characteristic.