Senior DevOps Engineer (AI/LLM Trainer) - Remote - Latin America

We are looking for a Senior DevOps Engineer to contribute to the development and evaluation of AI training data for a leading expert human data platform for AI agents and LLMs. You’ll work at the intersection of software engineering and artificial intelligence, helping AI labs and companies build better, safer, and more capable models. This includes writing prompts, producing reference-quality code solutions, evaluating model outputs, and providing the structured human signal that makes AI systems smarter. This is not a traditional engineering role, it is a unique opportunity for senior engineers who want to shape how the next generation of AI understands, generates, and reasons about code.

Key Responsibilities:

• Contribute to the development and evaluation of AI training data for AI agents and LLMs.
• Write prompts for AI training and evaluation.
• Produce reference-quality code solutions.
• Evaluate AI model outputs.
• Provide structured human signal to improve AI systems.
• Evaluate AI agent performance on terminal-based tasks.
• Work with tasks including compiling code, running tests, managing environments, and completing multi-step software engineering workflows.
• Write functional and integration tests.
• Help ensure the quality of AI-generated software engineering outputs.

Core Requirements:

• 5+ years of professional software engineering experience in a backend, DevOps, or systems role.
• Strong proficiency in at least one core programming language, ideally Python (open to Rust, Go, and TypeScript as well).
• Hands-on experience with Terminal-Bench, with the ability to evaluate AI agent performance on terminal-based tasks including compiling code, running tests, managing environments, and completing multi-step software engineering workflows.
• Comfortable working with Linux, Docker, Git Internals, and Concurrency command line/terminal, and common development workflows.
• Strong experience writing functional and integration tests. Hands-on practitioners, not reviewers.

Nice-to-Have:

• Experience working on AI, machine learning, or LLM-related projects.
• Familiarity with software quality assurance methodologies or technical evaluation frameworks.
• Experience working with distributed systems or large-scale applications.

Additional Information:

• This is a unique opportunity for senior engineers interested in shaping how the next generation of AI understands, generates, and reasons about code.
• The role sits at the intersection of software engineering and artificial intelligence, helping AI labs and companies build better, safer, and more capable models.
• US Timezone Overlap: 6 hours preferred with PST time zone.

Why Join Kake?

Kake is a remote-first company with a global community, fully believing that it’s not where your table is, but what you bring to the table that matters. We provide top-tier engineering teams to support some of the world’s most innovative companies, and we’ve built a culture where great people stay, grow, and thrive. We’re proud to be more than just a stop along the way in your career - we’re the destination. The icing on the Kake:

💰 Competitive Pay in USD: Work globally, get paid globally.

🌎 Fully Remote: Simply put, we trust you.

💜 Better Me Fund: We invest in your personal growth and passions.

🎂 Compassion is Badass: Join a community that invests in social good.

Please Note: Due to the high volume of applications, only shortlisted candidates will be contacted.