ai backend engineer at haystack remote

We are working with a company at the forefront of leveraging artificial intelligence to drive decision-making, automation, and orchestration across its robust platform. This organisation is building the foundational systems that power next-generation AI solutions, impacting production experience through rigorous attention to latency, correctness, reliability, and cost.

The Role

- Build and operate backend systems supporting AI-powered workflows in production<br/>- Design and implement AI orchestration layers connecting models, APIs, and business logic<br/>- Develop inference pipelines for LLM-based and AI-assisted automation systems<br/>- Optimise AI services for latency, throughput, and cost through various techniques<br/>- Design stable service boundaries between backend systems, ML components, and product APIs<br/>- Implement comprehensive observability, including logging, metrics, tracing, and incident response

What You'll Need

- Strong experience in production backend engineering<br/>- Demonstrated experience with Artificial Intelligence (AI) concepts and applications<br/>- Proficiency in building or operating high-throughput, low-latency services<br/>- Familiarity with AI Systems such as LLMs, Embeddings, or AI Workflows<br/>- Experience with distributed systems and production debugging practices<br/>- Strong understanding of APIs, data flows, and system design principles

What's On Offer

- Fully remote position within a global engineering team<br/>- Opportunity to work at the core of an advanced AI stack<br/>- Exposure to cutting-edge AI technologies and distributed systems<br/>- Competitive benefits package including medical, dental, vision, and savings plans

Apply via Haystack today!

Location: Location not specified (Remote)

Remote: Yes