AI Engineer – LLMOps & Azure
- Hiring from
- Belgium
- Work type
- Hybrid
- Posted
624,651 remote jobs, straight from company career pages
100% free · New jobs every minute
Show job descriptionHide job description
Our client, a leading organization in the transport sector, is looking for a specialist to manage the operational phase of its AI-driven services. This role focuses on maintaining the reliability, performance, and security of production-scale AI agents and retrieval-based systems.
Responsibilities
Responsibilities
- Monitor production AI services for availability and latency while managing incident root-cause analysis and resolution.
- Maintain evaluation sets and track answer quality to detect and mitigate performance regressions.
- Operate ingestion pipelines and manage the integration of new content sources and business domains.
- Oversee agent interactions and monitor tool calls to ensure seamless integration with business systems.
- Manage model version upgrades and configuration changes through validated deployment pipelines.
- Track token consumption and service costs to propose architectural and operational optimizations.
- Maintain infrastructure consistency using Terraform and Helm across multiple environments.
- 3+ years of experience in AI development using Python and LangChain.
- 3+ years of experience with Azure services, specifically Azure OpenAI, Azure AI Search, and Azure API Management.
- 3+ years of experience managing containerized environments using Azure Kubernetes Service (AKS).
- 3+ years of experience in Infrastructure as Code with Terraform and Helm.
- Proven track record of operating RAG systems or AI agents in a production setting.
- Hands-on experience with MLflow, Databricks, or OpenTelemetry for monitoring and tracing.
- Practical knowledge of Azure DevOps for CI/CD pipeline management.
- Experience with Vector databases and data ingestion workflows.
- Proactive and analytical approach to troubleshooting complex technical issues.
- You are fluent in English with a level of Native Dutch or Native French.
- Experience with data protection impact assessments and access control logic.
- Understanding of prompt engineering best practices for production reliability.
- Start date: 04/01/2027.
- Duration: 12 months.
- Work regime: Full-time.
- Location: Brussels.
- Working model: Hybrid (2 to 3 days per week onsite).
- Contract: open to both permanent employees and freelancers.
