Skopje, Ohrid, Bitola
Job ad title for career site
The place where impact matters
This is us
At Avenga, we believe that human creativity empowers technology that matters. Operating globally, our 6000+ specialists provide a full spectrum of services, including business and tech advisory, enterprise solutions, CX, UX and Ul design, managed services, product development, and software development.
This is the job
You'll be working on the core engine of a production AI assistant, developing Agentic AI solutions using RAG and LLM orchestration to enable the assistant to move beyond answering questions and safely execute real customer requests.
This is you
- 3+ years building production Python services (async, API design)
- Experience designing and building REST APIs (and consuming them); comfortable with request/response modelling, auth, and versioning
- Hands-on experience building RAG / retrieval-augmented generation systems: not just calling an LLM API, but chunking, retrieval, and grounding answers in sources
- Experience with any vector database (e.g. Milvus, Pinecone, Weaviate, Qdrant, pgvector) and an understanding of embeddings and similarity search
- Worked with an LLM provider (OpenAI / Azure OpenAI / Anthropic / open models) in production
- A habit of evaluating output quality, you can explain how you measured whether a RAG system was good
- Writes automated tests as a matter of habit unit and integration testing with pytest (mocking, fixtures) Comfortable with GitHub in a team workflow, feature branches, pull requests, and code review
Nice-to-have Skills:
- LlamaIndex (or LangChain) framework experience
- Milvus specifically
- Azure OpenAI deployments
- LLM observability / tracing (Langfuse, LangSmith, OpenInference) FastAPI, Pydantic
- WebSocket / streaming APIs for real-time chat responses
- API tooling and testing: Bruno / Postman, OpenAPI/Swagger; API gateways
- Async & parallel testing and mocking AWS
- Modern Python tooling: uv, ruff, ty/mypy, pre-commit
- CI/CD with GitHub Actions, and trunk-based development with Conventional Commits
- AWS (ECS/Fargate, Secrets Manager), Terraform, Docker
- Multilingual NLP (Dutch/English)
What awaits you at Avenga?
At Avenga, everyone matters. We provide equal opportunities in recruitment, career development, and leadership, regardless of race, ethnicity, gender identity, sexual orientation, disability, age, religion, or any other characteristic. We are committed to fostering a work environment where our diverse community of employees, candidates, and business partners actively shapes our growth. By bringing together people from different backgrounds and experiences, we build a workplace where everyone feels free to be themselves while honoring the boundaries of others.
Locations Skopje, Ohrid, Bitola Remote status Hybrid Technology AI Seniority Senior-level
Your way in starts here
APPLICATION
Send us your application, we are ready to hear your story and explore how we can grow together.
REVIEW
Our team carefully reviews every application with curiosity and care. If your profile isn’t the right fit today, we will keep it in mind for future opportunities that match your skills and ambitions.
TALENT ACQUISITION INTERVIEW
You will meet our Talent team to talk about your goals and learn more about who we are, what we offer, and how we support our people.
TECHNICAL INTERVIEW
Our tech interview is all about diving deeper into your expertise and understanding your strengths, how you solve problems, and how you think – no trick questions, just a meaningful conversation.
CUSTOMER INTERVIEW
For some roles, especially when our clients are closely involved, you might also have a conversation with them – it’s a chance for everyone to align and get to know each other better.
JOB OFFER
If we both feel it’s the right match, we will send you an offer to join us. And even if it’s not the time just yet, you’ll always hear back from us.
WELCOME!
Your new team is excited to meet you, support you, and build something great together. Let’s make your first day the start of a journey that shapes a career that matters.
jobs--overlay#unobserveClickOutside common--modal:closed->jobs--overlay#observeClickOutside " data-jobs--overlay-overlay-value="false" data-jobs--overlay-overlay-class="!fixed flex flex-col inset-0 rounded-t-6 shadow-job-form-overlay z-career-job-application-form-overlay" data-jobs--overlay-minimize-button-hidden-class="hidden" data-careersite--jobs--form-overlay-target="form" style="--topOffset: 40px; --overlayDuration: 300ms;">
Skopje, Ohrid, Bitola
Job ad title for career site
The place where impact matters
Loading application form
This is us
At Avenga, we believe that human creativity empowers technology that matters. Operating globally, our 6000+ specialists provide a full spectrum of services, including business and tech advisory, enterprise solutions, CX, UX and Ul design, managed services, product development, and software development.
This is the job
You'll be working on the core engine of a production AI assistant, developing Agentic AI solutions using RAG and LLM orchestration to enable the assistant to move beyond answering questions and safely execute real customer requests.
This is you
- 3+ years building production Python services (async, API design)
- Experience designing and building REST APIs (and consuming them); comfortable with request/response modelling, auth, and versioning
- Hands-on experience building RAG / retrieval-augmented generation systems: not just calling an LLM API, but chunking, retrieval, and grounding answers in sources
- Experience with any vector database (e.g. Milvus, Pinecone, Weaviate, Qdrant, pgvector) and an understanding of embeddings and similarity search
- Worked with an LLM provider (OpenAI / Azure OpenAI / Anthropic / open models) in production
- A habit of evaluating output quality, you can explain how you measured whether a RAG system was good
- Writes automated tests as a matter of habit unit and integration testing with pytest (mocking, fixtures) Comfortable with GitHub in a team workflow, feature branches, pull requests, and code review
Nice-to-have Skills:
- LlamaIndex (or LangChain) framework experience
- Milvus specifically
- Azure OpenAI deployments
- LLM observability / tracing (Langfuse, LangSmith, OpenInference) FastAPI, Pydantic
- WebSocket / streaming APIs for real-time chat responses
- API tooling and testing: Bruno / Postman, OpenAPI/Swagger; API gateways
- Async & parallel testing and mocking AWS
- Modern Python tooling: uv, ruff, ty/mypy, pre-commit
- CI/CD with GitHub Actions, and trunk-based development with Conventional Commits
- AWS (ECS/Fargate, Secrets Manager), Terraform, Docker
- Multilingual NLP (Dutch/English)
What awaits you at Avenga?
At Avenga, everyone matters. We provide equal opportunities in recruitment, career development, and leadership, regardless of race, ethnicity, gender identity, sexual orientation, disability, age, religion, or any other characteristic. We are committed to fostering a work environment where our diverse community of employees, candidates, and business partners actively shapes our growth. By bringing together people from different backgrounds and experiences, we build a workplace where everyone feels free to be themselves while honoring the boundaries of others.
Send us your application, we are ready to hear your story and explore how we can grow together.
Our team carefully reviews every application with curiosity and care. If your profile isn’t the right fit today, we will keep it in mind for future opportunities that match your skills and ambitions.
You will meet our Talent team to talk about your goals and learn more about who we are, what we offer, and how we support our people.
Our tech interview is all about diving deeper into your expertise and understanding your strengths, how you solve problems, and how you think – no trick questions, just a meaningful conversation.
For some roles, especially when our clients are closely involved, you might also have a conversation with them – it’s a chance for everyone to align and get to know each other better.
If we both feel it’s the right match, we will send you an offer to join us. And even if it’s not the time just yet, you’ll always hear back from us.
Your new team is excited to meet you, support you, and build something great together. Let’s make your first day the start of a journey that shapes a career that matters.