Lead Backend & Data Engineer

Lead Backend & Data Engineer It’s your career – make it matter Apply now This is us At Avenga, we believe that human creativity empowers technology that matters. Operating globally, our 6000+ specialists provide a full spectrum of services, including business and tech advisory, enterprise solutions, CX, UX and Ul design, managed services, product development, and software development. This is the job We are looking for a Lead Backend & Data Engineer to join an innovative AI initiative focused on building a highly deterministic, zero-hallucination Dual-Engine Retrieval-Augmented Generation (RAG) platform. This is you Extensive experience with Python and modern backend development. Deep expertise in Apache Beam and distributed data processing concepts, including windowing, watermarks, and idempotent writes. Strong experience with Google Cloud Spanner or another distributed SQL database. Working knowledge of graph query languages such as ISO GQL , Cypher , or Gremlin . Advanced proficiency in asynchronous Python development using FastAPI and Pydantic . Hands-on experience with workflow orchestration platforms such as Temporal or Cadence . Strong understanding of deterministic workflow execution and separating non-deterministic operations into Activities. Experience implementing retries, compensation logic, and state management in distributed systems. Solid understanding of distributed systems architecture and cloud-native application design. Strong problem-solving skills with the ability to drive technical decisions. Upper-Intermediate or higher level of English. This is your role Design, build, and optimize Apache Beam data ingestion pipelines running on multiple execution engines such as Dataflow and Flink. Structure and optimize multi-hop graph queries using ISO GQL to trace physical and logical data provenance. Develop scalable backend services using FastAPI and optimize Google Cloud Spanner performance through advanced gRPC connection pooling. Define robust API contracts with Pydantic to support seamless integration with downstream AI orchestration frameworks such as LangChain and LangGraph. Design backend architectures that efficiently separate synchronous request handling from long-running asynchronous processing. Develop and maintain Workflow Definitions, Activity Definitions, and Temporal clients using the Temporal Python SDK. Deploy and manage a horizontally scalable fleet of Temporal Workers responsible for complex database operations and AI routing logic. Implement resilient distributed workflows with automated retries, compensation mechanisms, and reliable state management. Collaborate closely with AI, Platform, and Data Engineering teams to deliver scalable, production-ready solutions. Contribute to architectural decisions, code reviews, and engineering best practices while ensuring high standards of performance, reliability, and maintainability. What awaits you at Avenga? Through our values, Better Minds, Bolder Ideas, and Bigger Hearts, we strive to provide you with the tools, autonomy, trust, and assistance you need to excel. Enjoy benefits like private health insurance, well-being programs, flexible and hybrid work models, laptops and gear, training, language classes, social events, great offices, and more. At Avenga, everyone matters. We provide equal opportunities in recruitment, career development, and leadership, regardless of race, ethnicity, gender identity, sexual orientation, disability, age, religion, or any other characteristic. We are committed to fostering a work environment where our diverse community of employees, candidates, and business partners actively shapes our growth. By bringing together people from different backgrounds and experiences, we build a workplace where everyone feels free to be themselves while honoring the boundaries of others. Locations Sofia Remote status Hybrid Technology Data Engineering Seniority Senior-level Your way in starts here APPLICATION Send us your application, we are ready to hear your story and explore how we can grow together. REVIEW Our team carefully reviews every application with curiosity and care. If your profile isn’t the right fit today, we will keep it in mind for future opportunities that match your skills and ambitions. TALENT ACQUISITION INTERVIEW You will meet our Talent team to talk about your goals and learn more about who we are, what we offer, and how we support our people. TECHNICAL INTERVIEW Our tech interview is all about diving deeper into your expertise and understanding your strengths, how you solve problems, and how you think – no trick questions, just a meaningful conversation. CUSTOMER INTERVIEW For some roles, especially when our clients are closely involved, you might also have a conversation with them – it’s a chance for everyone to align and get to know each other better. JOB OFFER If we both feel it’s the right match, we will send you an offer to join us. And even if it’s not the time just yet, you’ll always hear back from us. WELCOME! Your new team is excited to meet you, support you, and build something great together. Let’s make your first day the start of a journey that shapes a career that matters.