LLM Dev Analyst

LLM Dev Analyst Leadtech Group builds and scales digital products used by millions of people worldwide . With over 18 years of experience , we bring together multidisciplinary teams to turn ideas into meaningful, high-impact solutions. Within the group, MAU by Leadtech focuses on subscription-based apps and digital products. It builds on the expertise, technology and product mindset developed at Leadtech, combining proven experience with a strong focus on user value and long-term growth. Across both brands, we share the same approach: a deep commitment to understanding people and creating experiences that make a difference — for our users and for our teams. We work as a remote-first, international team, where flexibility and collaboration shape how we build, learn and move forward together. Our environment brings together experienced professionals across product, tech, data and design, all driven by curiosity, ownership and continuous improvement. If you’re looking to contribute to products with real impact and grow alongside a team that values how things are built as much as what is built, we’d love to meet you. The role We are looking for a highly skilled LLM Dev Analyst to design, build, and scale intelligent agents within our Databricks ecosystem, redefining how data is accessed, interpreted, and activated across the organization. In this role, you will operate at the intersection of AI engineering, analytics, and data platforms, developing domain-specific agents that automate and augment decision-making across key business areas including A/B testing, marketing performance, data engineering workflows, and MarTech processes. You will translate complex business challenges into agent-driven solutions powered by Large Language Models (LLMs), leveraging both structured and unstructured data to deliver real-time insights and automation at scale. As a core contributor to our next-generation data stack, you will define and implement best practices for agent architecture, prompt engineering, evaluation frameworks, and orchestration within Databricks, ensuring production-grade reliability and business impact. Key Responsibilities 1. Agent Design & Development Design, build, and deploy LLM-powered agents for multiple business domains (A/B testing, marketing analytics, data engineering automation, MarTech workflows) Develop multi-step reasoning agents that integrate with internal data systems, APIs, and tools Implement RAG architectures to enable agents to leverage enterprise data effectively 2. Databricks & Data Integration Integrate LLM agents within the Databricks lakehouse architecture Build scalable pipelines using PySpark, SQL, and Databricks workflows Enable seamless interaction between agents and data warehouses, event streams, and APIs 3. Prompt Engineering & Evaluation Design and optimize prompts, tools, and agent workflows for accuracy and performance Develop evaluation frameworks to measure agent quality, reliability, and business impact Implement strategies to reduce hallucinations and improve response consistency 4. Automation & Use Case Delivery Build agents that automate: Experimentation analysis (A/B testing insights) Marketing performance reporting and optimization Data Engineering workflows and monitoring MarTech processes and campaign operations Deliver solutions that drive measurable efficiency gains and decision velocity 5. Productionization & Reliability Productionize agent systems with monitoring, logging, and observability Implement guardrails, security controls, and governance frameworks Ensure scalability, latency optimization, and cost efficiency 6. Cross-Functional Collaboration Partner with Data Engineering, Analytics, Marketing, and Product teams Translate business requirements into scalable AI solutions Communicate insights and capabilities to both technical and non-technical stakeholders Requirements Must-Have Qualifications Proven experience building applications with Large Language Models (LLMs) Strong expertise in prompt engineering, RAG architectures, and agent frameworks (e.g., LangChain, LlamaIndex) Experience with Databricks/Snowflake/GCP, including PySpark and SQL Strong proficiency in Python Solid understanding of analytics use cases such as A/B testing, marketing performance, or data workflows Experience implementing LLM evaluation, monitoring, and guardrails Strong problem-solving skills with the ability to translate business needs into technical solutions Nice-to-Have Qualifications Experience with vector databases (e.g., Pinecone, FAISS, Weaviate) Familiarity with open-source LLM deployment and optimization (Hugging Face, vLLM, etc.) Knowledge of MLOps practices, CI/CD, and scalable infrastructure (Docker, Kubernetes) Experience with MarTech tools (GA4, AppsFlyer, Segment, Braze, Amplitude) Strong background in experimentation frameworks, causal inference, or incrementality Experience designing multi-agent systems or autonomous workflows Understanding of AI product design and human-in-the-loop systems What We’re Looking For A builder mindset with a passion for applied AI and automation Ability to operate in ambiguous, fast-paced environments Strong ownership and accountability for end-to-end delivery Curiosity to explore and implement cutting-edge AI capabilities A pragmatic approach to balancing innovation with reliability Benefits Why should you join us? Growth and career development At Leadtech, we prioritize your growth. Enjoy a flexible career path with personalized internal training and an annual budget for external learning opportunities. Work-Life balance Benefit from a flexible start and end times and the option of working full remote or from our Barcelona office. Enjoy free Friday afternoons with a 7-hour workday, plus a 35-hour workweek in July and August so you can savor summer! Comprehensive benefits Competitive salary, full-time permanent contract, and top-tier private health insurance (including dental and psychological services). 25 days of vacation plus your birthday off, with flexible vacation options—no blackout days! Unique Perks If you wish to come, in our office in Barcelona you’ll find it complete with free coffee, fresh fruit, snacks, a game room, and a rooftop terrace with stunning Mediterranean views. Additional benefits include ticket restaurant and nursery vouchers, paid directly from your gross salary. Join us in an environment where you’re free to innovate, learn, and grow alongside passionate professionals. At Leadtech, you’ll tackle exciting challenges and be part of a vibrant team dedicated to delivering exceptional user experiences Equal Employment Opportunity Employer: Leadtech is an Equal Employment Opportunity (EEO) Employer, which means we encourage applications from people with different backgrounds, interests, and personal circumstances. Our team welcomes applicants regardless of their race, gender, age, religion, nationality, sexual orientation, and/or disabilities. All we need is your high energy, skills, and willingness to be a part of a great project! Location You'll have the flexibility to choose whether you'd like to come to the office every day, from time to time, or work fully remote. We want you to find the best combination for you. If you prefer to be surrounded with amazing people, our exceptional office is in Barcelona’s Blue Building, located right on the city's seafront. Besides our stunning views, you’ll enjoy our office perks such as free fruit, snacks, and coffee and you’ll also be able to take part in our Mario Kart and table tennis competitions. The personal data you provide will be processed in order to manage your candidacy for the corporate selection processes that fit your profile. If you wish, you can exercise your rights of access, rectification or cancellation by writing to our address (Avenida Litoral, 12-14, 5ta planta. Barcelona. 08005) or to the email address [email protected] . #MAU Department DATA AND BUSINESS INTELLIGENCE Remote status Fully Remote Employment type Full-time Subdivision DBI - BUSINESS INTELLIGENCE & ANALYTICS