Accenture logo

Generative AI & LLM Architecture Manager

Hiring from
Costa Rica
Work type
Hybrid
Posted

626,802 remote jobs, straight from company career pages

100% free · New jobs every minute

Show job description

Accenture helps the world’s leading enterprises reinvent by building their digital core and unleashing the power of AI to create value at speed for organizations across industries. Our strategy is to be the reinvention partner of choice for our clients and lead in the safe, widespread adoption of AI, and to be the most client-focused, AI-enabled, great place to work in the world. We bring together the talent of our approximately 799,000 people with proprietary assets and platforms, deep process and industry expertise, and leading ecosystem relationships to deliver end-to-end solutions and measurable outcomes at scale. Through our Reinvention Services, we offer broad expertise across Cybersecurity, Digital Core, Finance, Industry and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve approximately 9,000 clients and generated approximately $70 billion in FY25 revenue. Visit us at accenture.com.


About the role


We are looking for an experienced Generative AI & LLM Architecture Manager to define and lead the implementation of scalable Artificial Intelligence solutions.

In this role, you will shape enterprise AI architecture with a strong focus on Generative AI, Large Language Models and multimodal solutions. You will lead multidisciplinary teams and guide initiatives from early-stage prototypes to secure, reliable and production-ready platforms.

This opportunity is ideal for a senior technology leader who combines hands-on architectural expertise with strong stakeholder management, delivery leadership and the ability to translate complex technical decisions into clear business outcomes.


Key responsibilities

  • Define and evolve enterprise AI architecture blueprints covering LLMs, multimodal models, data platforms, security, governance and operations.
  • Evaluate technology options and make architectural recommendations across model development, serving, orchestration, observability and AI governance.
  • Develop implementation roadmaps to move AI initiatives from their current state toward scalable and reusable enterprise capabilities.
  • Lead the design and operationalization of data ingestion, vector search, Retrieval-Augmented Generation pipelines, model-serving gateways, prompt management, evaluation tools and LLMOps capabilities.
  • Design reusable architectural components such as model-routing services, safety controls, retrieval and reranking services, caching layers and policy-enforcement mechanisms.
  • Guide Proofs of Concept through production, establishing technical standards, reusable patterns and engineering best practices.
  • Optimize AI solutions for performance, availability, scalability and cost efficiency.
  • Establish security, Responsible AI and governance controls, including data privacy, identity and access management, content safety, model-risk assessment, auditability and continuous monitoring.
  • Define observability practices covering metrics, logs, tracing, model quality, safety, infrastructure utilization and cost monitoring.
  • Lead multiple technical workstreams and coordinate with engineering, data, security, platform and product teams.
  • Present architectural recommendations and trade-offs to both technical and executive audiences.
  • Mentor engineers, technical leads and architects while supporting the continued development of AI capabilities across the organization.

What we are looking for

  • 10+ years of experience in software engineering, solution architecture or technology architecture, delivering distributed, web-based and enterprise solutions.
  • 3+ years of hands-on experience designing or implementing AI and Generative AI solutions, including LLM applications, Retrieval-Augmented Generation, prompt engineering and model customization techniques.
  • Proven experience leading technical teams and complex initiatives across multiple workstreams.
  • Strong understanding of enterprise architecture, software development lifecycle practices, platform integration and architectural governance.
  • Experience designing and operating services, microservices and APIs in enterprise environments.
  • Demonstrated ability to identify scalability and performance bottlenecks and lead optimization and cost-reduction initiatives.
  • Experience implementing security-by-design practices, including authentication, authorization, data protection and mitigation of AI-specific risks such as prompt injection and data leakage.
  • Experience with DevOps, MLOps, containerized environments and automated integration and deployment processes.
  • Ability to manage senior stakeholders, communicate complex architectural decisions and resolve technical or delivery-related escalations.
  • Advanced English communication skills, both written and spoken.

Technical skills

We are looking for experience across several of the following areas:

  • Enterprise AI architecture for LLMs and multimodal models.
  • Retrieval-Augmented Generation, including embeddings, chunking, reranking, grounding and guardrails.
  • LLMOps practices such as prompt versioning, evaluation suites, A/B testing, canary releases and production monitoring.
  • Model serving, gateways and routing across multiple models or providers.
  • Python and API development using frameworks such as FastAPI or Flask.
  • Server-side development with technologies such as Java, .NET, Python or Node.js.
  • REST APIs, microservices and enterprise integration patterns.
  • Relational, non-relational and vector databases, including PostgreSQL with pgvector, Pinecone or Weaviate.
  • Streaming and data-ingestion technologies such as Apache Kafka or Azure Event Hubs.
  • Identity and access management, OAuth 2.0, OpenID Connect, JWT, encryption and secrets management.
  • Docker, Kubernetes, Terraform, Bicep and Git-based delivery workflows.
  • Observability tools and standards such as OpenTelemetry.
  • Cloud platforms such as AWS, Microsoft Azure or Google Cloud Platform.
  • Architecture documentation using UML, C4 models, sequence diagrams and Architecture Decision Records.

Preferred qualifications

  • Degree in Computer Science, Software Engineering, Information Technology, Systems Engineering or a related field.
  • Advanced studies in Artificial Intelligence, Machine Learning or distributed systems.
  • Cloud, AI, data or enterprise architecture certifications.
  • Experience with model-serving technologies such as vLLM, NVIDIA Triton Inference Server, TensorRT-LLM, ONNX Runtime or KServe.
  • Familiarity with AI and model platforms such as Amazon SageMaker, Google Vertex AI or Azure Machine Learning.
  • Experience with model providers, gateways, vector databases and orchestration frameworks such as LangChain or LlamaIndex.
  • Knowledge of LLM evaluation and monitoring tools such as RAGAS, Langfuse, Arize Phoenix or PromptFoo.
  • Previous experience working in large-scale or complex enterprise technology environments.

What you will bring

You will combine strategic architectural thinking with practical delivery leadership. You should be comfortable setting technical direction, challenging assumptions, making informed build-versus-buy decisions and guiding teams through the complexity of taking Generative AI solutions into production.

You will also play a key role in creating reusable patterns, developing technical talent and ensuring AI solutions are secure, responsible, scalable and aligned with measurable business outcomes.

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.

Reinvent with Accenture

Bring your incredible skills and join our global team of innovators. We come together from different backgrounds across the world and work with the latest technologies to create value and growth for our clients. With us, you’ll continue to learn and grow so you can advance in your career. Your personal dreams and ambitions are just as important to us; that’s why we offer support any way we can—when you thrive, we all thrive.

Explore your next step at Accenture

Join a team of Reinventors

Belong. Grow. Thrive.

Join a great place to work for reinventors who drive meaningful change for our clients, communities, and the world. Wo

rld.

Explore your next step at Accenture

Apply for this job100% free