QA Analyst (with AI/ML experience)

Hexa Consulting is looking for a Mid QA Analyst (AI) to join our Client's team in a hybrid work model from Lisbon.

Job Details

Lisbon, Portugal | Hybrid | Banking technology sector

Mandatory Requirements

• At least 3 years of professional experience as a QA Analyst.
• Hands-on understanding of AI/ML concepts, including supervised and unsupervised learning, model training, inference and datasets.
• Experience with manual, functional, exploratory and non-functional testing.
• Experience with AI/ML testing concepts, including model behavior validation, robustness, fairness, explainability and regression analysis.
• Experience with data quality checks and data pipeline validation.
• Experience with JIRA and XRAY.
• Experience with API testing using SoapUI or Postman.
• Experience with SQL and SQL Developer for data validation.
• Knowledge of Python or scripting for test data preparation.
• Awareness of test automation frameworks such as Playwright, Selenium or Katalon.
• Experience working in Agile SCRUM environments.
• Experience with test reporting, defect tracking and test effort estimation.
• Higher education in Computer Science, Software Engineering, Data Science or an equivalent field.
• Professional working proficiency in English.
• Ability to synthesize information, document clearly and communicate effectively.
• Detail-oriented, proactive and autonomous working style.
• Strong prioritization skills, with the ability to balance risks, business impact and delivery constraints.
• Curiosity and a continuous learning mindset, particularly in AI, data and quality assurance practices.

Technology Stack

AI/ML | JIRA | XRAY | SoapUI | Postman | SQL | SQL Developer | Python | Playwright | Selenium | Katalon | Agile SCRUM

Key Responsibilities

• Define test strategies, test plans and testing approaches for AI/ML-based systems.
• Design, execute and maintain manual, exploratory, functional, non-functional and AI-specific test scenarios.
• Analyze backlog items to assess testing feasibility, effort, risk and impact.
• Validate AI model behavior, including correctness, robustness, fairness, explainability, edge cases and regression impacts.
• Review test results, model outputs, prediction behavior and data-related issues to support reliable delivery.
• Design and execute data quality checks and data pipeline validation scenarios.
• Challenge requirements and acceptance criteria with Product Owners, especially for AI-driven outputs.
• Contribute to the definition of AI quality metrics and KPIs, including accuracy and precision.
• Identify, document, track and validate defects, fixes and model performance observations.
• Support UAT activities and ensure business expectations are reflected in test coverage and outputs.
• Prepare clear test status reports, issue reports and delivery updates.
• Participate in Agile SCRUM ceremonies and contribute to continuous improvement.
• Share knowledge with less experienced analysts and provide constructive feedback when relevant.

What We Offer

• Work Model: hybrid.
• A culture where each person is encouraged to act as a Builder, contributing with ownership, responsibility and impact.
• A collaborative environment built on Honesty, Mutual Support and Agility.
• Continuous learning and certification support throughout your journey.
• Private health insurance from day one, with optional family extension.
• Confidential mental health support through TEAM 24, including psychological support, content and live sessions.
• Childcare vouchers and practical family support measures.
• Opportunities to grow through exposure to quality management, information security, AI governance and cybersecurity best practices.

Equal Opportunity

Hexa is committed to equal opportunity, inclusion and fair access to professional growth. We value diverse backgrounds, perspectives and experiences, and we support the principles of the Portuguese Diversity Charter in the way we build teams and opportunities.

Hexa Life

Life at Hexa means being part of a community of Builders. We work with transparency, support each other across projects and geographies, and stay focused on learning, adapting and delivering work that creates real impact.

If you meet the above criteria and are ready for an exciting opportunity in a dynamic environment, please send your CV!