AI/ML QA Analyst (Porto | Lisboa,Hibrido)

We are looking for an AI/ML QA Analyst to join our team. The successful candidate will combine strong manual and functional testing skills with hands-on knowledge of Artificial Intelligence and Machine Learning systems, ensuring the quality, reliability, and robustness of AI-powered applications. The role involves working closely with development, product, and business teams within an Agile environment, with a particular focus on AI/ML-specific testing, data quality, model behaviour, and continuous improvement.

Responsibilities

• Define and implement test strategies and test plans adapted to AI/ML-based systems.
• Design, execute, and maintain manual and exploratory test cases covering functional, non-functional, and AI/ML-specific scenarios, including model behaviour, edge cases, bias, robustness, and explainability.
• Analyse the product backlog to assess testing feasibility and contribute to the overall testing strategy.
• Estimate testing effort and identify risks, taking into consideration AI/ML model uncertainty and data variability.
• Support UAT activities, ensuring business requirements are accurately reflected in AI/ML outputs.
• Review and analyse test results, including model outputs, prediction accuracy, and regression impacts.
• Identify, track, and report defects, validate fixes, and monitor model performance over time.
• Prepare test status and issue status reports.
• Validate AI/ML model behaviour in terms of correctness, robustness, fairness, and explainability.
• Design and execute data quality checks and data pipeline validation scenarios.
• Challenge AI/ML model requirements and acceptance criteria in collaboration with Product Owners.
• Contribute to the definition of AI/ML quality metrics and KPIs, such as accuracy and precision.
• Participate actively in Agile/SCRUM ceremonies and contribute to continuous improvement initiatives.
• Keep up to date with AI/ML trends and QA best practices and apply relevant insights to improve testing processes.
• Support junior QA analysts by sharing knowledge and providing constructive feedback.
  
  

Requisitos mínimos

• Minimum 3 years of professional experience as a QA Analyst.
• Hands-on knowledge and experience with AI/ML concepts, including supervised and unsupervised learning, model training and inference, and datasets.
• Experience with JIRA/XRAY.
• Experience with API testing tools, such as SoapUI or Postman.
• Good knowledge of SQL / SQL Developer for data validation.
• Experience with Python or scripting for test data preparation.
• Knowledge of test automation frameworks such as Playwright, Selenium, or Katalon.
• Higher education in Computer Science, Software Engineering, Data Science, or a related field.
• Previous experience working in an Agile/SCRUM environment.
• Strong communication skills, with the ability to synthesise information and produce clear documentation.
• Strong attention to detail, with a proactive and autonomous approach.
• Proven ability to prioritise activities based on risks and business impact.
• Good level of English; French is considered a plus.
• Demonstrated autonomy, commitment, and ability to contribute with ideas and solutions.
• Curiosity and genuine interest in new technologies, particularly AI/ML and data.