TransPerfect logo
Hiring from
Spain, Vietnam
Work type
Hybrid
Posted

625,700 remote jobs, straight from company career pages

100% free · New jobs every minute

Show job description

TransPerfect helps organizations navigate the global marketplace. Founded in an NYU dorm room in 1992 and still founder-led, TransPerfect has grown into the world’s largest translation and language services company, with thousands of employees across more than 160 offices worldwide and over $1.3 billion in annual revenue.

The TransPerfect TechOps team builds and supports the technology behind that success – from workflow improvements and core GlobalLink platform services to AI-powered language solutions and scalable client-facing applications.

As a QA Engineer, you will help ensure the quality, reliability, security, and performance of our web applications, APIs, and AI-enabled products. You will design and maintain automated tests, perform hands-on exploratory and regression testing, and work closely with engineering and product teams to identify risks early. You will also use AI-assisted development and testing tools responsibly and contribute to validating AI/LLM features, including translation and other generated language outputs.

This position offers:

  • A significant role in a dynamic QA team, part of a technology division within the world's largest provider of language services and technology solutions

  • Ownership of test automation and opportunities to influence product quality and release readiness

  • Collaboration with distributed product, development, and release teams

  • Hands-on exposure to AI-enabled products, LLM evaluation, and modern AI-assisted testing workflows

  • Opportunities to expand skills in automation frameworks, API testing, CI/CD, and responsible AI quality practices

Your responsibilities will include:

  • Design, implement, execute, and maintain automated functional, integration, regression, and API tests for web and mobile-enabled applications

  • Build and improve scalable, maintainable test automation frameworks using Playwright, Selenium, or comparable tools, with appropriate code reviews and quality checks

  • Integrate automated tests into CI/CD pipelines, analyze failures, reduce flaky tests, and provide timely feedback on release quality

  • Create risk-based test strategies, test plans, test scenarios, and traceable test cases aligned with user stories and acceptance criteria

  • Perform hands-on exploratory, cross-browser, system, end-to-end, database, and RESTful API testing as needed

  • Validate data integrity, access control, error handling, usability, and compatibility across supported environments

  • Identify, document, prioritize, and track defects in Azure DevOps or comparable tools, supplying clear steps, evidence, impact, and technical findings

  • Work with developers, product managers, QA leads, and release managers to assess risks, investigate defects, and support release-readiness decisions

  • Test AI-powered features and LLM-based workflows for functional correctness, output quality, reliability, and alignment with requirements

  • Evaluate AI-generated language and translation outputs using defined criteria such as meaning preservation, terminology, fluency, formatting, and locale conventions; collaborate with language specialists when subject-matter review is needed

  • Design repeatable AI test scenarios and evaluation datasets covering normal, edge, ambiguous, multilingual, and adversarial inputs

  • Identify and document AI-specific failures, including hallucinations, omissions, inconsistent responses, bias, unsafe outputs, and failures to follow instructions or required formats

  • Account for non-deterministic AI behavior by using appropriate evaluation rubrics, comparative baselines, sampling, and repeat testing rather than relying on exact-text assertions alone

  • Use approved AI assistants to accelerate test-case design, test-data preparation, automation scripting, coverage analysis, debugging, and defect reporting; independently verify all AI-generated artifacts

  • Assess the risks of AI-assisted testing workflows, including sensitive-data exposure, unsupported assumptions, fabricated test evidence, and weak assertions; follow company security and data-handling policies

  • Maintain test assets and technical documentation, and proactively recommend improvements to test coverage, effectiveness, and execution efficiency

Communication:

  • Communicate test progress, quality risks, defects, and release blockers clearly to QA, development, and product stakeholders

  • Collaborate effectively with cross-functional teams across locations and time zones; participate in Agile planning, refinement, and daily standups

Required skills and experience:

  • Bachelor’s degree in Computer Science, Engineering, a related discipline, or equivalent relevant experience

  • Professional experience in software quality engineering with both manual and automated testing

  • Hands-on experience developing and maintaining UI or API automation using Playwright, Selenium, or similar frameworks

  • Programming proficiency in C#, Java, or a comparable language used for test automation

  • Experience with RESTful API testing, debugging, test-data management, and validation of backend behavior

  • Experience working with CI/CD platforms and defect/test management tools such as Azure DevOps, TeamCity, or Jira

  • Ability to analyze requirements, develop risk-based coverage, and maintain traceability from acceptance criteria to test results

  • Familiarity with AI-assisted coding or testing tools, plus the judgment to review and validate generated code, test cases, and results

  • Foundational understanding of LLM capabilities and limitations, including hallucinations, variable outputs, and the need for structured evaluation

  • Strong analytical, troubleshooting, documentation, and communication skills; ability to work independently and collaboratively

Desired skills and experience:

  • Experience testing AI/LLM applications, machine translation, retrieval-augmented generation (RAG), or other generative AI features

  • Experience creating automated AI evaluations, quality rubrics, curated datasets, or regression benchmarks for model-generated outputs

  • Knowledge of AI security and safety test scenarios, including prompt injection, data leakage, and inappropriate output handling

  • Experience with .NET development, SQL/database validation, performance or load testing, and service virtualization

  • Experience with AI coding assistants or agent-based QA workflows, including tool integrations and human-in-the-loop validation

  • Professional working knowledge of an additional language, especially for multilingual product testing

  • Ability to work across time zones and understand complex business workflows

By applying, I confirm I have read and accept TransPerfect's Privacy Policy: https://www.transperfect.com/about/data-privacy-recruiting

Similar jobs

Apply for this job100% free