QA Engineer - SDET

About Us:

Phyllo is a data gateway that allows social data to be accessed from source platforms (e.g. YouTube, Twitch, Upwork, Shopify, etc.). We build the underlying infrastructure that connects with every creator platform, maintain a live data feed to the systems used by these platforms to manage creators' data, and provide a normalized data set so that businesses can use creators' data in a simple yet impactful way. Website: https://www.getphyllo.com/

About the Role

As an SDET, you will take ownership of automation quality for assigned product areas across APIs, SDKs and web applications. You will design scalable automation solutions, strengthen regression coverage, integrate tests into CI/CD pipelines and proactively identify quality risks before they reach production..
This is an automation-first, hands-on role. You will build test suites that run on every code change, use AI tools to write and maintain tests faster, and review that AI output with a critical eye. You will work side by side with product managers and engineers to agree on what “working” means before code is written, and coach your team to grow from testers into automation engineers.

What you'll be expected to do

1. Build and own test automation (UI and API)

• Set the test automation strategy: what to automate, at which level (API, contract, UI), and what to keep for exploratory testing.
• Design and maintain API test automation in code, covering functional, schema/contract, negative, authentication and data-accuracy checks against our OpenAPI specs.
• Build reliable end-to-end UI test suites using sound design patterns (page objects, stable locators, isolated test data) so tests stay fast and trustworthy.
• Run automated tests in CI/CD on every pull request and release, with clear quality gates and fast feedback to engineers.
• Use AI coding assistants and agents to draft test plans, generate scripts and test data, and triage failures, and review every AI-generated test as carefully as human-written code.
• Verify that data flowing through our APIs is complete, correct and consistent across platforms, including pagination, webhooks and rate limits.
• Track and reduce flaky tests, and report quality metrics (coverage, escaped defects, flake rate, pipeline time) that the team acts on.

2. Work closely with product and engineering

• Work with product managers early to turn requirements into clear acceptance criteria and test scenarios before development starts.
• Partner with engineers on testability, test data and shared ownership of quality.
• Reproduce and debug issues using logs, network traces and API responses, and give engineers precise, actionable bug reports.
• Explain quality risks and release status in plain language to product, engineering and leadership.

You'll be a good fit if

• 3–5 years of experience in quality engineering, with at least 2 years building test automation (not only running manual tests).
• Hold a BS in Computer Science or have an equivalent combination of technical education and work experience.
• Write solid code in at least one language used for test automation: TypeScript/JavaScript, Python or Java.
• Have deep hands-on experience automating REST API tests in code (e.g. Playwright, REST
• Assured, pytest, SuperTest), with a solid grasp of HTTP, OAuth/API-key authentication, JSON schemas and OpenAPI. Postman experience is welcome, but API tests must live in code and CI.
• Have built a UI automation framework with a modern tool such as Playwright (preferred), Cypress or Selenium.
• Run tests in CI/CD pipelines (GitHub Actions, GitLab CI, Jenkins or similar) and work daily with Git, pull requests and code reviews.
• Use AI coding assistants regularly in your testing work, and can tell when an AI-generated test is wrong, shallow or passing for the wrong reason.
• Are comfortable debugging with logs, browser dev tools and SQL.
• Communicate and collaborate clearly, with the confidence to challenge unclear requirements with product managers and engineers.

Nice to Have

• AI-driven UI testing: Playwright Test Agents (planner, generator, healer) or Playwright MCP used with coding agents such as Claude Code, Cursor or GitHub Copilot.
• AI-assisted API testing: Postman Agent Mode, KushoAI, or Keploy (regression tests generated from recorded API traffic).
• Agentic testing platforms: AI-native platforms such as testRigor, mabl, Katalon or QA.tech
• Contract and schema testing: Pact, Specmatic, or Schemathesis (property-based and fuzz testing from OpenAPI specs).
• Testing AI features: Evaluating LLM-powered features with tools such as Promptfoo, DeepEval, LangSmith or Langfuse, including golden datasets and LLM-as-judge scoring.
• Performance testing: k6, JMeter or Gatling.
• Mobile testing: Appium or similar, for testing SDKs on Android and iOS.
• Accessibility: Automated checks with axe or similar, and familiarity with WCAG.
• API security: OWASP API Security Top 10 and basic API security testing.
• Infrastructure and reporting: Docker, cloud test environments (we run on Google Cloud), and reporting tools such as Allure, TestRail or Xray.
• Domain: Familiarity with social and creator platform APIs (YouTube, Instagram, TikTok and similar).

What we offer

• Hybrid Working Environment: Work both from the office and remotely as needed for a better work-life balance
• Flexible Hours: Choose to work in the hours you feel the most productive
• Innovate and Evolve: We're building a high-growth, high-autonomy culture. We rely less on job titles and more on cultivating an environment where anyone can contribute, the best ideas win, and personal growth is driven by expanding impact

What's in it for you?

We invest in our people and believe in hiring for high-potential and humble individuals who can rapidly grow their responsibilities as the company scales. You will infuse insights and ideas into business decision-making, solutions strategy, and the innovation roadmap for each product.

Do you truly want to make a difference and revolutionize the creator economy through data? If yes, Phyllo is the perfect place for you.