Website Testing & CRO Specialist

Scope and role purpose
Freelance, part time, remote. 17 to 27 hours per month. Heavy use of AI tools is expected
across research, briefs, and analysis.
The goal of this role is to increase conversion rate and AOV on our client's site through
a steady cadence of data driven A/B tests on our highest traffic pages.
Responsibilities
Monthly research: analytics, heatmaps, session recordings, and customer reviews,
using AI to summarize patterns and surface friction points.
Own the test backlog and prioritize by expected impact vs. effort.
Run 6 to 8 tests per month in the testing tool: brief, build, desktop and mobile QA,
monitoring, and readout.
Manage the monthly test calendar by lane (homepage, top PDPs, main collections,
cart), with one live test per lane at a time (the homepage can run two in mutually
exclusive groups).
Flag tests that can interact across pages (for example a homepage promo test and a
free shipping threshold test in cart) and run them in sequence or in mutually exclusive
groups.
Coordinate with the campaign calendar. No new tests during major sales or launches.
Write clear technical briefs for our developer on tests that need development, and QA
the result before launch.
Short report and a 30 minute review meeting, twice a month.
Not included
Building templates or custom development is optional. A plus if you can, not required.
Permanent site changes without approval.
Website Testing & CRO Specialist: Job Description
Page 1 of 4
New creative, photography, or full campaign copy.
Monthly hours
Expected range is 17 to 27 hours per month, depending on how many tests run. More than
27 only with prior approval. Development work on tests that need a developer is not
included.
Test lanes
One live test per lane at a time. The homepage has enough traffic to run two at once in
mutually exclusive groups.
Area Basis Low
(hrs)
High
(hrs)
Research and backlog One monthly block, AI
summarized
3 4
Test calendar and campaign
coordination
Ongoing 1 2
Test briefs ~15 min per test 1.5 2
Build and QA in testing tool 45 to 60 min per test 4.5 8
Monitoring while live ~15 min per test 1.5 2
Analysis and recommendation ~30 min per test 3 4
Dev handoffs (brief and QA) 0 to 1 per month 1 2
Reports and review meetings Twice a month, 30 min meeting +
report prep
1.5 2.5
Total 6 to 8 tests per month 17 26.5
Lane Tests per month Typical duration
Homepage 2 to 3 1 to 2 weeks
Top PDPs (Kireina, Gelyu) 1 to 2 2 to 3 weeks
Website Testing & CRO Specialist: Job Description
Page 2 of 4
Beyond the lanes. New test ideas are welcome. Bring ideas outside the usual pages, for
example dedicated landing pages for ads, tests that connect with Meta or Klaviyo, or
anything else you think could move conversion or AOV.
BFCM and holiday freezes
No live tests during BFCM. The role shifts to planning and prep behind the scenes.
Cart and checkout tests paused from November 1.
No new tests on any page from November 9 through December 2. Running tests are
wrapped up and read out before the freeze.
During the freeze, hours go to research and building the December and January
backlog, so testing restarts right after Cyber Week.
Freezes may also apply around other major holidays and sales when relevant. We agree on
each one together in advance.
Workflow rules
Every test goes live only after approval.
All on-site copy follows our client brand voice.
Requirements
Proven A/B testing experience in ecommerce, Shopify preferred.
Hands-on with testing tools (Shoplift, Intelligems, VWO or similar) and behavior tools
(Hotjar, Microsoft Clarity or similar).
Solid grasp of statistical significance, sample size, and when to stop a test.
Experience running concurrent tests and managing interaction effects.
Basic HTML and CSS.
Lane Tests per month Typical duration
Main collections 1 2 weeks
Cart 1 2 to 3 weeks
Shared PDP element (all products) 1 2 to 3 weeks
Website Testing & CRO Specialist: Job Description
Page 3 of 4
Comfortable using AI tools to speed up research, briefs, and analysis.
Bonus: fashion or DTC experience.
Success metrics
Number of winning tests implemented on site.
Cumulative impact on conversion rate and AOV.
At least 6 tests per month outside the freeze.
Zero tests invalidated by collisions or campaign overlap.
Zero site issues caused by tests.
Trial period
3 months, with at least 10 tests run and a clear conclusion from each. The trial also lets the
monthly hours settle. At the end of the trial we review the terms together: a fixed monthly
scope or hourly.
Website Testing & CRO Specialist: Job Description
Page 4 of 4

Skills

Proven A/B testing experience in ecommerce, hands-on with testing tools such as Shoplift, Intelligems, or VWO, behavior tools such as Hotjar or Microsoft Clarity, solid grasp of statistical significance and sample size, experience running concurrent tests and managing interaction effects, and basic HTML and CSS.

Testing tools such as Shoplift, Intelligems, VWO, and behavior tools such as Hotjar or Microsoft Clarity.