This role is for one of our clients
Compensation: $80-$150 per hour
1. Role Overview
We are seeking experienced UI/UX and product design professionals to contribute to an AI research initiative focused on evaluating how effectively AI systems perform real-world digital product design work. In this role, you will help define what high-quality product and UX work looks like by developing task-specific evaluation criteria and assessing completed work samples with rigorous, well-reasoned written feedback.
The ideal candidate brings hands-on experience designing digital products, strong knowledge of modern UX practices, and the ability to distinguish thoughtful, production-ready design from superficial or incomplete work.
2. Key Responsibilities
Develop clear, objective, task-specific grading criteria for digital product and UX deliverables, including:
Design systems and component libraries
Responsive interfaces, dashboards, and web applications
End-to-end product journeys such as onboarding, checkout, booking, and account management
Customer portals and logged-in experiences
UX writing and product content
Design-to-development and production handoff
Evaluate AI-generated and human-created design work against established criteria.
Provide detailed, evidence-based written explanations for each evaluation, clearly identifying strengths, weaknesses, usability issues, and areas for improvement.
Apply consistent standards so that evaluations are objective, reproducible, and aligned with real-world product expectations.
Incorporate feedback from senior reviewers and continuously refine evaluation approaches.
Assess designs from the perspective of usability, accessibility, visual quality, interaction patterns, business objectives, and end-user needs.
3. Ideal Qualifications
5+ years of professional experience in
product design, UI/UX, UX design, or design systems
for real-world digital products.
Experience working with leading digital-product or UX studios, product-led organizations, e-commerce platforms, marketplaces, or technology companies with sophisticated digital experiences.
Relevant experience in one or more areas such as:
Product / UI Designer
UX Designer or UX Lead
Design Systems Designer
UX Writer / Content Designer
Digital Product or Business Analyst
Strong command of interaction design, visual design, responsive layouts, design systems, prototyping, usability principles, and end-to-end product flows.
Hands-on proficiency with
Figma
and familiarity with production and engineering handoff processes.
Ability to critically evaluate design decisions and articulate feedback at the level expected from a senior design or UX lead.
Excellent written communication skills, with the ability to clearly explain why a design does or does not meet professional standards.
Strong attention to detail and the ability to apply consistent evaluation criteria across different design solutions.
Comfortable receiving feedback and having professional judgment reviewed and calibrated against other experts.
Prior experience with AI training, AI evaluation, or human-data projects is a plus.
4. Application Process
Submit your resume, portfolio, or relevant professional background.
Qualified candidates may be asked to complete a brief design assessment or provide additional information about their experience.
Selected professionals will receive further details about the project, evaluation process, and onboarding requirements.
5. Work Arrangement
Fully remote engagement
Flexible project-based schedule
Work focused on digital product, UI/UX, and design evaluation
Collaboration with an experienced research and review team
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
6. Contract and Payment Terms
Engagement is structured as an independent contractor opportunity.
Work can be completed remotely and generally on a flexible schedule.
Projects may be extended, shortened, or concluded based on project requirements and performance.
Work will not require access to confidential or proprietary information belonging to any current or former employer, client, or institution.
Payments are made weekly through supported payment platforms based on services rendered.
Candidates must meet all applicable eligibility requirements for the engagement.