AI Agent Oversight (student job)

About CARV CARV is building the infrastructure that powers AI-driven recruiting and talent operations. As AI becomes increasingly embedded in hiring workflows, ensuring quality, reliability, and exceptional customer experiences is critical. We're looking for a curious, detail-oriented student to join our AI Oversight Team in a flexible part-time side job alongside their studies. You'll get hands-on experience working with cutting-edge AI products while helping us ensure they perform accurately and reliably for customers. This is a great opportunity for someone excited about AI, enjoys figuring out why things work (or don't), and wants practical experience at a fast-growing AI company. What You'll Do AI Quality Assurance & Testing Test AI products, workflows, and agent experiences from end to end. Spot, document, and report bugs, errors, and unexpected AI behavior. Validate fixes and help ensure new features work as intended before release. Work through structured test plans and explore products independently to uncover issues. AI Chat Monitoring & Oversight Review AI conversations and identify incorrect responses, hallucinations, and workflow failures. Monitor customer interactions and flag opportunities to improve the product. Provide feedback that helps improve AI behavior, accuracy, and reliability. Help us maintain a consistently high quality bar across our AI products. Customer Hypercare & Support Help investigate and triage customer support issues. Reproduce reported problems and share clear findings with our product and engineering teams. Keep an eye on customer experiences when new features are launched. Turn recurring customer questions and issues into useful product insights. Product Development Support Be one of the first people to test new features and AI capabilities. Give structured feedback on usability, workflows, and the overall customer experience. Evaluate AI outputs and help compare performance across releases. Help us improve the way we test, monitor, and evaluate our AI systems. What You'll Gain A flexible side job that you can combine with your studies . Hands-on experience working with cutting-edge AI systems and AI agents. Practical experience in AI quality assurance, context engineering, and AI operations. Close collaboration with our product, engineering, and AI teams. A behind-the-scenes look at how AI products are built, tested, improved, and deployed to real customers. Meaningful responsibility and the opportunity to have a visible impact on the quality of CARV's products. You don't need to be an AI expert. We're looking for someone curious, sharp, reliable, and eager to learn. If you're studying and excited about AI, and you'd like a side job that lets you gain real-world experience while contributing to products used by customers every day, we'd love to hear from you. You're currently studying and looking for a part-time side job alongside your studies. Strong attention to detail and an ability to spot inconsistencies. Genuine interest in AI, large language models, AI agents, prompting, or context engineering. Strong written communication skills. An analytical mindset and willingness to investigate problems independently. Ability to follow structured processes while still thinking critically. Comfortable working in a fast-moving startup environment. Nice to Have You've experimented with tools such as ChatGPT, Claude, Gemini, or other AI products. Some familiarity with software testing, QA, or customer support. Interest in recruiting technology, SaaS, or AI product development. Experience documenting bugs, testing software, or providing structured product feedback. No previous professional AI experience is required. Curiosity, attention to detail, and a willingness to learn matter most.