Prompt Engineer

Location- Remote

Experience: 3+ Years

About the Role

We are looking for a skilled and detail-oriented Prompt Engineer to join our growing AI team. The ideal candidate will have experience working with Large Language Models (LLMs) and Generative AI platforms, creating effective prompts, evaluating AI outputs, and improving model performance through structured testing and feedback.

This role requires strong analytical thinking, excellent written communication skills, and the ability to collaborate with cross-functional teams to build AI-powered solutions.

Key Responsibilities

Prompt Design & Optimization

• Design, develop, and refine prompts for Generative AI and LLM-based applications.
• Create prompt frameworks and reusable prompt libraries for different business use cases.
• Continuously test and optimize prompts to improve response quality, accuracy, and consistency.
• Develop role-based and task-specific prompt strategies.

AI Model Evaluation

• Evaluate AI-generated outputs for relevance, accuracy, completeness, and instruction adherence.
• Identify response gaps, hallucinations, biases, and quality issues.
• Create evaluation criteria, scoring frameworks, and benchmarking processes.
• Compare outputs across multiple AI models and platforms.

AI Testing & Quality Assurance

• Conduct prompt testing across various scenarios and user journeys.
• Perform quality assurance reviews on AI-generated content.
• Document findings and recommend improvements to enhance performance.
• Maintain prompt version control and testing records.

Research & Analysis

• Stay updated with the latest developments in Generative AI, LLMs, and prompt engineering techniques.
• Research emerging prompting methodologies and best practices.
• Analyze user interactions and feedback to improve AI experiences.
• Assist in creating training datasets and AI evaluation workflows.

Collaboration

• Work closely with Product, Engineering, Operations, and Business teams.
• Translate business requirements into effective AI prompt solutions.
• Support AI implementation projects across multiple domains.
• Participate in brainstorming and innovation initiatives related to AI products.

Required Skills & Qualifications

Must Have

• 3+ years of professional experience in Prompt Engineering, AI Operations, AI Evaluation, Content Strategy, Business Analysis, Technical Writing, or related fields.
• Strong understanding of Large Language Models (LLMs) and Generative AI concepts.
• Hands-on experience with AI platforms such as ChatGPT, Claude, Gemini, or similar tools.
• Excellent written and verbal communication skills.
• Strong analytical and problem-solving abilities.
• Experience creating structured prompts and evaluating AI-generated outputs.
• Ability to work independently in a remote environment.

Good to Have

• Experience with AI evaluation frameworks and human feedback processes.
• Understanding of prompt chaining, few-shot prompting, and RAG concepts.
• Familiarity with Python, SQL, APIs, or workflow automation tools.
• Experience working with AI-powered products or chatbot solutions.
• Knowledge of data annotation, AI training, or model evaluation processes.

Preferred Candidates

• Curious and passionate about AI technologies.
• Strong attention to detail and quality.
• Comfortable working in a fast-paced startup environment.
• Ability to learn new AI tools quickly.
• Self-motivated with excellent time management skills.