We are sharing a specialised part-time consulting opportunity for experienced in-house legal professionals practising in Germany with strong expertise in German commercial and contract law.
This role supports a legal AI evaluation initiative focused on assessing how accurately advanced AI systems answer real-world questions involving German law. Selected professionals will run identical legal prompts across two AI platforms, compare their responses side by side, score each answer using a standardised rubric, and provide concise written feedback grounded in professional legal judgment.
Key Responsibilities
German Legal Analysis
Review AI-generated answers to realistic questions involving German law
Assess legal accuracy, completeness, reasoning quality, and practical relevance
Apply professional in-house counsel judgment to commercial and contractual matters
Identify incorrect legal conclusions, missing considerations, or unsupported reasoning
Evaluate whether responses appropriately reflect German legal practice
AI Response Comparison
Run identical prompts across two AI platforms
Compare outputs side by side using consistent evaluation criteria
Identify meaningful differences in legal reasoning, accuracy, and usefulness
Determine which response provides stronger support for the relevant legal question
Flag errors or omissions that could materially affect legal decision-making
Scoring & Evaluation
Score each response against a provided standardised rubric
Apply evaluation criteria consistently across assignments
Distinguish substantive legal weaknesses from minor presentation issues
Ensure scoring reflects both doctrinal accuracy and practical legal usefulness
Work independently while maintaining consistent evaluation standards
Written Legal Feedback
Provide concise written justification for each evaluation
Explain significant legal errors, omissions, or reasoning weaknesses clearly
Document why one response performs better where relevant
Communicate findings precisely and efficiently
Meet agreed project deadlines and quality requirements
Ideal Profile
Strong candidates may have:
At least 5 years of professional experience as in-house legal counsel practising in Germany
Strong knowledge of German law
Substantial experience with commercial and contract matters
Experience advising businesses on practical legal issues
Strong ability to evaluate complex legal reasoning
Excellent written communication and attention to detail
Ability to work independently according to structured evaluation criteria
Current professional experience or substantial recent experience in the German legal environment
Educational Background
A legal degree or equivalent professional legal qualification is highly relevant
Professional qualification appropriate to legal practice in Germany may strengthen an application
Substantial in-house legal experience involving German commercial and contract law is particularly important for this engagement
Nice to Have
Experience reviewing or comparing legal research produced by other professionals
Background advising multinational or complex commercial organisations
Experience with technology, software, or AI-related legal matters
Familiarity with legal research or legal technology platforms
Prior experience with structured legal evaluation, benchmarking, or rubric-based review
Experience evaluating AI-generated legal content
Why This Opportunity
Apply German legal expertise to advanced legal AI evaluation
Review realistic questions grounded in commercial and contract practice
Compare the performance of multiple AI systems using professional legal judgment
Help improve the accuracy and reliability of AI-generated legal analysis
Participate in a focused remote engagement with competitive hourly compensation
Potential for additional work following the initial project scope
Contract Details
Independent contractor role
Fully remote within Germany
Candidates must have at least 5 years of in-house legal experience practising in Germany
Initial project commitment of approximately 10 hours, with potential for additional work
Competitive rates between $135–$145 per hour depending on expertise and project scope
Work may include AI response comparison, legal analysis, rubric-based scoring, and written evaluation
All project work is covered by confidentiality requirements and NDA
Weekly payments via Stripe or Wise
Projects may be extended, shortened, or adjusted depending on scope and performance
Work will not involve access to confidential or proprietary information from any employer, client, or institution
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy:
https://www.24-mag.com/privacy-policy
.