Overview
Evaluate AI responses to U.S. litigation scenarios for accuracy and compliance.
About the hiring company
Based in San Francisco, California, the hiring company is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. The hiring company supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Role Overview
The hiring company invites Litigation and Civil Procedure experts to join projects that fine-tune AI models like ChatGPT. You will apply your expertise in trial strategy, motion practice, discovery, and procedural rules to evaluate how AI handles complex litigation scenarios. If you enjoy analyzing case strategy, identifying procedural deficiencies, and providing rigorous legal feedback, this is your opportunity. No prior AI experience is required — your background in U.S. litigation practice is exactly what’s needed.
What Does Day-to-Day Look Like
- Review and evaluate AI-generated responses to U.S. litigation hypotheticals, including motion to dismiss arguments, summary judgment analyses, discovery disputes, and trial strategy questions.
- Apply a structured legal rubric to assess issue spotting, procedural accuracy under the Federal Rules of Civil Procedure, and proper application of case law and evidentiary standards.
- Identify gaps in AI reasoning around standing, jurisdiction, burden of proof, pleading standards (Twombly/Iqbal), and remedies.
- Provide detailed, high-quality annotations and written feedback to refine AI models.
- Collaborate with researchers and project managers to align evaluation standards and project goals.
Requirements
- Juris Doctor (J.D.) from an accredited U.S. law school; Bar admission (active/inactive).
- 3+ years of U.S. legal practice in civil litigation, commercial litigation, or appellate work.
- Strong reasoning skills across the Federal Rules of Civil Procedure, evidence, and trial advocacy.
- Excellent written communication and attention to detail.
- High ethical standards; interest in AI is a plus.
Perks of Freelancing with the hiring company
- Opportunity to work on cutting-edge AI projects with leading LLM companies.
- Competitive compensation.
- Flexible, fully remote work arrangement.
- Learn how to use AI to advance the legal field.
Offer Details
- Commitment: Flexible, 10–30 hrs/week.
- Duration: ~1 month, with the possibility of extension based on performance and project needs.