Overview
Create and evaluate challenging Biology problems for AI training.
About the hiring company
Based in San Francisco, California, the hiring company is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. The hiring company supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L
Role Overview
- We are seeking highly analytical and detail-oriented Biology Subject Matter Experts to contribute to the development and evaluation of cutting-edge Artificial Intelligence systems.
- In this role, you will help train and evaluate Large Language Models (LLMs), such as ChatGPT, by creating, reviewing, and solving complex Biology problems. Your expertise will directly influence the accuracy, reasoning capabilities, and educational value of next-generation AI systems.
- The ideal candidate possesses a strong academic foundation in Biology and is comfortable working with concepts ranging from undergraduate-level coursework to advanced graduate and research topics. This position offers a unique opportunity to combine scientific expertise with emerging AI technologies while developing valuable skills in an AI-driven environment.
Responsibilities
- Design challenging Biology questions that test the reasoning, knowledge, and problem-solving abilities of large language models.
- Develop accurate, detailed, and well-structured solutions with clear step-by-step explanations.
- Evaluate AI-generated responses for correctness, scientific rigor, clarity, and reasoning quality.
- Identify areas where AI systems struggle, including:Conceptual understanding
- Multi-step reasoning
- Data interpretation
- Scientific analysis
- Collaborate with AI researchers and project teams to improve evaluation methodologies and model performance.
- Contribute to the development of Biology benchmarks covering topics from undergraduate through advanced graduate-level curricula.
- Provide detailed annotations, feedback, and quality assessments to support model improvement.
Required Qualifications
- Excellent analytical, research, and problem-solving abilities.
- Strong English reading and comprehension skills.
- Ability to explain complex biological concepts in a clear, concise, and accessible manner.
- Exceptional attention to detail and commitment to accuracy.
- Strong written communication and documentation skills.
- Ability to work independently and manage tasks effectively in a remote environment.
- Comfortable using digital tools and online collaboration platforms.
Offer Details
Commitments Required: at least 4 hours per day and up to 40 hours per week with 4 hours of overlap with PST.