Overview
Evaluate media content for quality and adherence to guidelines.
About the hiring company
The hiring company is an AI-powered tech services company with a mission to accelerate AGI advancement and deployment by bridging the gap between global talent from 100+ countries and the world's best foundational LLM companies, by helping them improve performance through model evaluation, fine-tuning, feedback, factuality and handling diverse data.
Role Overview
A US based AI company that is at the forefront of AI research is looking for a detail-oriented and analytically consistent
Annotator
- to evaluate visual and creative content using structured rating frameworks and detailed guidelines.
- In this role, you will assess AI-generated and real-world media (images and videos) for quality, realism, composition, and adherence to defined evaluation standards. Your work will directly contribute to improving cutting-edge AI systems.
- This position requires strong visual judgment, structured reasoning, and consistency across high-volume evaluation tasks.
Job Responsibilities
- Evaluate visual and media content using structured guidelines and predefined rating frameworks.
- Provide clear, well-structured written justifications to support evaluation decisions.
- Ensure consistency, accuracy, and attention to detail across high-volume annotation tasks.
- Identify quality gaps related to realism, composition, motion, lighting, and overall production standards.
Job Requirements
- 3+ years of professional work experience
- Media/agency experience is mandatory
- Hands-on experience working directly with designers, photographers, or videographers (mandatory)
- Experience with AI image or video generation tools is a strong plus
- Strong understanding of motion realism, lighting, camera movement, composition, and production quality
- Strong analytical, logical reasoning, and research skills and excellent communication and collaboration abilities, with proficiency in English.
- Incorporate feedback from LLM performance metrics into training data creation.
- Ability to commit to 40 hours per week and candidates who can join immediately preferred.
Required Qualification
Bachelor’s degree or higher in
- Design, Visual Communication, or Fine Arts
- Film, Media, Animation, or VFX
- Photography or Cinematography
- Architecture or Industrial Design
- Creative Writing or equivalent professional experience in content creation, media production, or content review.
Benefits
- Opportunity to work on cutting-edge AI projects.
- Competitive compensation.
- Flexible working hours and remote work environment.
Application Process
- Shortlisted candidates will complete an assessment.
- Successful candidates will be interviewed.
- Once the assessment is cleared, candidates can start.