Video Evaluation Generalist

Job Details:

Evaluate Paired Video Outputs: Watch two short video clips presented side by side and compare them against a provided rubric across dimensions such as prompt adherence, motion quality, visual artifacts, and physical plausibility.

Score and Justify Preferences: Assign rubric scores to each clip, select an overall preference between the two, and document a brief written justification supporting the decision where prompted.

Maintain Scoring Consistency: Apply the same standard across high task volumes, holding calibration to the rubric steady so that judgments remain reliable and comparable throughout a production run.