Position Overview

We are seeking qualified medical professionals to serve as Evaluator Subject Matter Experts for an AI-powered learning platform designed to support medical students during their pre-clinical years and USMLE STEP 1/COMLEX preparation.

Primary Responsibilities

Evaluate and assess AI-generated content responses covering basic science topics and medical school curriculum

Apply established evaluation metrics to rate content for accuracy, completeness, relevance, and educational utility

Provide expert feedback to ensure content meets the learning needs of first and second-year medical students

Complete asynchronous evaluations within specified deadlines (5 days to 2 weeks, depending on workload)

Participate in quarterly evaluation cycles with potential for ad-hoc assessments

Required Qualifications

Candidates must meet ONE of the following criteria:

Current PGY-1 resident in a US medical residency program (MD or DO degree), OR

Fourth-year medical student from an ACGME-accredited medical school who has successfully passed USMLE Steps 1 & 2

Preferred Qualifications

Prior experience in medical education content review

Strong understanding of medical education pedagogy and learning outcomes

Time Commitment

5-15 hours per week during active evaluation periods

Minimum of 4 evaluation cycles per year

Project Details

Duration: November 2025 – December 2026 (with possibility of extension)

Start Date: First evaluation round begins November 5, 2025

Compensation: $60 USD per hour

Work Arrangement: Remote (US time zones)

Contract Structure: Employment through third-party contracting agency

Osmosis