Position Overview
We are seeking qualified medical professionals to serve as Evaluator Subject Matter Experts for an AI-powered learning platform designed to support medical students during their pre-clinical years and USMLE STEP 1/COMLEX preparation.
Primary Responsibilities
- Evaluate and assess AI-generated content responses covering basic science topics and medical school curriculum
- Apply established evaluation metrics to rate content for accuracy, completeness, relevance, and educational utility
- Provide expert feedback to ensure content meets the learning needs of first and second-year medical students
- Complete asynchronous evaluations within specified deadlines (5 days to 2 weeks, depending on workload)
- Participate in quarterly evaluation cycles with potential for ad-hoc assessments
Required Qualifications
Candidates must meet ONE of the following criteria:
- Current PGY-1 resident in a US medical residency program (MD or DO degree), OR
- Fourth-year medical student from an ACGME-accredited medical school who has successfully passed USMLE Steps 1 & 2
Preferred Qualifications
- Prior experience in medical education content review
- Strong understanding of medical education pedagogy and learning outcomes
Time Commitment
- 5-15 hours per week during active evaluation periods
- Minimum of 4 evaluation cycles per year
Project Details
- Duration: November 2025 – December 2026 (with possibility of extension)
- Start Date: First evaluation round begins November 5, 2025
- Compensation: $60 USD per hour
- Work Arrangement: Remote (US time zones)
- Contract Structure: Employment through third-party contracting agency