Position Overview
We are seeking qualified medical professionals to serve as Evaluator Subject Matter Experts for an AI-powered learning platform designed to support medical students during their pre-clinical years and USMLE STEP 1/COMLEX preparation.
Primary Responsibilities
• Evaluate and assess AI-generated content responses covering basic science topics and medical school curriculum
• Apply established evaluation metrics to rate content for accuracy, completeness, relevance, and educational utility
• Provide expert feedback to ensure content meets the learning needs of first and second-year medical students
• Complete asynchronous evaluations within specified deadlines (5 days to 2 weeks, depending on workload)
• Participate in quarterly evaluation cycles with potential for ad-hoc assessments
Required Qualifications
Candidates must meet ONE of the following criteria:
• Current PGY-1 resident in a US medical residency program (MD or DO degree), OR
• Fourth-year medical student from an ACGME-accredited medical school who has successfully passed USMLE Steps 1 & 2
Preferred Qualifications
• Prior experience in medical education content review
• Strong understanding of medical education pedagogy and learning outcomes
Time Commitment
• 5-15 hours per week during active evaluation periods
• Minimum of 4 evaluation cycles per year
Project Details
• Duration: November 2025 – December 2026 (with possibility of extension)
• Start Date: First evaluation round begins November 5, 2025
• Compensation: $60 USD per hour
• Work Arrangement: Remote (US time zones)
• Contract Structure: Employment through third-party contracting agency