We connect certified psychometricians and domain experts with credentialing organizations that need independent item review. AI flags the issues — you resolve the ambiguous 10%.
Flexible, well-compensated expert work that advances the assessment industry
Review items on your schedule. 24-48h standard turnaround. Set your own availability.
$45–$85 per item review. Rush reviews at 2–3x. Top reviewers earn $150+/hr effective rate.
Your reviews contribute to the first-ever Assessment Item Quality Index. Co-author published case studies with credentialing bodies.
Experienced assessment professionals across domains
Former credentialing-body item writers with 5+ years of high-stakes assessment experience.
MS/PhD in measurement, educational psych, or psychometrics. IRT, DIF, standard-setting expertise.
Clinicians, engineers, IT professionals who moonlight as item writers for certification boards.
MS/PhD candidates in measurement or educational psychology looking for applied experience.
Three steps from application to your first review assignment
Submit your credentials, domain expertise, and assessment experience.
Pass our proficiency assessment based on Haladyna + AERA/APA/NCME Standards (free).
Receive flagged items in your domain. AI does the initial 200+ check scan; you adjudicate the flags.
Accountability built into every review
Every reviewer is tracked on inter-rater agreement (Cohen's κ). High-performing reviewers get priority assignments and premium rates. This isn't crowdsourcing — it's a vetted expert network.
Want to formalize your expertise? Our Certified Item Writer program ($499, renewable every 2 years at $199) trains and certifies you against Haladyna, AERA/APA/NCME Standards, and ITC/ATP Guidelines. Certified reviewers earn priority marketplace access.
Tell us about your expertise and we'll be in touch within 48 hours