I Am Available to Help Power Up Your Exams!
🚑 EMS/Fire leaders and educators 🚒
A few questions for you:
Would your exams withstand an independent psychometric audit today?
Do you have current validity evidence that scores reflect job readiness, not test savvy?
When did you last review adverse impact by gender, race/ethnicity, disability, or language?
Do you track item performance (difficulty/discrimination) and retire weak items on schedule?
Are your promotional exams actually predicting field leadership performance?
I can help you!
I develop fair, defensible, and practical exams for EMS and Fire. I bring 22 years in EMS (18 years teaching in EMS programs) and field experience as a firefighter and fire instructor. For the past decade I’ve led certification-exam development for globally recognized credentials. I hold a PhD in Education and master’s degrees in Human Resource and Organization Development and in Measurement, Evaluation, Statistics, and Assessment. This blend of field work and psychometrics produces exams that are fair to examinees, legally defensible, psychometrically sound, and grounded in real practice.
What I help with:
- EMS/Fire education programs: high-stakes cognitive exams; OSCE/skills stations; simulation and case-based testing; readiness and remediation assessments (formative and summative)
- EMS/Fire services: entry and placement testing; promotional exams (FTO, lieutenant, captain, etc.); scenario and judgment assessments; CE testing and QA remediation
Services I provide (and much more)
- Job task analysis and competency mapping
- Blueprinting and form design
- Item-writing workshops and bank development
- Fairness, language, and bias review
- Item editing and quality control
- Standard setting (Modified Angoff, Bookmark, and Statistical) and cut scores
- Item analysis, form validation, and improvement plans
- Classical Test Theory (CTT) and Item Response Theory (IRT) analysis methods
- Accreditation alignment: CoAEMSP/CAAHEP (education) and NCCA, ISO/IEC 17024 (certification)
- Clear reporting and documentation for accreditors and leadership
If you are building or refreshing exams, let’s talk! DM me for more information, availability, and answers to your questions.



You may be aware of this already, but I wanted to be sure you're in the loop, given your stated expertise in this area!
https://substack.com/@willpattiz/note/c-149683221?r=r2wrh