Assessment and Test Construction Administrator - PESMOA

• Assemble, format, and publish 42 exams across 7 pre-clerkship modules (14 NBME customized exams, 14 Faculty-Developed exams, and 14 25-item NBME practice exams). Extract and build exams from NBME Customized Assessment Services (CAS) question banks and internal faculty item repositories according to established module specifications.
• Partner with Module Directors, faculty content experts, and module administrative personnel to design, review, and finalize comprehensive test blueprints for every exam. Ensure item selection aligns precisely with pre-clerkship learning objectives, LCME accreditation requirements, and USMLE Step 1 content outlines.
• Manage and maintain internal item banking software and NBME CAS platform interfaces. Catalog, upload, tag, and quality-check faculty-written test questions, ensuring proper formatting, metadata tagging, and answer key accuracy prior to exam publishing.
• Oversee exam review workflows with faculty before test administration, verifying timing, question clarity, and scoring parameters. Coordinate with medical education administrative staff to ensure seamless delivery on testing days and assist in post-exam scoring review and item analysis.
• Standardize test administration protocols, maintain standard operating procedures (SOPs) for blueprinting and question selection, and assist leadership in monitoring student performance metrics across pre-clerkship assessments.
• May perform other duties as assigned.

Join the HJF Team!

HJF is seeking an Assessment & Test Construction Administrator to manage end-to-end development, construction, and delivery of high-stakes examinations for the School of Medicine's pre-clerkship curriculum. Operating within the Office of Medical Education, the incumbent collaborates directly with module directors, faculty item writers, and administrative personnel to establish exam blueprints and build balanced assessments. Responsible for constructing 42 total assessments per academic cycle-comprising customized National Board of Medical Examiners (NBME) exams, faculty-developed (FD) assessments, and practice tests across seven pre-clerkship modules-this role ensures rigorous alignment with curriculum learning objectives and accreditation standards. The position manages item banking, psychometric alignment, and software delivery platforms to maintain high assessment quality and support student preparation for national licensing examinations.

This position will be in support of SOM (School of Medicine) in the MEE (Medical Education) department at Uniformed Services University in Bethesda, MD.

The Henry M. Jackson Foundation for the Advancement of Military Medicine (HJF) is a nonprofit organization dedicated to advancing military medicine. We serve military, medical, academic and government clients by administering, managing and supporting preeminent scientific programs that benefit members of the armed forces and civilians alike. Since its founding in 1983, HJF has served as a vital link between the military medical community and its federal and private partners. HJF's support and administrative capabilities allow military medical researchers and clinicians to maintain their scientific focus and accomplish their research goals.