Assessment and Test Construction… at The Henry M.… · Bethesda

HJF is seeking a Assessment & Test Construction Administrator to manage end-to-end development, construction, and delivery of high-stakes examinations for the School of Medicine's pre-clerkship curriculum. Operating within the Office of Medical Education, the incumbent collaborates directly with module directors, faculty item writers, and administrative personnel to establish exam blueprints and build balanced assessments. Responsible for constructing 42 total assessments per academic cycle—comprising customized National Board of Medical Examiners (NBME) exams, faculty-developed (FD) assessments, and practice tests across seven pre-clerkship modules—this role ensures rigorous alignment with curriculum learning objectives and accreditation standards. The position manages item banking, psychometric alignment, and software delivery platforms to maintain high assessment quality and support student preparation for national licensing examinations.

Join the HJF Team!

HJF is seeking an Assessment & Test Construction Administrator to manage end-to-end development, construction, and delivery of high-stakes examinations for the School of Medicine's pre-clerkship curriculum. Operating within the Office of Medical Education, the incumbent collaborates directly with module directors, faculty item writers, and administrative personnel to establish exam blueprints and build balanced assessments. Responsible for constructing 42 total assessments per academic cycle—comprising customized National Board of Medical Examiners (NBME) exams, faculty-developed (FD) assessments, and practice tests across seven pre-clerkship modules—this role ensures rigorous alignment with curriculum learning objectives and accreditation standards. The position manages item banking, psychometric alignment, and software delivery platforms to maintain high assessment quality and support student preparation for national licensing examinations.

This position will be in support of SOM (School of Medicine) in the MEE (Medical Education) department at Uniformed Services University in Bethesda, MD.

The Henry M. Jackson Foundation for the Advancement of Military Medicine (HJF) is a nonprofit organization dedicated to advancing military medicine. We serve military, medical, academic and government clients by administering, managing and supporting preeminent scientific programs that benefit members of the armed forces and civilians alike. Since its founding in 1983, HJF has served as a vital link between the military medical community and its federal and private partners. HJF's support and administrative capabilities allow military medical researchers and clinicians to maintain their scientific focus and accomplish their research goals.

Responsibilities

• Assemble, format, and publish 42 exams across 7 pre-clerkship modules (14 NBME customized exams, 14 Faculty-Developed exams, and 14 25-item NBME practice exams). Extract and build exams from NBME Customized Assessment Services (CAS) question banks and internal faculty item repositories according to established module specifications.
• Partner with Module Directors, faculty content experts, and module administrative personnel to design, review, and finalize comprehensive test blueprints for every exam. Ensure item selection aligns precisely with pre-clerkship learning objectives, LCME accreditation requirements, and USMLE Step 1 content outlines.
• Manage and maintain internal item banking software and NBME CAS platform interfaces. Catalog, upload, tag, and quality-check faculty-written test questions, ensuring proper formatting, metadata tagging, and answer key accuracy prior to exam publishing.
• Oversee exam review workflows with faculty before test administration, verifying timing, question clarity, and scoring parameters. Coordinate with medical education administrative staff to ensure seamless delivery on testing days and assist in post-exam scoring review and item analysis.
• Standardize test administration protocols, maintain standard operating procedures (SOPs) for blueprinting and question selection, and assist leadership in monitoring student performance metrics across pre-clerkship assessments.
• May perform other duties as assigned.

Qualifications

Education and Experience

• Master's degree required
• Minimum of 3-5 years experience required.

Required Knowledge, Skills and Abilities

• Strong interpersonal, written, and verbal communication skills to effectively collaborate with faculty, module leadership, and administrative staff.
• Certification in educational testing or assessment management is favorable.
• Strong organizational and project planning/project management skills with demonstrated ability to manage tight, multiple exam deadlines concurrently.
• Experience working with item banking systems, computer-based testing software, or assessment platforms (e.g., NBME CAS, ExamSoft/Examplify, Canvas, or equivalent).
• Basic understanding of medical education structures, exam blueprinting principles, and multiple-choice question (MCQ) design standards.
• High attention to detail and accuracy in managing confidential, high-stakes examination data.
• Ability to solve problems independently and work collaboratively in a higher education academic health environment.
• Ability to obtain and maintain a Tier I Public Trust background check.

Physical Capabilities

• Ability to stand or sit at a computer for prolonged periods.

Work Environment

• This position will take place primarily in a office setting.

Compensation

• The annual salary range for this position is $77,600-$125,000. Actual salary will be determined based on experience, education, etc.

Benefits

• HJF offers a comprehensive suite of benefits focused on your health and well-being, from medical, dental, and vision coverage to health savings and retirement plans, and more.

Employment with HJF is contingent upon successful completion of a background check, which may include, but is not limited to, contacting your professional references, verification of previous employment, education and credentials, a criminal background check, and a department of motor vehicle (DMV) check if applicable. Any qualifications to be considered as equivalents, in lieu of stated minimums, require the prior approval of the Chief Human Resources Officer.

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor’s legal duty to furnish information. 41 CFR 60-1.35(c)

Any qualifications to be considered as equivalents, in lieu of stated minimums, require the prior approval of the Chief Human Resources Officer.