Senior Psychometrician

OVERVIEW OF POSITIONS NBME®'s Psychometrics and Data Analysis (PADA) unit is seeking a Senior Psychometrician to join their team. Interested candidates when applying should include a cover letter to indicate their interest in and fit for that role. This position is expected to make contributions in six primary areas: Applied research and development in support of modifications to examination designs, and analysis methods and procedures. Planning and execution of psychometric analyses, scoring, and score reporting for operational examination programs. Contribute to the educational measurement community via professional presentations and publications related to independent and organizational research agendas. Evaluate existing procedures for improvement opportunities, identify new procedures to increase accuracy and efficiency of exam processing. Designing and evaluating data visualization and graphical representation of data for stakeholder feedback, examinee feedback reports, and interactive data tools. Supporting AI-related research initiatives. Senior Psychometrician must effectively collaborate with a variety of internal staff including data analysts, test developers, information technologists, and program managers. In addition, external facing communication and engagement with clients and subject matter experts from a wide range of medical and health care fields is also necessary. Operational examination programs at NBME include the United States Medical Licensing Examination®, an extensive medical school examination program that supports the assessment needs of US and international medical schools, and numerous client examinations primarily in support of medical specialties. The variety of assessment programs creates a wealth of data and opportunities for applied and theoretical research that can impact practice. This role has been designated as primarily remote, meaning it requires little to no onsite attendance. While this role can be designated as remote, you are offered the flexibility to select if you prefer to work primarily remotely, hybrid, or onsite. We're open to considering candidates within 50 miles of our office location in Philadelphia, PA. Please note that onsite interviews and onboarding at our Philadelphia office may be required for this role. If applicable, advance notice will be provided to support planning. At NBME, we continue to innovate and improve how we fulfill the evolving needs of the health care community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-informed, robust approach to advancing medical education and assessment for years to come. QUALIFICATIONS Skills and Abilities Strong background in psychometric theory and application, including knowledge of IRT, CTT, statistics, test development procedures, and research design. Advanced knowledge of applied measurement topics, such as equating, scaling, generalizability theory, Bayesian methodology, and/or standard setting. Demonstrated strength in presenting assessment data graphically to facilitate user comprehension, support correct inferences, and guide subsequent actions. Knowledge and/or experience in natural language processing, process data analytic methods, formative assessment approaches is desirable. Excellent computer skills and a working knowledge of statistical software (e.g., Calibration software, SAS, Python, R). Excellent oral and written communication skills. Ability to identify errors and solve problems. Excellent interpersonal skills, including the ability to work closely and successfully with individuals from a variety of professional and educational backgrounds. Experience A minimum of 5 years of experience in a Psychometrician/Measurement Scientist role is required for consideration. Education Doctorate degree in Educational/Psychological Measurement, Statistics, or a related field is required. About NBME: NBME offers a versatile selection of high-quality assessments and educational services for students, professionals, educators, regulators and institutions dedicated to the evolving needs of medical education and health care. To ensure our assessments meet the highest standards of quality, stay relevant and align to the current curriculum in medical schools and training programs, we rely on a wide network of collaborators. These include the volunteers who help develop our exam questions, the committees and panels who represent various groups within the medical education community, external researchers and health profession organizations. We are committed to meeting the needs of educators and learners globally with assessment products and expert services such as NBME Subject Examinations , Customized Assessment Services , Self-Assessment s , the International Foundations of Medicine® Program and Item Writing Workshops . Together with the Federation of State Medical Boards, NBME develops and manages the United States Medical Licensing Examination® , which measures the ability to apply knowledge and skills that form the basis of safe and effective patient care. Our Competency-based Assessment unit is focused on new methods as well as the optimization of assessment in the workplace and education. As a result of leadership in ongoing research, innovative measurement practices and the exploration of forward-thinking assessment modalities and improvements, NBME advances assessment science. Our grant and funding opportunities further support this dedication to medical education and assessment science. We help develop the next generation of assessment professionals through our Summer Psychometric Internship Program . Through the Stemmler Fund , Strategic Educators Enhancement Fund and Latin America Grants Program , researchers and educators can continue to improve the assessment of health care professionals around the world. NBME views diversity, equity and inclusion (DEI) as foundational and enduring to our strategy and vision. We continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, culture, products and services, the Philadelphia community and the broader medical education landscape. Our commitment manifests in our hiring and staff development, recruitment for committees, grants programs, design and review of our assessments, and involvement in our local and national communities. Learn more about NBME at NBME.org . The NBME offers competitive salaries, excellent benefits, and a rewarding work environment. Excellent Benefits include: Healthcare, Dental, Prescription, and Vision plans; 401(k) w/match, Tuition Reimbursement Plan, Commuter Benefit: Public Transit or Parking options. Remote Friendly Workplace. The compensation we are offering ranges from $138,688 to $173,360. Please note that the offered rate for this position typically aligns with the minimum to midrange of this position, but it can vary based on the successful candidate's qualifications and experience, department budget, and an internal equity review. NBME is an Equal Opportunity Employer. We will consider all qualified applicants for employment without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability. #LI-Remote #Associate