About Kryterion
Kryterion, proudly certified as a Great Place to Work™, is a leader in delivering secure, reliable testing solutions worldwide. Our Psychometrics team is known for its responsiveness, expertise, and commitment to quality earning a consistent Net Promoter Score (NPS) of 100 from clients. We enable organizations to deliver valid, reliable, and fair assessments that allow individuals across the globe to earn life-changing credentials.We are seeking a Psychometrician who thrives in both analytical and client-facing work, brings expertise across all phases of test development and maintenance, and has a passion for helping clients succeed.Position OverviewAs a Psychometrician at Kryterion, you will:
- Partner directly with clients to design and maintain credentialing programs.
- Lead and conduct psychometric analyses that ensure exam validity, reliability, and fairness.
- Contribute to a collaborative, high-performing team while working independently on key projects.
Key Responsibilities
- Conduct job task analyses, including survey design, data collection, analysis, and reporting.
- Develop test blueprints/specifications, facilitating SME meetings to ensure alignment.
- Lead and support item development, technical review workshops, and training sessions with SMEs.
- Oversee and maintain item banks, including item edits, coding, and enemy item identification.
- Perform exam and item analyses using both Classical Test Theory (CTT) and Item Response Theory (IRT); provide recommendations and review results with clients.
- Facilitate standard setting studies (e.g., Modified Angoff), analyze results, and prepare recommendations.
- Conduct equating studies using CTT and demonstrate familiarity with IRT methodologies.
- Prepare technical reports (e.g., job task analyses, standard setting, psychometric analyses).
- Recommend and oversee test maintenance activities (e.g., test form revisions, beta test item sets).
- Manage multiple projects, creating timelines and ensuring delivery within scope, schedule, and budget.
- Communicate complex psychometric concepts to both technical and non-technical audiences.
- Provide support for accreditation applications (e.g., NCCA, ANSI/ANAB).
- Represent Kryterion at industry conferences as a psychometric resource.
Qualifications
- Master’s or Doctorate in Educational Measurement, Educational Statistics, Industrial/Organizational Psychology, or a related field.
- Minimum 3 years of experience in the certification/licensure testing industry.
- Strong analytical and problem-solving skills with proven expertise in psychometrics.
- Proficiency in SPSS (experience with R, Winsteps, or other statistical software is a plus).
- Advanced skills in Microsoft Excel and Word.
- Excellent oral and written communication skills.
- Strong project management and time management abilities.
- Exceptional attention to detail and commitment to accuracy.
- Ability to work independently with minimal supervision.
- Willingness to travel up to 20–25%, including some weekends for client workshops.
Our ValuesAt Kryterion, our culture is driven by collaboration, accountability, and continuous improvement. We live our values every day:
- We Own It
- We Are One Team
- We Listen and Learn From Each Other
- We Face Challenges with Optimism
- We Continuously Improve
- We Build Trust
- We Help Our Customers Succeed
What We Offer
- Competitive salary commensurate with experience.
- Comprehensive benefits package including medical, dental, vision, life insurance, short- and long-term disability, and 401(k) with company match.
- Generous PTO and holiday pay.
- A people-centered culture that supports learning, growth, and career development.
Additional Information
- Applicants must be authorized to work in the U.S. without sponsorship.
- We are an Equal Opportunity Employer, committed to building a diverse and inclusive workplace.
