Psychometrician
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Psychometrician conducting Rasch-based analyses for WIDA ACCESS at the nonprofit Center for Applied Linguistics. Developing quality controls, technical reports, and quantitative guidance for language assessment research.
Responsibilities:
- Design and conduct psychometric analyses for the WIDA ACCESS program
- Plan, conduct, document, and present psychometric and statistical analyses using classical test theory and the Rasch model
- Analyze item quality, rater performance, DIF, reliability and classification consistency, standard setting, equating, scoring, and reporting
- Investigate and evaluate new approaches to psychometric analyses in language testing
- Establish and monitor quality control procedures from data cleaning through final technical reports
- Provide quantitative guidance to professional researchers on proposal design and analytical approaches
- Participate in writing quantitatively oriented portions of proposals
- Support outreach and collaboration with external partners, academia, education and language innovators, and the public
- Coordinate external quantitative resources on behalf of the organization
- Write narrative accompanying psychometric analyses for technical reports and documentation
- Create replicable procedures for routine psychometric work
- Instruct junior team members in statistical software
Requirements:
- Ph.D. in Educational Measurement, Psychometrics, or related field
- Minimum of five years of demonstrated operational experience designing and conducting statistical and psychometric analyses for high-stakes testing programs
- Strong experience applying the Rasch model to varied psychometric issues
- Experience analyzing performance and polytomously scored tasks
- Demonstrated proficiency programming in R or Python
- Proficiency using SPSS, Winsteps, Facets, and other statistical and psychometric software
- Experience in a psychometric program in a K-12 U.S. educational context, preferably language testing
- Experience communicating effectively in English with clients and internal and external stakeholders in high-stakes contexts
- Experience producing timely, error-free deliverables as part of a team
- Ability to create and apply quality control procedures for databases, statistical and psychometric analyses, quantitative research, and technical reports
- Ability to program, document procedures, and instruct junior team members in R, Python, SPSS, Winsteps, Stata, and SAS
- Ability to create replicable procedures for routine psychometric work
- Ability to write narrative accompanying psychometric analyses for technical reports and documentation
- Ability to work with a diverse, multidisciplinary team of researchers and language testers
- Strong experience with computerized adaptive assessments
- Experience conducting standard-setting and/or alignment studies
- Ability to travel occasionally, 1–3 times per year
- Position is not open to candidates residing in New York, New Jersey, Pennsylvania, Texas, California, or U.S. Territories
Benefits:
- Benefits eligible
- Remote work up to 100%
- Preferred combination of in-person work at the D.C. office in a hoteling capacity or remote work
- Occasional travel (1–3 times per year)
Similar Jobs
Cruise & Resort Booking Specialist
Independent remote travel agent designing customized resort, cruise, and vacation packages. Booking reservations, recommending upgrades, and serving travelers with training and mentorship.
Senior Agile Master
Agile Master senior guiding agile teams at Colombian software engineering company. Ensuring effective communication, optimal workflow, and delivery of project results.
Lead Shift Server
Part-time Lead Shift Server providing food and beverage service to residents and guests at Senior Lifestyle’s Wellington at Hershey’s Mill community. Maintaining dining-area sanitation, coordinating room service, and training shift staff.
Junior Acquisition Specialist
Jr. Acquisition Specialist supporting federal acquisition activities for Martek Global Services, a provider of real estate, healthcare, facilities, and professional services. Preparing acquisition documents and supporting contract awards, administration, modifications, and closeouts.
Coordinator, Charge Revenue Integrity
Revenue Integrity Coordinator validating hospital charges, coding, and billing documentation for Trinity Health. Supporting ancillary departments and improving charge accuracy across healthcare operations.
Small Business Engagement Lead
Small-business engagement lead helping underserved suppliers navigate public procurement through Civic Marketplace’s digital platform. Building supplier partnerships, education programs, and scalable engagement operations nationwide.
Title Coordinator
Title Coordinator supporting First American’s global title and escrow operations. Coordinating complex transactions, title production, training, and AI-enabled process improvements remotely across the US.
Senior Project Specialist
Senior Project Specialist coordinating banking, wealth management, and trust-services projects at First American. Managing schedules, budgets, risks, milestones, and cross-functional stakeholder communications.
ADHD Specialist
ADHD Specialist providing virtual executive-function coaching for Texas Sports Academy, a K-12 school for elite student-athletes. Supporting academic progress through individualized routines, group sessions, and collaboration with guides, coaches, and parents.
Dyslexia Specialist
Dyslexia Specialist delivering virtual structured literacy and reading intervention for Texas Sports Academy student-athletes. Monitoring progress, coordinating accommodations, and supporting families across the online K-12 learning environment.
Revenue Protection Specialist
Revenue Protection Specialist analyzing hospital registration performance and denials for Trinity Health, a large nonprofit health care system. Driving revenue-cycle improvements, reporting trends, and implementing denial-resolution solutions.
Language Testing Specialist
Language Testing Specialist developing WIDA English proficiency assessments for multilingual K–12 learners at nonprofit CAL. Writing, reviewing, and analyzing test items and field-test data.
Study Start-Up Lead
Study Start-Up Lead coordinating global clinical trial activation for ICON, a clinical research organisation. Managing documents, submissions, vendors, budgets, and site readiness to accelerate patient access to medicines.
Cardiac Device Specialist
Part-time Cardiac Device Specialist analyzing and reprogramming pacemakers, ICDs, and loop recorders for Allegheny Health Network. Supporting cardiology telemonitoring, patient follow-up, education, and EKG testing.
CAP Early Childhood (Apprenticeship)
Apprenti CAP AEPE gardant des enfants à domicile pour une entreprise partenaire du CFA Espace Concours. Suivi d'une formation à distance rémunérée et prise en charge, avec accompagnement pédagogique.
CAP Early Childhood Care (AEPE), Apprenticeship
Apprenti CAP AEPE gardant des enfants à domicile pour une entreprise partenaire du CFA Espace Concours. Formation à distance rémunérée et diplôme d’État pris en charge.
Inventory Coordinator
Inventory Coordinator managing retail and wholesale inventory for a fast-paced retailer. Handling purchase orders, replenishment, product data, reporting and website administration remotely.
Senior Specialty Triage RN – Cancer Center
Remote oncology triage RN supporting Providence’s cancer clinics through symptom assessment, guidance, documentation, and care escalation. Applying evidence-based protocols to promote safe access to oncology services.
Freelance Virtual-Building Scheduling Specialist
Remote Building Scheduling Specialist coordinating construction installation schedules for WolfSteel Buildings. Verifying orders, managing contractor availability, and updating bilingual clients throughout projects.
Deployment Specialist, Propagation Modeling
Deployment Specialist supporting Tantalus smart-grid deployments for U.S. utility customers. Troubleshooting TRUConnect hardware, software, networks, databases, and cloud environments.