• Research Scientist I or II

    Job Locations US-IA-Iowa City | US-Remote
    Posted Date 3 weeks ago(4/3/2019 12:38 PM)
    Job ID
    # of Openings
    Up to 25% Travel
  • Overview

    ACT is a nonprofit organization helping people achieve educational and workplace success.  Our programs are designed to boost lifelong learning in schools and workplaces around the world. Whether it's guiding students along their learning paths, enabling companies to develop their workforce, fostering parent, teacher, and counselor understanding of student progress, guiding job seekers toward career success, or informing policymakers about education and workforce issues. ACT is passionate about making a difference in all we do.


    Learn more about working at ACT at act.org!



    Position objective: ACT is looking for someone to join our Assessment Transformation team; this could be a new Ph.D. or someone with experience. The Assessment Transformation team has as its mission to lead the research, design, and development of next generation assessments that facilitate adaptability and personalization by leveraging digital technologies, new measurement models, and digital data sources.




    Typical work-related activities include:

    • Under the direction of senior staff, this position will:
      • Provide psychometric support including test construction, field test design and item analysis, equating design and analysis, and score comparability research
      • Incorporate the use of process data (e.g. response time, eye-tracking, log file data) to enhance assessment modeling and support for adaptive/personalized assessment feedback
      • Conduct cognitive labs to provide validity evidence for response processes
      • Conduct research on next generation psychometric models at scale
    • Conduct, interpret, and present the results of scaling, equating, calibration, and other psychometric and research studies for ACT products and services
    • Prepare technical and/or interpretive materials for ACT products and services
    • Participate on project teams to support the planning, execution, and quality control of all projects
    • Under direction from senior staff, lead the planning and execution of qualitative and quantitative analyses in support of ACT products and services
    • Create and maintain technical specifications and documentation for the psychometric processes and procedures related to the ACT and related assessment programs
    • Conduct cognitive labs, usability studies, and eye-tracking research to provide validity evidence based on response processes
    • Incorporate process data (e.g. response time, eye-tracking, log file data) into psychometric procedures to support adaptive and personalized assessment solutions
    • Under direction of senior staff, prepare and present research study plans and results to the ACT Technical Advisory Committee for feedback
    • Learn about and participate in the proposal development in response to domestic RFPs, international tenders, and similar requests for services
    • Participate within ACT Research and across ACT in creating an open, innovative, and collaborative environment
    • Increase visibility of ACT Research through staff publications, presentations, and presence across relevant national and international research communities




    Minimum Qualifications



    For Research Scientist I

    • Doctoral degree required in educational measurement, educational psychology, quantitative psychology or related field 

    For Research Scientist II:

    • Doctoral degree required in educational measurement, educational psychology, quantitative psychology or related field



    For Research Scientist I:

    Demonstrated professional achievement through presentations at professional conferences or publications


    For Research Scientist II:

    Minimum of three years of post-doctoral related work experience in a testing, measurement, or research environment        


    Knowledge, Skills and Abilities:

    • Solid computer programming skills in R, SAS, or Python
    • Familiarity with IRT software packages including Bilog, FlexMIRT, Winsteps, etc.
    • Self-motivated and self-driven
    • Exceptional organizational skills and attention to detail
    • Excellent oral and written communication skills
    • Exceptional collaborator and team member
    • Ability to meet multiple deadlines
    • Ability to adapt to a fast changing environment


    Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
    Share on your newsfeed

    Connect With Us!

    Not ready to apply? Connect with us for general consideration.