American Institutes for Research Test Development, Senior Manager in District Of Columbia
The Assessment Program at AIR is a well regarded organization that is growing rapidly. We focus on providing our clients with customized assessments that not only measure student achievement against state standards, but also provide meaningful score reports that can help students, parents, and educators address any areas of student weakness. Our environment is fast-paced and requires people at all levels who are willing to roll up their sleeves to get the work done on time while maintaining high quality. We are seeking a Manager, ELA Test Development for our Washington, D.C. (Georgetown) office.
The Manager, ELA Test Development will work with the ELA content team to develop and manage products for online and paper-pencil assessment programs. You will be the primary representative to the client on matters specific to content item and test form development. Duties include: • Managing internal and external item writing and reviewing to meet internal and external deadlines; • Leading client committee meetings in which stakeholders review the content and grade-appropriateness of test items; • Leading constructed-response scoring activities to identify exemplar student responses, monitor scorer training, and audit scoring sessions; • Writing, revising, and reviewing test items (questions) based on scientific content correctness and appropriateness, fairness, and project specifications; • Helping develop new machine-scored item types; • Developing ways to use the new item types to assess aspects of ELA content not amenable to paper-pencil assessment; • Resolving client feedback on test items and test forms; • Assembling and reviewing field test and operational test forms, working with technical staff to meet content and statistical specifications; • Designing, and resolving client feedback on test specification documents, style guides, test blueprints, and specific student aids; • Supporting technical staff at client committee meetings in which stakeholders review statistical data of administered test forms; • Managing test item pools.
- Masters degree in ELA or ELA education with at least 8 years of experience in the development of standardized assessments or a Ph.D. in a ELA related field and at least 6 years of experience in the development of standardized assessments - Ability to identify problems and conceptualize solutions, prioritize tasks and meet deadlines - Ability to work collaboratively and manage staff and the test development processes - Knowledge of the detection and correction of flaws in multiple choice and constructed response items - Experience in the activities of blueprint and item specification development, pool development, item review, fairness review, constructed response scoring, and form development - Experience in the use of either classical and IRT statistical models to the interpret item level data and construct of test forms - Must be comfortable with and interested in learning new technologies Required travel for this position ranges from 4 to 10 weeks per year. Candidates should be able to travel as required for 2-3 days at a time, mostly in the June/July timeframe. *LI-DG1
External Company Name: American Institutes for Research
External Company URL: http://www.air.org