Manager, Writing Test Development

The Manager, Writing Test Development, is responsible for overseeing the development of Writing test items and ancillary materials for the WIDA suite of assessments, which are large-scale English language proficiency assessment for multilingual learners in grades 1-12. This position involves reviewing, revising, and approving test items (linguistic content, graphics, scripts, audio files) that align to the WIDA English Language Development Standards Framework, with a focus on the language domain of Writing.The Manager, Writing Test Development, oversees the test development process from start to finish. This position develops test refreshment plans, timelines, and procedures; provides comprehensive feedback to test developers; and signs off on test items content at critical points in the development process. This position also collaborates with the Associate Manager, Rater Training, to oversee the creation of scoring materials for the Writing test.Essential DutiesItem DevelopmentManage test development staff who write, review, revise, and select Writing test items based on item specifications, test maps, and blueprintsEvaluate test items for appropriate task setup and design, linguistic complexity, grade-level appropriateness, content correctness, universal accessibility, appropriate scaffolding, fairness, sensitivity, and adherence to style guidesGive clear, constructive, and timely feedback to test developers on test item text and graphics using test item specificationsSign off on test item content at the end of each phase of the item development cycleWork in close collaboration with managers and directors across functional teams and partner organizations to coordinate effortsCollaborate on the production of project plans and timelines for test item development in coordination with client and other vendors and oversee their implementationOversee the development and revision of item specifications and sign off on revisionsOversee the creation of training materials to prepare item writers and reviewersEnsure test development staff provide content, administrative, and technical support for item writers and reviewersLead meetings during which stakeholders review the content, fairness, and grade-appropriateness of test items and ensure stakeholder feedback on test items is resolvedWork with test development staff and audio recording studio to cast actors and produce recordings for Writing test items, overseeing recording sessions and quality monitoringWrite, review, and edit written reports, procedures, and foundational documents for internal and external stakeholdersUpdate and maintain style guides and item development checklistsEnsure test development staff follow quality control and test security proceduresPilot Testing and Field TestingConduct annual pilot testing of Writing tasks, including obtaining IRB approval and overseeing recruitment and logisticsCoordinate the analysis of pilot test data and report on findingsCoordinate, conduct, and sign off on quality checks of field test QTI packages and ancillary materialsReview and update field test functional rulesOversee the qualitative analysis of Writing field test responses and report findings to internal teams and external stakeholdersRater Training and ScoringCollaborate on research and development work for scoring materials related to the Writing test, including rubrics, rater training presentations and courses, and other scoring guidanceSelect anchor papers and training papersReview and approve score justifications, as well as qualifying, recalibration, and validity setsSynthesize information from the scoring of Writing tasks for use in future developmentOperational Test and Database ManagementReview test maps, test forms, ancillary documents, test practice items, and sample items for the publicWrite, review, and maintain test and item design plansWrite, review, and maintain the Writing Test Construct Framework documentEnsure accuracy of data in test item databasesSupervisionSet functional team goals and expectations for Writing test developmentMonitor progress and performance of staff completing Writing test development tasksMentor test development staff in their job duties and professional developmentFulfill administrative responsibilities related to hiring/retention and performance reviewsOther duties as assigned