Rotating Score Validation Process for the Initial ELPAC

Rotating Score Validation Process for the Initial ELPAC

Approximately 10 percent of local educational agencies (LEAs) in California have been identified by the California Department of Education to take part in the Rotating Score Validation Process (RSVP) for the Initial English Language Proficiency Assessments for California (ELPAC). These identified LEAs return their scannable kindergarten through grade two (K–2) Writing Answer Books to the testing contractor, ETS, after all domains have been administered, locally scored Speaking and Writing scores have been entered, and parent/guardian notification of the results has been completed. This process helps to produce item statistics for the Initial ELPAC and validates the LEA's scores for that testing period.

Computer-based Initial ELPAC

  • RSVP LEAs administer the Writing domain to students in K–2 using the scannable 2022–23 Form 1 Writing Answer Books. (Non-RSVP LEAs receive nonscannable Form 1 Writing Answer Books.) RSVP and non-RSVP LEAs administer all other domains to students in kindergarten through grade twelve (K–12) using the test delivery system (TDS).
  • Scores are to be entered as follows:
    • Scores for the Listening and Reading domains are machine-scored in the TDS. Student responses in the TDS are received automatically by ETS for back scoring as part of the RSVP process.
    • Speaking scores for all grade levels must be entered into the Data Entry Interface (DEI).
    • Writing scores for K–2 must be entered into the DEI.
    • Writing scores for grades three through twelve must be entered into the Teacher Hand Scoring System (THSS).
  • An individual Student Score Report (SSR) will be available in the Test Operations Management System (TOMS) after all domains have been administered and scored for a student, within less than 24 hours.
  • LEAs must return their scannable K–2 Writing Answer Books to ETS after parent/guardian notification of the results has been completed and a pre-identification (Pre-ID) label has been received and attached for the student. Completed Answer Books may include those that were transcribed by the test examiner if the Initial ELPAC was administered remotely. Do not send incomplete Answer Books.

K–12 Writing for In-Person Administration Details

K–12 Writing for Remote Administration Details

Mandatory Steps

  • Pre-ID labels and Group Identification Sheets are generated monthly, on the basis of when an official SSR has been generated in TOMS Link to external site.
  • Pre-ID labels are to be attached to the Answer Books prior to shipping to ETS; do not send Answer Books without the Pre-ID label attached. Note the following about Pre-ID labels:
    • You must confirm that the student name on the Pre-ID label matches the student name on the Answer Book.
    • Pre-ID labels are shipped to the LEA automatically.
  • You must follow the instructions in the Initial ELPAC Rotating Score Validation Process User Instructions for Test Materials Handling After Testing (Posted 03/29/22) web document.

Comparison Report

  • You can refer to the Initial ELPAC Score Comparison Report Layout (Updated 09/22/21) for descriptions of the fields in the comparison report.
  • You should use the Guide to the Initial ELPAC Score Comparison Report (Updated 10/13/21) while reviewing the comparison report.
  • ETS raters score the Writing domain only to compare the local scores entered into the DEI (for K–2) or the THSS (for grades three through twelve).
  • Comparison reports are posted by mid-November and mid-December. The final file is posted by end of January.
  • An email notification will be sent to the LEA ELPAC coordinator when a comparison report is available for the LEA.

2022–23 RSVP Local Educational Agencies