Rotating Score Validation Process for the Initial ELPAC

Rotating Score Validation Process for the Initial ELPAC

Approximately 10 percent of local educational agencies (LEAs) in California have been identified by the California Department of Education (CDE) to take part in the Rotating Score Validation Process (RSVP) for the Initial English Language Proficiency Assessments for California (ELPAC). These identified LEAs return their scannable kindergarten through grade two Writing Answer Books to the testing contractor, ETS, after all domains have been administered, locally scored Speaking and Writing scores have been entered, and parent/guardian notification of the results has been completed. This process helps to produce item statistics for the Initial ELPAC and validates the LEA’s scores for that testing period.

Computer-based Initial ELPAC

  • RSVP LEAs administer the Writing domain to students in kindergarten through grade two (K–2) using the scannable 2021–22 Form 1 Writing Answer Books. (Non-RSVP LEAs receive nonscannable Form 1 Writing Answer Books.) RSVP and non-RSVP LEAs administer all other domains to students in kindergarten through grade twelve using the test delivery system (TDS).
  • Scores are to be entered as follows:
    • Scores for the Listening and Reading domains are machine-scored in the TDS. Student responses in the TDS are received automatically by ETS for back scoring as part of the RSVP process.
    • Speaking scores for all grades must be entered into the Data Entry Interface (DEI).
    • Writing scores for K–2 must be entered into the DEI.
    • Writing scores for grades three through twelve must be entered in the Teacher Hand Scoring System (THSS).
  • Student Score Reports will be available in the Test Operations Management System (TOMS) after all domains have been administered and scored, within less than 24 hours.
  • LEAs must return their scannable K–2 Writing Answer Books to ETS after parent/guardian notification of the results has been completed and a pre-identification (Pre-ID) label has been received and attached for the student. Completed Answer Books may include those that were transcribed by the test examiner if the Initial ELPAC was administered remotely. Do not send incomplete Answer Books.

Kindergarten Through Grade Twelve Writing for In-Person Administration Details: Rotating Score Validation Process (RSVP) vs Non-RSVP

Document Type or Activity In-Person Testing: Non-‍RSVP Local Educational Agency (LEA) In-Person Testing: RSVP LEA
Kindergarten Through Grade Two Answer Book The student writes in the nonscannable Answer Book. There is a note at the bottom of the cover page of the Answer Book indicating that the Answer Book is not scannable. The student writes in the scannable Answer Book. There is no note on the cover page of the Answer Book.
Grade Three Through Twelve Writing Response The student types the responses directly into the test delivery system. The student types the responses directly into the test delivery system.
Scoring for Kindergarten Through Grade Two The test examiner scores student's responses and enters them into the Data Entry Interface (DEI). The test examiner scores student's responses and enters them into the DEI.
Scoring for Grades Three Through Twelve The test examiner scores the student's responses in the Teacher Hand Scoring System (THSS). The test examiner scores the student's responses in the THSS.
Answer Book, After Testing

The nonscannable Answer Book is securely shredded by the LEA at the end of the test administration window.

Note: If you are testing closer to the end of the test administration window, please remember that parents/guardians should be provided with 30 days to request a review of the results before destruction.

After receipt of the pre-identification (Pre-ID) label, the completed, scannable Answer Books—with the Pre-ID label attached—are shipped to the contractor for tests administered between July and October. Refer to the Initial ELPAC Rotating Score Validation Process User Instructions for Test Materials Handling After Testing.

Note: LEAs should hold completed Answer Books for 30 days after the scores have been reported to the parent/guardian, to give an opportunity for the parent/guardian to review the results before sending the Answer Books to the contractor.

Mandatory Steps

  • Pre-ID labels and Group Identification Sheets (GIS) are generated monthly, based on when an official Student Score Report has been generated in TOMS.
  • Pre-ID labels are to be attached to the Answer Books prior to shipping to ETS; do not send Answer Books without the Pre-ID label attached. Note the following about Pre-ID labels:
    • You must confirm that the student name on the Pre-ID label matches the student name on the Answer Book.
    • Pre-ID labels are shipped to the LEA automatically based on the schedule in the Materials Return Dates table in the next section.
  • Follow the instructions in the Initial ELPAC Rotating Score Validation Process User Instructions for Test Materials Handling After Testing (Posted 05/20/21) web document.

Comparison Report

  • Refer to the Initial ELPAC Score Comparison Report Layout for descriptions of the fields in the comparison report. The layout is updated in September.
  • The Guide to the Initial ELPAC Score Comparison Report is updated in November.
  • ETS raters score the Writing domain only to compare the local scores entered in the DEI (for grades K–2) or the THSS (for grades three through twelve).
  • Comparison reports are posted by mid-November and mid-December. The final file is posted by end of January.
  • An email notification will be sent to the LEA ELPAC coordinator when a comparison report is available for the LEA.

2021–22 RSVP Local Educational Agencies

2020–21 RSVP Local Educational Agencies