Rotating Score Validation Process and Form 2 Second Scoring for the Initial ELPAC
Rotating Score Validation Process (RSVP)
Approximately 10 percent of local educational agencies (LEAs) in California have been identified by the California Department of Education (CDE) to take part in the RSVP for the Initial English Language Proficiency Assessments for California (ELPAC). These identified LEAs return their scannable kindergarten through grade two (K–2) Writing Answer Books to the testing contractor, ETS, after all domains have been administered, locally scored Speaking and Writing scores have been entered, and parent/guardian notification of the results has been completed. Writing responses for grades three through twelve students in the test delivery system (TDS) are automatically sent to ETS. This process helps to produce item statistics for the Initial ELPAC and validates the LEA's scores for that testing period. Please note that, while the Initial ELPAC will have two forms for the 2024–25 test administration, only a subset of LEAs assigned to Form 1 will take part in RSVP specifically, although some LEAs assigned Form 2 will take part in Form 2 second scoring as described in the next section.
Form 2 Second Scoring
For the 2024–25 test administration only, there are select LEAs assigned Form 2 that have been chosen as a part of the Form 2 second scoring group, which only pertains to completed kindergarten Writing domain assessments. Similar to the RSVP group, the Form 2 second scoring group must submit their scannable kindergarten Answer Books to ETS after local scores for the Writing domain have been entered into the Data Entry Interface (DEI). Only identified LEAs will receive Pre-identification (Pre-ID) labels and precoded Group Identification Sheets (GISs) to return scannable Answer Books. This will allow the CDE and ETS to collect statistical item analyses of the Form 2 field test items for kindergarten and conduct a comparison between the results provided by LEAs and the results determined by ETS.
Computer-based Initial ELPAC
RSVP and second scoring LEAs administer the Writing domain to students in K–2 using the scannable 2024–25 Writing Answer Books for their assigned forms. Non-RSVP and non–second scoring LEAs receive nonscannable Writing Answer Books. All LEAs administer all other domains to students in kindergarten through grade twelve (K–12) using the TDS.
- Scores are to be entered as follows:
- Scores for the Listening and Reading domains are machine-scored in the TDS. Student responses in the TDS are received automatically by ETS for back-scoring as part of the RSVP.
- Speaking scores for all grade levels must be entered into the DEI.
- Writing scores for K–2 must be entered into the DEI.
- Writing scores for grades three through twelve must be entered into the Teacher Hand Scoring System (THSS).
- An individual Student Score Report (SSR) will be available in the Test Operations Management System (TOMS) within less than 24 hours after all domains have been administered and scored for a student.
- LEAs must return their scannable Form 1 K–2 Writing Answer Books and scannable Form 2 kindergarten Writing Answer Books to ETS after parent/guardian notification of the results has been completed and a Pre-ID label has been received and attached for the student. Completed Answer Books may include those that were transcribed by the test examiner if the Initial ELPAC was administered remotely. Do not send incomplete Answer Books.
K–12 Writing for In-Person Administration Details
| Document Type or Activity |
In-Person Testing: Non-RSVP and Non-Second Scoring LEA |
In-Person Testing: RSVP and Form 2 Second Scoring LEA |
| K–2 Answer Book |
The student writes in the nonscannable Answer Book. There is a note at the bottom of the cover page of the Answer Book indicating that the Answer Book is not scannable. |
The student writes in the scannable Answer Book. There is no note on the cover page of the Answer Book. |
| Grades Three Through Twelve Writing Response |
The student types the responses directly into the TDS. |
The student types the responses directly into the TDS. |
| Scoring for K–2 |
The test examiner scores the student's responses and enters them into the DEI. |
The test examiner scores the student's responses and enters them into the DEI. |
| Scoring for Grades Three Through Twelve |
The test examiner scores the student's responses in the THSS. |
The test examiner scores the student's responses in the THSS. |
| Answer Book, After Testing |
The nonscannable Answer Book is securely shredded by the LEA at the end of the test administration window.
Note: If the student is being tested closer to the end of the test administration window, please remember that parents/guardians should be provided with 30 days to request a review of the results before destruction.
|
After receipt of the Pre-ID label, the completed, scannable Answer Books—with the Pre-ID label attached—are shipped to the testing contractor for assessments administered between July and October.
Note: LEAs should hold completed Answer Books for 30 days after the scores have been reported to the parent/guardian to give the parent/guardian an opportunity to review the results before Answer Books are sent to the testing contractor.
|
K–12 Writing for Remote Administration Details
| Document Type or Activity |
Remote Testing: Non-RSVP and Non-Second Scoring LEA |
Remote Testing: RSVP and Form 2 Second Scoring LEA |
| K–2 Test Examiner Document |
The test examiner uses the Writing Teacher Answer Book PDF to share through a virtual meeting application (e.g., Zoom or Google Meet) during the video meeting and has a copy of the student Answer Book to mark scores in the moment. At the end of each completed page, screen captures of the student's writing are acceptable but must be deleted immediately after scoring. |
The test examiner uses the Writing Teacher Answer Book PDF to share through a virtual meeting application (e.g., Zoom or Google Meet) during the video meeting and has a copy of the scannable Answer Book to transcribe students' responses and mark scores. At the end of each completed page, screen captures of the student's writing are acceptable but must be deleted immediately after transcription and scoring. |
| K–2 Student Document, Option 1—Student Writing Response Sheet, blank paper, or whiteboard |
Option 1: The student uses Student Writing Response Sheets (found in TOMS), blank pieces of paper, or a whiteboard to write the responses; and then the student holds the responses in front of the web camera for the test examiner to view. There is no transcription. |
Option 1: The student uses Student Writing Response Sheets (found in TOMS), blank pieces of paper, or a whiteboard to write the responses; and then the student holds the responses in front of the web camera for the test examiner to view. The test examiner transcribes the student's responses into the scannable Answer Book. At the end of each completed page, the test examiner can take a screen capture of the student's Answer Book to assist with transcription, if necessary. Screen captures must be deleted immediately after transcription and scoring. |
| K–2 Student Document, Option 2—Send and return Answer Book to the student |
Option 2: The LEA sends the Answer Book to the student's location through parent/guardian pickup. The student writes responses in the Answer Book, which is then returned to the school by the parent/guardian in a sealed envelope. |
Option 2: The LEA sends the scannable Answer Book to the student's location through parent/guardian pickup. The student writes responses in the scannable Answer Book, which is then returned to the school by the parent/guardian in a sealed envelope. |
| Scoring for Options 1 and 2 |
The test examiner scores student's written responses and then enters the scores into the DEI. |
The test examiner scores student's written responses and then enters the scores into the DEI. |
| Answer Book, After Testing |
The Answer Book, if used, is securely shredded by the LEA at the end of the test administration window.
Note: If the student is being tested closer to the end of the test administration window, please remember that parents/guardians should be provided with 30 days to request a review of the results before destruction.
|
After the receipt of the Pre-ID label, the completed, scannable Answer Books—with the Pre-ID label attached—are shipped to the testing contractor for tests administered between July and October.
Note: LEAs should hold completed Answer Books for 30 days after the scores have been reported to the parent/guardian to give an opportunity for the parent/guardian to review the results before Answer Books are sent to the testing contractor.
|
| Grades Three Through Twelve Writing Response |
The student types the responses directly into the TDS. |
The student types the responses directly into the TDS. |
| Scoring for Grades Three Through Twelve |
The test examiner scores the student's responses in the THSS. |
The test examiner scores the student's responses in the THSS. |
Mandatory Steps
LEAs must ship Answer Books for students tested on or before October 31, 2024, to ETS following the schedule in the Materials Return Dates table. The last date to ship Answer Books back to ETS is December 9, 2024.
| Initial ELPAC Administration |
Pre-ID and GIS to Arrive at LEA by |
Ship Answer Books to ETS by |
| July 3 to August 2, 2024 |
August 19, 2024 |
September 6, 2024 |
| August 5 to September 3, 2024 |
September 23, 2024 |
October 14, 2024 |
| September 4 to September 27, 2024 |
October 14, 2024 |
October 25, 2024 |
| September 30 to October 31, 2024 |
November 18, 2024 |
December 9, 2024 |
- Pre-ID labels and GISs are generated monthly, based on when an official SSR has been generated in
.
- Pre-ID labels are to be attached to the Answer Books prior to shipping to ETS; do not send Answer Books without the Pre-ID label attached. Note the following about Pre-ID labels:
- The student name on the Pre-ID label must match the student name on the Answer Book.
- Pre-ID labels are shipped to the LEA automatically.
Comparison Report for RSVP
- Descriptions of the fields in the comparison report are found in the (Posted 12/07/23).
- Additional information about the comparison report is found in the (Updated 10/05/22).
- Data from when ETS raters scored the Writing domain is used only to compare the local scores entered into the DEI (for K–2) or THSS (for grades three through twelve).
- Comparison reports are posted by mid-November and mid-December. The final file is posted by the end of January.
- An email notification will be sent to the LEA ELPAC coordinator when a comparison report is available for the LEA.
2023–24 RSVP Local Educational Agencies
