PA Dept. of Education: Test Security & Administration Roles, Schemes and Mind Maps of English Language

Download PA Dept. of Education: Test Security & Administration Roles and more Schemes and Mind Maps English Language in PDF only on Docsity! pennsylvania DEPARTMENT OF EDUCATION Pennsylvania System of School Assessment (PSSA) and Keystone Exams Handbook for Secure Test Administration Revised January 2020 Page 1 of 11 ~ pennsylvania u DEPARTMENT OF EDUCATION Handbook for Secure Test Administration Security Statement State assessments rely on the measurement of individual achievement. Any deviation from procedures meant to ensure test validity and security (e.g., group work, teacher coaching, teaching or release of any test items, use of previously administered Pennsylvania assessments as preparation tools) is strictly prohibited and will be considered a violation of test security. Local Education Agency (LEA)/school personnel with access to the assessment materials must not review, discuss, disseminate, or otherwise reveal the contents to anyone. (This prohibition excludes the Item and Scoring Samplers available on the Pennsylvania Department of Education’s (PDE’s) website.) Any action by a professional employee or commissioned officer that is willfully designed to divulge test questions, falsify student scores, or compromise the integrity of the state assessment system will be subject to disciplinary action under the Educator Discipline Act, 24 P.S. §§ 2070.1a et seq, which may include a private reprimand, a public reprimand, a suspension of his/her teaching certificate(s), a revocation of his/her teaching certificate(s), and/or a suspension or prohibition from being employed by a charter school. Training and Test Administration Procedures The purpose of this handbook is to assist in the training of LEA/school personnel to properly and securely administer state assessments. This handbook is also an important and valuable resource in implementing testing successfully from planning and preparing to collecting and returning tests. Roles and Responsibilities: Training The District Assessment Coordinator (DAC) is responsible for completing all of the Pennsylvania State Test Administration Trainings (PSTATs) provided by PDE for the DACs, SACs, and TAs/Proctors. DACs must complete the Data Recognition Corporation (DRC) training on receiving and packaging materials, and any DAC specific training provided by the PDE. The DAC is then responsible for coordinating all training that takes place in the LEA and for determining specifics related to test administration such as a schedule, type of administration (paper/pencil or online) and other LEA-level administrative aspects of the testing. The DAC is responsible for ALL training in the LEA with primary responsibility for the direct training of SACs. In some LEAs the DAC may train the LEA-level staff who handle and/or have access to secure test material. The SAC receives training from the DAC and must also complete both the PSTAT training for SACs and for TAs/ Proctors. The SAC is then responsible to oversee all aspects of test administration in a building, including training Test Administrators (TAs), proctors, and other building level staff. The TAs/Proctors must complete the PSTAT training for TAs/Proctors. The TAs/Proctors are responsible for administering the assessment and monitoring students during the assessment. Translators, interpreters, and scribes must complete the PSTAT training for TAs/Proctors and must also complete the training offered by the school/district. The Handbook for Assessment Coordinators provides more information related to training. Page 4 of 11 ~ pennsylvania u DEPARTMENT OF EDUCATION Suspected testing irregularities/security breaches must immediately be reported to the Pennsylvania Department of Education. For the most rapid response, irregularities and/or allegations should be reported to PDE via ra-ed-pssa-keystone@pa.gov. You may also report by phone at 844-418-1651; however, using the telephone may delay the response. After Test Administration – DAC Collect tests from SAC(s) (ship-to-district). Complete the Materials Accountability Form after inventorying, packaging, and returning the materials to the vendor. NOTE: DACs should not open or look into answer booklets or test booklets. Record the UPS Tracking Number for each package, noting the assessment(s) for which it was used and the content of each box. Please keep the number(s) for future reference to document the materials returned to DRC. Sign the Test Security Certification (District Assessment Coordinator). The DAC should sign the Test Security Certification at the end of each testing window. Failure to account for and/or return assessment materials constitutes a breach in security, the consequences of which can be severe, up to and including remuneration should it be determined loss of or misappropriation of materials has compromised the integrity of test items. B. SCHOOL ASSESSMENT COORDINATOR AND/OR BUILDING PRINCIPAL TEST SECURITY GUIDELINES General Statement: Maintain the security and integrity of all assessment materials, prevent any dishonest or fraudulent behavior in the administration and handling of the assessment, and promote a fair and equitable testing environment in order to obtain reliable and valid student scores. Before Test Administration – SAC Attend the annual training for SACs provided by the DAC. Complete the PSTAT training for SACs and for TAs/Proctors annually. Review DFA’s, the Handbook for Assessment Coordinators, Accommodations Guidelines and Online User Guides (if testing online). Develop a building level master test schedule (including make-ups) that falls within PDE established testing windows for each administration and include it in training. Ensure that the test schedule is developed so that sections are administered in the sequence in which they are printed in the test booklets. Develop an agenda and train TAs/Proctors and other building level personnel (review the Handbook for Assessment Coordinators for more information). Ensure that all individuals involved in the handling of assessment materials and/or the administration of the assessment receive instruction regarding test security protocols and procedures. Ensure that all TAs/Proctors receive a copy of the TA/Proctor Test Security Certification. Page 5 of 11 ~ pennsylvania u DEPARTMENT OF EDUCATION Ensure that all individuals who will administer and/or proctor the assessment complete the Pennsylvania State Test Administration Training (PSTAT). Translators, interpreters, and scribes must complete the PSTAT training for TAs/Proctors and must also complete the training offered by the school/district. Ensure that all individuals involved in the handling and/or administration of the assessment receive instruction that all assessment materials must remain secure. This includes all assessment booklets and other materials containing secure assessment questions and student responses that must be kept secure and precisely accounted for in accordance with the procedures specified in the Handbook for Assessment Coordinators. Ensure that all TAs/Proctors are instructed on the policy regarding electronic devices (cell phones, smartphones, smartwatches, cameras, etc.). Ensure that all individuals who assist in the administration of the assessment and all individuals who have access to the secure assessment materials are instructed that they are not in any manner to alter or cause the alteration of any examinee response, assessment booklet, or papers used by examinees. Create and maintain the PAsecureID list (refer to the Handbook for Assessment Coordinators for specific instructions). Ensure all students are scheduled for the appropriate assessment. Ensure TAs/Proctors understand that each assessment returned will be linked to the TA who administered the assessment. For paper/pencil assessments, TA initials will be collected on the back page of each answer booklet. For online testing, teacher (TA) names must be included with each online test session created. This will link the TA to the online session prior to test tickets being generated. Ensure that students testing online have prior experience with the online practice test and tools that model the testing mode (online). Maintain a contingency plan for breaks and for disruptions during testing. Ensure monitoring software or spyware is disabled or removed from computers, iPads, and Chromebooks to be used for testing. Ensure all instructional materials that could aid students in answering test items are covered with opaque material or removed from classrooms and hallways. Make sure the testing environment is secure and educationally appropriate. Know the required accommodations and those allowable accommodations for each student with an IEP or 504 Service Plan and/or for each English Learner being assessed and communicate this to the appropriate personnel. Provide the appropriate testing environment for each student requiring an accommodation. Inventory tests received in “ship to district.” If additional materials are needed, notify DRC. In a “ship to school” the SAC should order additional materials, if needed. Report any shipping or ordering mistakes immediately to DRC. Create Test Sessions in the DRC INSIGHT portal (if testing online). Make sure to list the correct TA when creating test sessions in the DRC INSIGHT portal. Page 6 of 11 ~ pennsylvania u DEPARTMENT OF EDUCATION Put labels on answer booklets (Do not open test booklets while labeling). Place a “Testing—Do Not Disturb” sign on doors where testing is occurring. During Test Administration – SAC Develop and maintain a procedure for distribution and collection of secure test materials to TAs each day utilizing a sign-out/sign-in process. It is recommended that TAs count the test booklets in the presence of the SAC or his/ her designee. Ensure that TAs are following proper testing protocols. Make sure students are supervised at all times during testing and all breaks. This supervision requirement includes those students who need additional time to complete any test session. If there is a disruption (e.g., fire alarm, power outage) ensure the safety of students at all times, and take appropriate precautions concerning the security of the test and answer booklets. Ensure secure processes and procedures for extended time. Do not allow students to move to an extended time location without a TA and do not allow students to carry materials to an extended time session/location. Make sure that sections/modules are started and completed in the same day. Minimize distractions, including intercom announcements. Ensure tests are stored in a locked area with controlled and limited access. Report suspected testing irregularities/security breaches to the DAC. If the DAC is unavailable for an extended time or has any involvement in the testing irregularity, PDE must be contacted directly. For the most rapid response, irregularities and/or allegations should be reported to PDE via ra-ed-pssa-keystone@pa.gov. You may also report by phone at 844-418-1651; however, using the telephone may delay the response. After Each Testing Session – SAC Collect all materials from TAs excluding copies of the DFA. Account for all test booklets and answer booklets daily. It is recommended that the SAC or his/her designee count the test booklets in the presence of the TA. Store testing materials in a locked, secure location. Destroy scratch/grid paper, rough drafts and any other paper on which students have written. Page 9 of 11 ~ pennsylvania u DEPARTMENT OF EDUCATION After Each Testing Session – TA/Proctor Return all scratch/grid paper, rough drafts or any other paper on which students have written to the SAC to be destroyed. Account for all test booklets and answer booklets daily and return all secure testing materials to the SAC immediately after the testing session each day. It is recommended that the SAC or his/her designee count the test booklets in the presence of the TA. Failure to account for and/or return assessment materials constitutes a breach in security, the consequences of which can be severe, up to and including remuneration should it be determined loss of or misappropriation of materials has compromised the integrity of test items. Clear the memory of calculators before and after each testing session. After Test Administration – TA/Proctor Sign the Test Security Certification (Test Administrator/Proctor) and return it to the SAC. The TA/Proctor should sign the Test Security Certification at the end of each testing window. D. GENERAL TEST SECURITY GUIDELINES The assessments rely on the measurement of individual achievement. Any deviation from assessment procedures is strictly prohibited and will be considered a violation of test security. School administrators, teachers, and any other education personnel who are involved in the assessment program must maintain the security of all assessment materials at all times. Because the assessment must remain secure, teachers/TAs should not have assessment materials in their possession at any time other than during the actual assessment administration. Before Test Administration DO NOT: Teach students a test-taking technique that would require them to bubble more than one response to a test question and then return and erase all but one response. Review student test booklets except for purposes as stated in the Directions for Administration Manual and any of the accommodations guidelines documents. Knowledge or review of test items is not necessary for valid test administration and is prohibited. Note: Interpreters may have access to test materials three days prior to test administration to prepare for accurate interpretation of the test. Reveal any part of copyrighted materials to anyone. Copy or otherwise reproduce any part of copyrighted materials. Review and/or provide answers to test items to students. This includes using any of the test items for instructional purposes. Possess unauthorized copies of state tests. Page 10 of 11 ~ pennsylvania u DEPARTMENT OF EDUCATION Assist in, direct, aid, counsel, encourage, or fail to report immediately any of the actions prohibited in this document. During Test Administration DO NOT: Leave students unattended with testing materials or permit any student to leave the testing site with testing materials for any reason. Permit students to have unauthorized electronic devices in their possession or accessible to them. Permit students to look ahead to another section or module of the test before being instructed to do so, or allow students to look back in a test booklet once a test section or module has been completed. Discuss, disseminate, or otherwise reveal contents of the test to anyone. Possess secure test materials at any time other than during the actual administration of the test. TAs should be given the secure materials immediately prior to the administration of the test, and the materials must be collected and counted by the SAC immediately after the testing session ends each day. Coach or provide feedback to students (e.g., answer any questions pertaining to the content of the test, review rough drafts, or give students feedback of any kind including indicating items students may not have answered correctly). This prohibition applies to, but is not limited to, Personal Care Aides (PCA), Therapeutic Support Staff (TSS), or any other one-on-one aide who is assigned to a student. Define or clarify a word in a test item. Deviate from any of the read-aloud rules for any portion of the assessments. (The Pennsylvania Read-Aloud and Scribing Guidelines for Operational Assessments can be found on the PDE website.) Read aloud any part of the assessments that will cue the correct answer(s) or provide a hint for the test taker. Read-aloud the parts of the assessment that are not permitted to be read-aloud. Return a test booklet to any student after it has been turned in to the TA, unless approval is granted by PDE, or for the reasons noted in the following sentence. Test booklets will be returned to students for makeup sessions for absences and for students who go to another testing site for extended time. Alter, influence, or interfere with a test response in any way; fill in any unanswered item, or instruct the student to do so. Assist in, direct, aid, counsel, encourage, or fail to report any of the actions prohibited in this document. Play music while students are taking the test. Page 11 of 11 ~ pennsylvania u DEPARTMENT OF EDUCATION After Test Administration DO NOT: Discuss, disseminate, or otherwise reveal the contents of the test to anyone. Keep/save, copy, reproduce, or use any test, test item, specific test content, or examinee responses to any item or any section of a secure test in any manner inconsistent with the instructions provided by and through the Pennsylvania Department of Education. This includes using any of the test items for instructional purposes. Review student responses in the answer booklet. Read or review test booklets or answer booklets containing the test items. Alter, influence, or interfere with a test response in any way, fill in any unanswered items, or instruct the student to do so. Discuss or provide feedback regarding test items. Copy or reproduce any portion of the secure test materials or prepare/provide answer keys. Erase or change student answers. Make false or misleading statements about assessment results, including inappropriate interpretations, inaccurate reports, or unsubstantiated claims. Erase stray marks or darken bubbles or make any alteration to a student’s test. Assist in, direct, aid, counsel, encourage, or fail to report any of the actions prohibited in this document. DO: Immediately report suspected testing irregularities/security breaches. TAs/Proctors should report to the SAC/Building Principal; SACs should report directly to the DAC. In either case if the appropriate coordinator, whether SAC or DAC, is unavailable for an extended time or has any involvement in the testing irregularity, contact PDE directly. For the most rapid response, irregularities and/or allegations should be reported to PDE at ra-ed-pssa-keystone@pa.gov. You may also report by phone at 844-418-1651; however, using the telephone may delay the response. Sign the Test Security Certification (General). Those involved with testing should sign the Test Security Certification at the end of each testing window.