Reliability and Validity Study of A Computer-based English Test
GUAN Dandan;LI Ying;National Educational Examinations Authority;
In this study, PETS-5 computer-based English test is designed and implemented. A total of 404 students from overseas training class are selected to take the test. After the test, a questionnaire survey is conducted online to investigate the feelings and opinions of the participants towards the computer-based test. And the PETS-5 paper-pencil test scores of the examinees are collected. The results show that(1) the overall Alpha reliability of the computer-based test is 0.82, and the reliability of every section is 0.63-0.65, which indicate good internal consistency reliability.(2) The correlation among various sections is 0.34-0.43, similar to the results of each part of the paper-pencil test, which reveals good construct validity.(3) The correlation between the computer-based test scores and paper-pencil test scores is 0.709,which means good criterion-related validity.(4) The computer-based test is fair for males and females,and there is no gender DIF in the test.(5) The t-test results show that male and female candidates only have gender differences in reading comprehension scores, and the average score of the male is higher than that of the female.