Reliability and Validity Study of A Computer-based English Test
GUAN Dandan;LI Ying;National Educational Examinations Authority;
In this study, PETS-5 computer-based English test is designed and implemented. A total of 404 students from overseas training class are selected to take the test. After the test, a questionnaire survey is conducted online to investigate the feelings and opinions of the participants towards the computer-based test. And the PETS-5 paper-pencil test scores of the examinees are collected. The results show that(1) the overall Alpha reliability of the computer-based test is 0.82, and the reliability of every section is 0.63-0.65, which indicate good internal consistency reliability.(2) The correlation among various sections is 0.34-0.43, similar to the results of each part of the paper-pencil test, which reveals good construct validity.(3) The correlation between the computer-based test scores and paper-pencil test scores is 0.709,which means good criterion-related validity.(4) The computer-based test is fair for males and females,and there is no gender DIF in the test.(5) The t-test results show that male and female candidates only have gender differences in reading comprehension scores, and the average score of the male is higher than that of the female.
【CateGory Index】： G434;H310.4