The Academic Events Group, 6th INTERNATIONAL CONFERENCE ON EDUCATION

Font Size: 
The Influence of Using Plausible Values on Linear and Hierarchical Linear Regression Model Parameters
İlhan Koyuncu, Osman Tat, Selahattin Gelbal

Last modified: 2017-04-05

Abstract


In large-scale assessments like Programme for International Students Assessment (PISA) and the Trends in International Mathematics and Science Study (TIMMS), plausible values are often used as indicators of students’ ability estimations. In those studies, stratified sampling method is employed in order to select participants and the data gathered has a hierarchical structure.  In the context of large-scale assessments, plausible values refer to randomly drawn values from posterior ability distribution. It is reported that using one of plausible values or mean of those values as independent variable in linear models may lead to some estimation errors. Moreover, it is observed that sampling weights sometimes are not used during analysis of large-scale assessment data. This study aims to assess the influence of three approaches on the parameters of linear and hierarchical linear regression models: 1) using only one plausible value, 2) using all plausible values, 3) incorporating sampling weights or not.  Data used in the present study is obtained from school and student questionnaires in PISA (2015) Turkey database. Results revealed that the use of sampling weights and number of plausible values has significant effects on regression coefficients, standard errors and explained variance of both regression models. Findings of the study were discussed in details and some conclusions were drawn for practice and further research.