Using the 2006 PISA Questionaire to Evaluate the Measure of Educational Resources: A Rasch Measurement Approach

Ruixue Liu, Letao Sun, Jing Yuan, Kelly Bradley

Abstract


School educational resource is a key focus when studying school improvement due to its influence on learning outcomes.  Because of this, careful attention should be given to the way educational resource is operationalized and measured.  Using the 2006 PISA American sample containing 166 schools, this paper aims to validate the 13-item PISA School Educational Resource Scale with Rasch analysis.  Winsteps software was used in the analysis to evaluate how well the instrument measured the construct of school educational resource.  The results revealed that the PISA 2006 data gave an overall indication of good fit to the model despite the instrument did not separate respondents well.  In regards to the quality of items, the majority of items perform consistently with the model.  However, there are not enough items to discriminate the situation of school education resource for schools which are above the average educational resources.  


Keywords


school educational resource; PISA; Rasch rating scale model

Full Text:

PDF

References


Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 357-74.

Andrich, D. & Luo, G. (2003). Conditional pairwise estimation in the Rasch model for ordered response Categories using principal components. Journal of Applied Measurement, 4(3), 205-221.

Archibald, S. (2006). Narrowing in on educational resources that do affect student achievement. Peabody Journal of Education, 81(4), 23-42. doi: 10.1207/s15327930pje8104_2

Ammermueller, A., Heijke, H., Woessmann, L. (2005). Schooling quality in Eastern Europe: Educational production during transition. Economical Educational Review, 24 (5), 579-599.

Bond, T., & Fox, C. (2001). Applying the Rasch model: Fundamental measurement in the human sciences. Mahwah, NJ: Lawrence Erlbaum Associates.

Card, D., & Krueger, A. (1996). School resources and student outcomes: An overview of the literature and new evidence from North and South Carolina. Journal of Economic

Perspectives. doi: jep.10.4.31

Check, J., & Schutt, R. (2012). Research Methods in Education. Boston, MA: SAGE Publications.

Coleman, J. S., Hoffer, C., & York, R. (1966). The equality of educational opportunity study. Washington, DC: United States Department of Health, Education, and Welfare.

Crocker, P. R. E., Kowalski, K. C., & Graham, T. (1998). Measurement of coping strategies in sport. In J. L. Duda (Ed.), Advances in sport and exercise psychology measurement (pp. 149-169). Morgantown, WV: Fitness Information Technology.

Dodson, C. K. (2005). The Relationship between School Effectiveness and Teachers' Job Satisfaction in North Mississippi Schools. Unpublished Doctoral Dissertation, Mississippi University, Oxford.

Fan, M. (2013). Stability of Academic Performance Across Science Subjects Among Chinese Students (Master’s theses). Retrieved from http://uknowledge.uky.edu/edp_etds/15.

Greenwald, R., Hedges, L. V., & Laine, R. D. (1996). The effect of school resources on student achievement. Review of Educational Research, 66(3), 361-396. doi: 10.3102/00346543066003361

Hanushek, E. (1997). Assessing the effects of school resources on student performance: An update. Educational Evaluation and Policy Analysis, 19(2), 141-164. doi: 10.2307/1164207

Hanushek, E. A., & Luque, J. A. (2003). Efficiency and equity in schools around the world. Economics of Education Review, 22, 481-502. doi: 10.1016/S0272-7757(03)00038-4

Hedges, L. V., Laine, R. D., & Greenwald, R. (1994). Does money matter? A meta- analysis of studies of the effects of differential school inputs on student outcomes. Educational Researcher, 23(3), 5-14. doi: 10.2307/2655116

Jacob, B. & Ludwig, J. (2008). Improving Educational Outcomes for Poor Children. Cambridge, MA: National Bureau of Economic Research.

Johnson, A. D. (2008). The relationships among middle school student and staff perceptions of school effectiveness and student achievement. (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses.

Lezotte, L. W. (2001). Revolutionary and Evolutionary: The Effective Schools Movement. Retrieved from http://www.edutopia.org/pdfs/edutopia.org-closing-achievement-gap lezotte-article.pdf.

Linacre, J. M. (2002).What do Infit and Outfit, Mean-square and Standardized mean? Rasch Measurement Transactions, 16(2), 878.

Linacre, J. M. (2009). A user's guide to Winsteps, Ministep, Rasch-model computer programs: Program manual 3.72.3. Retrieved from http://www.winsteps.com/a/winsteps-manual.pdf.

Ma, X. (2001). Stability of school academic performance across subject areas. Journal of Educational Measurement, 38(1), 1-18.

Marsh, H. (1993). The multidimensional structure of physical fitness: invariance over gender and age. Research Quarterly for Exercise and Sport, 64(3), 256–273. doi: 10.1080/02701367.1993.10608810

Mortimore, P., Sammons, P., Stoll, L., Lewis, D., & Ecob, R. (1988). School matters. Berkeley, CA: The University of California Press.

Murnane, R. (1981). Interpreting the evidence on school effectiveness. Teachers College Record, 83(1), 19-35.

Organization for Economic Cooperation and Development. (1994). Making education count: Developing and using international indicators. Paris: Author.

Organization for Economic Cooperation and Development (2010). PISA 2009 Results: What Makes a School Successful? – Resources, Policies and Practices (Volume IV). Paris: Organization for Economic Cooperation and Development.

Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Chicago: The University of Chicago Press.

Reid, K., Hopkins, D., & Holly, P. (1987). Towards the effective school. Oxford: Blackwell.

Reynolds, D & Creemers, B. (1990). School effectiveness and school improvement: A mission statement, School Effectiveness & School Improvement, 1(1): 1-3.

doi: 10.1080/0924345900010101

Reynolds, D., Creemers, B., Stringfield, S., Teddlie, C., & Schaffer, G. (2002). World class school: International perspectives on school effectiveness. London: Routledge Farmer.

Smith, R. M. (1996). Polytomous mean-square fit statistics. Rasch Measurement Transactions, 10, 516-517.

Schneider, B. (1985). Further evidence of school effects. Journal of Educational Research, 78(6), 351-356.

Stanco, G. (2012). Using TIMSS 2007 data to examine STEM school effectiveness factors in an international context. (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses.

Teddlie, C., & Stringfield, S. (1993). Schools make a difference: lessons learned from a 10-year study of school effects. New York: Teachers College Press.

Teddlie, C., & Reynolds, D. (2000). The international handbook of school effectiveness research. London: Falmer Press.

Teddlie, C. (2004). Getting schools working in South Africa: A valuable addition to the SESI field. School Effectiveness and School Improvement, 15(2), 227-240.

Waugh, R. & Chapman, E., (2005). An analysis of dimensionality using factor analysis (true score theory) and Rasch measurement: what is the difference? Which method is better? Journal of Applied Measurement, 6(1):80-99.

Woessmann, L. & West, M. (2006). Class-size effects in school systems around the world: Evidence from between-grade variation in TIMSS. Europe Economic Review, 50(3), 695–736. doi: ssrn.308559

Wright, B. D., & Linacre, J. M. (1989). Observations are always ordinal: Measurements, however, must be interval. Archives of Physical Medicine and Rehabilitation, 70(12), 857-860.

Wright, B. D., & Masters, G. N. (1982). Rating scale analysis. Chicago, IL: MESA Press.

Yan, Z. & Mok, M. (2012). Validating the coping scale for Chinese athletes using multidimensional Rasch analysis. Psychology of Sport and Exercise, 13, 271-279. doi: 10.1016/j.psychsport.2011.11.013.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.