Measuring the data literacy of student teachers

Main Article Content

Edmond Sebestyén
Edit Tóth

Abstract

The systematic collection, analysis, interpretation and application of pedagogical information to improve the teaching-learning process has been receiving increasing attention in educational research. Providing teachers with the base for complex use of data begins in teacher education. In our research, we investigate the sense of efficacy and anxiety students in teacher education (N=221) about data use - access, analysis, interpretation and application – among students in teacher education (N=221) using the Data-Driven Decision-Making Efficacy and Anxiety Inventory (Dunn et al., 2013) questionnaire. We also examine the relationship between acquired knowledge in data use and sense of efficacy and anxiety. Our results show that students feel least effective in data processing, but are also more uncertain about interpretation than about the application of results. Their sense of anxiety about data use is low. No difference can be detected in sense of efficacy and anxiety about data use based on time spent in teacher training. However, attitudes towards data use are influenced by the course(s) the student has attended to support their proficiency in data use. Thus, the acquired knowledge during training is likely to increase students’ sense of efficacy and reduce their anxiety about using data.

Downloads

Download data is not yet available.

Article Details

How to Cite
Sebestyén, E., & Tóth, E. (2022). Measuring the data literacy of student teachers. Iskolakultúra, 32(12), 3–21. https://doi.org/10.14232/iskkult.2022.12.3
Section
Study

Funding data

References

Airola, D. T. & Dunn, K. E. (2011). Oregon DATA project final evaluation report. Next Level Evaluation, Inc.

Avramides, K., Hunter, J., Oliver, M. & Luckin, R. (2015). A method for teacher inquiry in cross-curricular projects: Lessons from a case study. British Journal of Educational Technology, 46(2), 249–264. DOI: 10.1111/bjet.12233

Bandura, A. (1977). Self-efficacy: toward a unifying theory of behavioral change. Psychological review, 84(2), 191. DOI: 10.1037/0033-95x.84.2.191

Bandura, A. (1997). Self-efficacy: The exercise of control. W. H. Freeman and Company.

Bettesworth, L. R., Alonzo, J. & Duesbery, L. (2008). Swimming in the depths: Educators’ ongoing effective use of data to guide decision making. na. DOI: 10.4324/9780203888803-26

Blatchford, P. & Russell, A. (2019). Class size, grouping practices and classroom management. International Journal of Educational Research, 96, 154–163. DOI: 10.1016/j.ijer.2018.09.004

Bolhuis, E. D. (2017). How teacher educators learn to use data in a data team. Dissertation. University of Twente.

Brown, G. T. (2006). Teachers’ conceptions of assessment: Validation of an abridged version. Psychological reports, 99(1), 166–170. DOI: 10.2466/pr0.99.1.166-170

Bruce, C. D., Esmonde, I., Ross, J., Dookie, L. & Beatty, R. (2010). The effects of sustained classroom-embedded teacher professional learning on teacher efficacy and related student achievement. Teaching and Teacher Education, 26(8), 1598–1608. DOI: 10.1016/j.tate.2010.06.011

Brühwiler, C. & Blatchford, P. (2011). Effects of class size and adaptive teaching competency on classroom processes and academic outcome. Learning and instruction, 21(1), 95–108. DOI: 10.1016/j.learninstruc.2009.11.004

Coburn, C. E. & Turner, E. O. (2011). Research on data use: A framework and analysis. Measurement: Interdisciplinary Research & Perspective, 9(4), 173–206. DOI: 10.1080/15366367.2011.626729

Csapó, B. (2007). A tanári tudás szerepe az oktatási rendszer fejlesztésében. Új Pedagógiai Szemle, 57(3–4), 11–23.

Daly, A. J. (2012). Data, dyads, and dynamics: Exploring data use and social networks in educational improvement. Teachers College Record, 114(11), 1–38.

Dunn, K. E. (2016). Educational psychology’s instructional challenge: Pre-service teacher concerns regarding classroom-level data-driven decision-making. Psychology Learning & Teaching, 15(1), 31–43. DOI: 10.1177/1475725716636975

Dunn, K. E., Airola, D. T., Lo, W. J. & Garrison, M. (2013). What teachers think about what they can do with data: Development and validation of the data driven decision-making efficacy and anxiety inventory. Contemporary Educational Psychology, 38(1), 87–98. DOI: 10.1016/j.cedpsych.2012.11.002

Dunn, K. E., Airola, D. T. & Hayakawa, T. (2020). Pre-Service Teacher’s Efficacy, Anxiety, and Concerns about Data and the New Idea of Anchored

Judgment. Current Issues in Education, 21(1). https://cie.asu.edu/ojs/index.php/cieatasu/article/view/1856

Dunn, K. E., Skutnik, A., Patti, C. & Sohn, B. (2019). Disdain to Acceptance: Future Teachers’ Conceptual Change Related to Data-Driven Decision Making. Action in Teacher Education, 41(3), 193–211. DOI: 10.1080/01626620.2019.1582116

Dunlap, K. & Piro, J. S. (2016). Diving into data: Developing the capacity for data literacy in teacher education. Cogent Education, 3(1), n1132526. DOI: 10.1080/2331186x.2015.1132526

Ebbeler, J., Poortman, C. L., Schildkamp, K. & Pieters, J. M. (2016). Effects of a data use intervention on educators’ use of knowledge and skills. Studies in educational evaluation, 48, 19–31. DOI: 10.1016/j.stueduc.2015.11.002

Gearhart, M. & Osmundson, E. (2009). Assessment portfolios as opportunities for teacher learning. Educational Assessment, 14(1), 1–24. DOI: 10.1080/10627190902816108

Green, J. L., Schmitt-Wilson, S., Versland T., KeltingGibson L. & Nollmeyer G. E. (2016). Teachers and Data Literacy: A Blueprint for Professional Development to Foster Data Driven Decision Making. Journal Of Continuing Education and Professional Development, 3(1), 14–32.

Greenberg, J. & Walsh, K. (2012). What Teacher Preparation Programs Teach about K-12 Assessment: A Review. National Council on Teacher Quality.

Gummer, E., & Mandinach, E. (2015). Building a conceptual framework for data literacy. Teachers College Record, 117(4), n4. DOI: 10.1177/016146811511700401

Hattie, J. (2009). Visible Learning. Routledge. DOI: 10.4324/9780203887332

Huguet, A., Marsh, J. A. & Farrell, C. C. (2014). Building teachers’ data-use capacity: Insights from strong and developing coaches. Education Policy Analysis Archives, 22, 1–28. DOI: 10.14507/epaa.v22n52.2014

Koltay, T. (2020). Az adatműveltség pedagógiájához. Mesterséges intelligencia – interdiszciplináris folyóirat, 2(1), 33–44. DOI: 10.35406/mi.2020.1.33

Levin, J. A. & Datnow, A. (2012). The principal role in data-driven decision making: Using case-study data to develop multi-mediator models of educational reform. School Effectiveness and School Improvement, 23(2), 179–201. DOI: 10.1080/09243453.2011.599394

Mandinach, E. B. (2012). A perfect time for data use: Using data-driven decision making to inform practice. Educational Psychologist, 47(2), 71-85. DOI: 10.1080/00461520.2012.667064

Mandinach, E. B. & Gummer, E. S. (2013). A systemic view of implementing data literacy in educator preparation. Educational Researcher, 42(1), 30-37. DOI: 10.3102/0013189x12459803

Mandinach, E. B. & Gummer, E. S. (2016). Data literacy for educators: Making it count in teacher preparation and practice. Teachers College Press.

Matters, G. (2006). Using data to support learning in schools: Students, teachers, systems. Australian Education Review. Australian Council for Educational Research.

Messelt, J. (2004). Data-driven decision making: A powerful tool for school improvement. Sagebrush Corporation, 1, 1–15.

Piro, J. S. & Hutchinson, C. J. (2014). Using a data chat to teach instructional interventions: Student perceptions of data literacy in an assessment course. The New Educator, 10(2), 95–111. DOI: 10.1080/1547688x.2014.898479

Price, J. J. (2018). The Relationship Between Teachers’ Perception of Data-Driven Instructional Leadership and Their Sense of Efficacy and Anxiety for Data-Driven Decision-Making. Electronic Theses & Dissertations.

Quilter, S. M. & Gallini, J. K. (2000). Teachers’ assessment literacy and attitudes. The Teacher Educator, 36(2), 115–131. DOI: 10.1080/08878730009555257

Reeves, T. D. & Honig, S. L. (2015). A classroom data literacy intervention for pre-service teachers. Teaching and Teacher Education, 50, 90–101. DOI: 10.1016/j.tate.2015.05.007

Reeves, T. D., Summers, K. H. & Grove, E. (2016). Examining the landscape of teacher learning for data use: The case of Illinois. Cogent Education, 3(1), 1211476. DOI: 10.1080/2331186x.2016.1211476

Reeves, T. D. (2017). Pre-service teachers’ data use opportunities during student teaching. Teaching and Teacher Education, 63, 263–273. DOI: 10.1016/j.tate.2017.01.003

Reeves, T. D. & Chiang, J. L. (2017). Building pre-service teacher capacity to use external assessment data: An intervention study. The Teacher Educator, 52(2),155–172. DOI: 10.1080/08878730.2016.1273420

Reeves T. D. & Chiang J. (2018). Online interventions to promot teacher data-driven decision making: Optimizing design to maximize impact. Studies in Educational Evaluation, 59, 256–269. DOI: 10.1016/j.stueduc.2018.09.006

Reeves, T. D., Onder, Y. & Abdi, B. (2020). Validation of the Data-Driven Decision-Making Efficacy and Anxiety Inventory (3D-MEA) with US pre-service teachers. Mid-Western Educational Researcher, 32(4), 286–303.

Ridsdale, C., Rothwell, J., Smit, M., Ali-Hassan, H., Bliemel, M., Irvine, D., Kelley, D., Wuetherick, B. & Wuetherick, B. (2015). Strategies and best practices for data literacy education: Knowledge synthesis report. Dalhouse University. http://www.mikesmit.com/wp-content/papercitedata/pdf/data_literacy.pdf

Ronka, D., Geier, R. & Marciniak, M. (2010). A Practical Framework for Building a Data-driven District Or School: How a Focus on Data Quality, Capacity and Culture Supports Data-driven Action to Improve Student Outcomes. PCG Education.

Samuel, M. (2008). Accountability to whom? For what? Teacher identity and the force field model of teacher development. Perspectives in Education, 26(2), 3–16.

Sebestyén, E. (2019). A pedagógiai adatvezérelt döntéshozatal elméleti megközelítések és vizsgálati lehetőségek. Magyar Pedagógia, 119(4), 287–312. DOI: 10.17670/mped.2019.4.287

Sebestyén, E. (2020). A tanárok adathasználati hatékonyságát mérő kérdőív adaptálása. In: Engler, Á., Rébay, M. & Tóth, D. A. (szerk.), Család a nevelés és az oktatás fókuszában: XX. Országos Neveléstudományi Konferencia. Debrecen. 196.

Sebestyén, E. (2021). A literature review on the affective factors that influence data-driven decision-making. Hungarian Educational Research Journal, 11(1), 23–30. DOI: 10.1556/063.2021.00016

Schildkamp, K., Poortman, C., Luyten, H. & Ebbeler, J. (2017). Factors promoting and hindering databased decision making in schools. School effectiveness and school improvement, 28(2), 242–258. DOI: 10.1080/09243453.2016.1256901

Schildkamp, K., Handelzalts, A., Poortman, C. L., Leusink, H., Meerdink, M., Smit, M., Ebbeler, J. & Hubers, M., D. (2018). The Data Team”! Procedure: A Systematic Approach to School Improvement. Springer International Publishing. DOI: 10.1007/978-3-319-58853-7

Schildkamp, K. & Poortman, C. (2015). Factors influencing the functioning of data teams. Teachers college record, 117(4), 1–42. DOI: 10.1177/016146811511700403

Straub, E. T. (2009). Understanding technology adoption: Theory and future directions for informal learning. Review of educational research, i(2), 625–649. DOI: 10.3102/0034654308325896

Suprayogi, M. N., Valcke, M. & Godwin, R. (2017). Teachers and their implementation of differentiated instruction in the classroom. Teaching and Teacher Education, 67, 291–301. DOI: 10.1016/j.tate.2017.06.020

Tóth, E. (2011). Pedagógusok nézetei a tanulóiteljesítmény-mérésekről. Magyar Pedagógia, 111(3), 225–249.

Tóth, E. (2015). Az Országos kompetenciamérés hatása a tanítási munkára pedagógusinterjúk alapján. Magyar Pedagógia, 115(2), 115–138. DOI: 10.17670/mped.2015.2.115

Tóth, E. & Csapó, B. (2022). Teachers’ beliefs about assessment and accountability. Educational Assessment, Evaluation and Accountability, 1–23. DOI: 10.1007/s11092-022-09396-w

Vígh, T. (2007). A vizsgák tanítási-tanulási folyamatra gyakorolt hatásának elméleti és empirikus kutatása. Magyar Pedagógia, 107(2), 141–161.

Walker, D. A., Reeves, T. D. & Smith, T. J. (2018). Confirmation of the Data-Driven Decision-Making Efficacy and Anxiety Inventory’s Score Factor Structure Among Teachers. Journal of Psychoeducational Assessment, 36(5), 477–491. DOI: 10.1177/0734282916682905

Wayman, J. C. & Jimerson, J. B. (2014). Teacher needs for data-related professional learning. Studies in Educational Evaluation, 42, 25–34. DOI: 10.1016/j.stueduc.2013.11.001