Towards a science inquiry test in primary education: development of items and scales
Апстракт
Background Inquiry-based learning is widely applied in science education; however, so far, the outcomes of learning process have been systematically assessed mainly at the secondary school level. For primary school students, there is no valid instrument for assessing the outcomes of their science inquiry. The aim of the current study was to develop a test for assessing science learning outcomes (analytical skills, planning skills, interpretation skills, and science knowledge) related to the five phases of inquiry-based learning (Orientation, Conceptualization, Investigation, Conclusion, and Discussion) at primary education level (ISCED 1). Results A set of contextualized science tasks was created to assess each of the learning outcomes at three levels. The Science Inquiry Test for Primary Education (SIT-PE test) was developed through several phases, including pilot studies with large groups of fourth-grade students (10 to 11 years of age). The 1 PL Item Response Theory model was used t...o analyze the quality of the test and items based on the test's reliability score, item difficulty measure, infit and outfit indices, estimation of item discrimination, item-scale correlation, and the quality of the scoring key. The final test, consisting of 24 items, was used with a sample of 1868 students. The analysis showed the SIT-PE test to be of good quality on test level and item level and to also have good predictive validity. Confirmatory factor analysis revealed that the correlated factors model and second-order factor model of the science learning outcomes both had a good fit to data collected with the SIT-PE test. Confirmatory factor analysis confirmed the multidimensionality of science learning outcomes and validated four dimensions of the model: analytical skills, planning skills, interpretation skills, and science knowledge. Conclusions In conclusion, the SIT-PE test could be further used for assessing students' inquiry competence in primary education. However, it could be even further improved in several ways and this study provides guidelines on how to do that. In addition, the SIT-PE provides test developers with information on how to design derivations of the SIT-PE test for assessing particular science inquiry outcomes or the same outcomes in older age groups as well.
Кључне речи:
Science / Primary education / Performance assessment / Item response models / Inquiry-based learning / Confirmatory factor analysis / AssessmentИзвор:
International Journal of Stem Education, 2021, 8, 1Издавач:
- Springer, New York
Финансирање / пројекти:
- Estonian Ministry of Education and ResearchMinistry of Education and Research, Estonia
- Estonian Research CouncilEstonian Research Council [IUT34-6]
- European Social Fund (ESF)
DOI: 10.1186/s40594-021-00278-z
ISSN: 2196-7822
WoS: 000630948900002
Scopus: 2-s2.0-85102677898
Институција/група
Psihologija / PsychologyTY - JOUR AU - Pedaste, Margus AU - Baucal, Aleksandar AU - Reisenbuk, Elle PY - 2021 UR - http://reff.f.bg.ac.rs/handle/123456789/3312 AB - Background Inquiry-based learning is widely applied in science education; however, so far, the outcomes of learning process have been systematically assessed mainly at the secondary school level. For primary school students, there is no valid instrument for assessing the outcomes of their science inquiry. The aim of the current study was to develop a test for assessing science learning outcomes (analytical skills, planning skills, interpretation skills, and science knowledge) related to the five phases of inquiry-based learning (Orientation, Conceptualization, Investigation, Conclusion, and Discussion) at primary education level (ISCED 1). Results A set of contextualized science tasks was created to assess each of the learning outcomes at three levels. The Science Inquiry Test for Primary Education (SIT-PE test) was developed through several phases, including pilot studies with large groups of fourth-grade students (10 to 11 years of age). The 1 PL Item Response Theory model was used to analyze the quality of the test and items based on the test's reliability score, item difficulty measure, infit and outfit indices, estimation of item discrimination, item-scale correlation, and the quality of the scoring key. The final test, consisting of 24 items, was used with a sample of 1868 students. The analysis showed the SIT-PE test to be of good quality on test level and item level and to also have good predictive validity. Confirmatory factor analysis revealed that the correlated factors model and second-order factor model of the science learning outcomes both had a good fit to data collected with the SIT-PE test. Confirmatory factor analysis confirmed the multidimensionality of science learning outcomes and validated four dimensions of the model: analytical skills, planning skills, interpretation skills, and science knowledge. Conclusions In conclusion, the SIT-PE test could be further used for assessing students' inquiry competence in primary education. However, it could be even further improved in several ways and this study provides guidelines on how to do that. In addition, the SIT-PE provides test developers with information on how to design derivations of the SIT-PE test for assessing particular science inquiry outcomes or the same outcomes in older age groups as well. PB - Springer, New York T2 - International Journal of Stem Education T1 - Towards a science inquiry test in primary education: development of items and scales IS - 1 VL - 8 DO - 10.1186/s40594-021-00278-z ER -
@article{ author = "Pedaste, Margus and Baucal, Aleksandar and Reisenbuk, Elle", year = "2021", abstract = "Background Inquiry-based learning is widely applied in science education; however, so far, the outcomes of learning process have been systematically assessed mainly at the secondary school level. For primary school students, there is no valid instrument for assessing the outcomes of their science inquiry. The aim of the current study was to develop a test for assessing science learning outcomes (analytical skills, planning skills, interpretation skills, and science knowledge) related to the five phases of inquiry-based learning (Orientation, Conceptualization, Investigation, Conclusion, and Discussion) at primary education level (ISCED 1). Results A set of contextualized science tasks was created to assess each of the learning outcomes at three levels. The Science Inquiry Test for Primary Education (SIT-PE test) was developed through several phases, including pilot studies with large groups of fourth-grade students (10 to 11 years of age). The 1 PL Item Response Theory model was used to analyze the quality of the test and items based on the test's reliability score, item difficulty measure, infit and outfit indices, estimation of item discrimination, item-scale correlation, and the quality of the scoring key. The final test, consisting of 24 items, was used with a sample of 1868 students. The analysis showed the SIT-PE test to be of good quality on test level and item level and to also have good predictive validity. Confirmatory factor analysis revealed that the correlated factors model and second-order factor model of the science learning outcomes both had a good fit to data collected with the SIT-PE test. Confirmatory factor analysis confirmed the multidimensionality of science learning outcomes and validated four dimensions of the model: analytical skills, planning skills, interpretation skills, and science knowledge. Conclusions In conclusion, the SIT-PE test could be further used for assessing students' inquiry competence in primary education. However, it could be even further improved in several ways and this study provides guidelines on how to do that. In addition, the SIT-PE provides test developers with information on how to design derivations of the SIT-PE test for assessing particular science inquiry outcomes or the same outcomes in older age groups as well.", publisher = "Springer, New York", journal = "International Journal of Stem Education", title = "Towards a science inquiry test in primary education: development of items and scales", number = "1", volume = "8", doi = "10.1186/s40594-021-00278-z" }
Pedaste, M., Baucal, A.,& Reisenbuk, E.. (2021). Towards a science inquiry test in primary education: development of items and scales. in International Journal of Stem Education Springer, New York., 8(1). https://doi.org/10.1186/s40594-021-00278-z
Pedaste M, Baucal A, Reisenbuk E. Towards a science inquiry test in primary education: development of items and scales. in International Journal of Stem Education. 2021;8(1). doi:10.1186/s40594-021-00278-z .
Pedaste, Margus, Baucal, Aleksandar, Reisenbuk, Elle, "Towards a science inquiry test in primary education: development of items and scales" in International Journal of Stem Education, 8, no. 1 (2021), https://doi.org/10.1186/s40594-021-00278-z . .