Development and preliminary validation of a physical education cognitive test across lower-, middle-, and higher-order thinking skills in students aged 12-15 years
DOI:
https://doi.org/10.55040/sjrj9w72Keywords:
cognitive tests, physical education, LOTS-MOTS-HOTS, educational assessment, educational measurementAbstract
Physical Education cognitive assessment requires validated instruments that capture not only factual knowledge but also students’ ability to apply and evaluate concepts in movement-related contexts. This study aims to develop and conduct a preliminary validation of a Physical Education cognitive test based on Lower-Order Thinking Skills (LOTS), Middle-Order Thinking Skills (MOTS) and Higher-Order Thinking Skills (HOTS) for students aged 12-15 years. This study employed a quantitative approach in the development and preliminary validation of the instrument. Content validation involved nine validators, comprising four lecturers and five Physical Education teachers from pilot schools. The empirical pilot study involved 722 students who returned complete and codable answer sheets in grades 7, 8 and 9 from five junior high schools. The instrument developed comprises 47 LOTS items, 35 MOTS items and 33 HOTS items, each with four answer options. The topics covered include big ball games, small ball games, athletics, gymnastics, physical fitness, pencak silat, healthy lifestyles and injury prevention. Content validity was analysed using Aiken’s V, whilst internal reliability was analysed using the Kuder-Richardson 20 (KR-20) formula. The results showed that Aiken’s V ranged from 0.852 to 0.889, with an overall value of 0.870. The overall KR-20 value was 0.687, whilst the KR-20 values for LOTS, MOTS and HOTS were 0.573, 0.515 and 0.609, respectively. These results indicate that the instrument possesses strong evidence of content relevance and limited-to-moderate preliminary internal consistency. Therefore, the test may serve as a preliminary basis for further item refinement, Physical Education cognitive item-bank development, and broader psychometric validation.
References
Abduljabar, B., Nur, L., & Yulianto, A. (2025). Cognitive-Reflective Motor Learning – Based Physical Education to Enhance Critical Thinking Abilities: Does RASCH Analysis Model show the Significant Evidence? Physical Education Theory and Methodology, 25(4), 816–824. https://doi.org/10.17309/tmfv.2025.4.09
Arriah, F., & Romba, S. S. (2023). Development of a numeracy literacy ability test instrument based on high order thinking skills (hots) in junior high school mathematics learning. Desimal: Jurnal Matematika, 6(1), 51–62. https://doi.org/10.24042/djm.v6i1.11523
Blegur, J., Yustiana, Y. R., Taufik, A., Ilham, M., & Hardiansyah, S. (2023). Integrating analytical thinking skills into physical education to improve student learning outcomes. Jurnal Keolahragaan, 11(2), 180–190. https://doi.org/10.21831/jk.v11i2.61176
Dudley, D., Mackenzie, E., Van Bergen, P., Cairney, J., & Barnett, L. (2022, June 23). What Drives Quality Physical Education? A Systematic Review and Meta-Analysis of Learning and Development Effects From Physical Education-Based Interventions. Frontiers in Psychology. Frontiers Media S.A. https://doi.org/10.3389/fpsyg.2022.799330
Frese, W. A., Hanson, K., Wang, Y., & Hsiao, W. C. (2025). Development of a Modified High-Value Care Rounding Tool. Hospital Pediatrics, 15(7), e293–e301. https://doi.org/10.1542/hpeds.2024-008272
Gilic, B., Malovic, P., Sunda, M., Maras, N., & Zenic, N. (2022). Adolescents with Higher Cognitive and Affective Domains of Physical Literacy Possess Better Physical Fitness: The Importance of Developing the Concept of Physical Literacy in High Schools. Children, 9(6). https://doi.org/10.3390/children9060796
Hadinata, R., Adrizal, M., Daya, W. J., Mardian, R., Ilham, M., & Ockta, Y. (2024). Developing Of Cognitive Assessment Instrumens Of High Order Thinking Skills In Small Ball Game Material. JETL (Journal of Education, Teaching and Learning), 9(1), 101. https://doi.org/10.26737/jetl.v9i1.5827
Hardiansyah, S., Zalindro, A., Pendidikan, J., & Dan Olahraga, J. (2025). Physical Education Teacher Attitudes toward the Stimulation of Student Higher-Order Thinking Skills. Jurnal Pendidikan Jasmani Dan Olahraga, 10(1), 128–137. https://doi.org/10.17509/jpjo.v10i1.80177
Hariadi, Valianto, B., Akhmad, I., & Bin Syed Ali, S. K. (2025). Implementation study of authentic assessment in physical education in Indonesia and Malaysia. Cakrawala Pendidikan, 44(1), 102–115. https://doi.org/10.21831/cp.v44i1.71485
Kania, N., Kusumah, Y. S., Dahlan, J. A., Nurlaelah, E., Gürbüz, F., & Bonyah, E. (2024). Constructing and providing content validity evidence through the Aiken’s V index based on the experts’ judgments of the instrument to measure mathematical problem-solving skills. REID (Research and Evaluation in Education), 10(1), 64–79. https://doi.org/10.21831/reid.v10i1.71032
Kartini, A., Husamah, H., Permana, F. H., & Mohd Shukri, A. A. Bin. (2024). PBL-based STEM: Its effect on the cognitive learning outcome of junior high school students. Jurnal Biolokus, 6(2), 187. https://doi.org/10.30821/biolokus.v6i2.2673
Kayrgozhin, D. U., Aralbayev, A. S., Askarovich, S. M., Amangeldinovna, N. B., & Marat, K. (2022). Developing cognitive independence in high school students through physical education lessons. Cypriot Journal of Educational Sciences, 17(3), 930–941. https://doi.org/10.18844/cjes.v17i3.6988
Kurniawan, F., Hidayatullah, M. F., Kristiyanto, A., Riyadi, S., Ekawati, F. F., Ningrum, N. R., & Prabowo, T. A. (2024). Physical literacy needs in esports: literature review. Retos, 58, 495–505. https://doi.org/10.47197/retos.v58.107885
Levin, K., Creed, P. A., Jones, L., & Duffy, A. (2025). Study Crafting in Higher Education: Scale Development and Initial Validation. International Journal for Educational and Vocational Guidance, 25(3), 1485–1505. https://doi.org/10.1007/s10775-024-09674-7
Lewis. R. Aiken. (1985). Three Coefficients For Analyzing The Reliability And Validity Of Ratings. Educational and Psychological Measurement, 45, 131–141. Retrieved from https://journals.sagepub.com/doi/abs/10.1177/0013164485451012
Liu, J., Liu, Z., Wang, C., Xu, Y., Chen, J., & Cheng, Y. (2024). K-12 students’ higher-order thinking skills: Conceptualization, components, and evaluation indicators. Thinking Skills and Creativity, 52. https://doi.org/10.1016/j.tsc.2024.101551
Milošević, Ž., Peulić, J., Aleksić, A., Bjelica, D., & Katanić, B. (2026). Gender Differences in Motor Competence among Preschool Children: Evidence from the KTK Test. Sport Mont, 24(2), 31–36. https://doi.org/10.26773/smj.260605
Muhson, A., Sudari, S., Fadoli, H. I., & Sari, N. T. (2024). Analysis of Assessment Results of Physical Education Learning Quality Mapping in Nahdlatul Ulama Pakis Junior High School. Journal of Physical Education, Sport, Health and Recreations, 13(3), 444–450. https://doi.org/10.15294/peshr.v13i3.9899
Nam, J. H., Kim, E. J., & Cho, E. H. (2022). Sport Psychological Skill Factors and Scale Development for Taekwondo Athletes. International Journal of Environmental Research and Public Health, 19(6). https://doi.org/10.3390/ijerph19063433
Nevitaningrum, N., Syafei, P. M., Mulya, G., Prabowo, T. A., Ramadhanty, O. Y., & Suryani, P. D. I. D. (2026). Healthy Lifestyle Program to Improve Physical Literacy and Physical Fitness of Junior High School Students : A Quasi-Experimental Approach. Journal of Learning Theory and Methodology, 7(1), 25–36. https://doi.org/10.17309/jltm.2026.7.1.02
Ospankulov, Y., Zhumabayeva, A., Nishanbayeva, S., Ussen, B., & Zhalel, A. (2023). The Effect of the Use of Digital Technologies in Physical Education Lessons on Students’ Physical Education Cultures and Attitudes towards the Lesson. International Journal of Education in Mathematics, Science and Technology, 11(6), 1424–1442. https://doi.org/10.46328/ijemst.3700
Pastor-Cisneros, R., Mendoza-Muñoz, M., López-Gil, J. F., & Carlos-Vivas, J. (2026). Development of the physical education knowledge questionnaire-Spain (PEKQ-S): feasibility, validity and reliability for Spanish children aged 6–12 years. Frontiers in Sports and Active Living, 7(January), 1–12. https://doi.org/10.3389/fspor.2025.1737905
Pisriwati, S. A., Siswanto, D. H., Hardi, Y., & Alghiffari, E. K. (2024). Question Making Training with LOTS, MOTS, and HOTS Cognitive Levels for High School Teachers. Journal of Social and Community Development, 1(01), 9–18. https://doi.org/10.56741/jscd.v1i01.666
Putro, K. H., Suharjana, S., Marhaendro, A. S. D., Fauzi, F., Wicaksono, D., Irianto, S., & Prabowo, T. A. (2025). Exploratory Factor Analysis on the Talent Development Environment Questionnaire (TDEQ-5) for Basketball in Indonesia. Physical Education Theory and Methodology, 25(1), 156–165. https://doi.org/10.17309/tmfv.2025.1.19
Putro, K. H., Suharjana, S., Marhaendro, A. S. D., Hariono, A., Siswantoyo, S., Fauzi, F., … Prabowo, T. A. (2025). Evaluating Validity and Test-retest Reliability on Indonesian Basketball Talent Scouting Model for Athletes Aged 10 to 14. Physical Education Theory and Methodology, 25(3), 540–547. https://doi.org/10.17309/tmfv.2025.3.09
Ridha, S., Mashud, Warni, H., & Arifin, S. (2025). Physical literacy in Indonesian school physical education: a systematic review of concepts, assessment, and implementation. Edu Sportivo: Indonesian Journal of Physical Education, 6(3), 285–301. https://doi.org/10.25299/esijope.2025.vol6(3).17622
Ritonga, A. W., Ritonga, M., Septiana, V. W., & Mahmud. (2021). Crossword puzzle as a learning media during the covid-19 pandemic: HOTS, MOTS or LOTS? In Journal of Physics: Conference Series (Vol. 1933). IOP Publishing Ltd. https://doi.org/10.1088/1742-6596/1933/1/012126
Saryono, S., Nurkamto, J., Hidayatullah, M. F., & Komarudin, K. (2025). Aiken Index Analysis to Determine the Content Validity of an Instrument Measuring Junior High School Students’ Preparedness for Earthquake Disasters in Physical Education. KnE Social Sciences, 10(9), 152– 162.https://doi.org/10.18502/kss.v10i9.18479
Shearer, C., Goss, H. R., Boddy, L. M., Knowles, Z. R., Durden-Myers, E. J., & Foweather, L. (2021, December 1). Assessments Related to the Physical, Affective and Cognitive Domains of Physical Literacy Amongst Children Aged 7–11.9 Years: A Systematic Review. Sports Medicine - Open. Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1186/s40798-021-00324-8
Susiono, R., Sugiyanto, F., Lumintuarso, R., Tomoliyus, T., Sukamti, E. R., Fauzi, F., … Prabowo, T. A. (2024). Y Agility Test Innovation on Special Badminton Athletes for the Junior Category (U17): Validity and Reliability. Retos, 53, 547–553. https://doi.org/10.47197/retos.v53.103282
Tannoubi, A., Guelmami, N., Bonsaksen, T., Chalghaf, N., Azaiez, F., & Bragazzi, N. L. (2022). Development and Preliminary Validation of the Physical Education-Study Process Questionnaire : Insights for Physical Education University Students. Frontiers in Public Health, 10. https://doi.org/10.3389/fpubh.2022.856167
Wedi, S., Gemaini, A., Fauzi, F., & Prabowo, T. A. (2025). Dynamic balance test modifications in Karate Kata : Content validity. SPORT TK-EuroAmerican Journal of Sport Sciences, 14, 113. https://doi.org/10.6018/sportk.581941
Wulandari, P. P., Siswantoyo, Sutapa, P., Apriyanto, G. E., Hidayah, T., Akhiruyanto, A., … Virama, L. O. A. (2023). Content Validity of Fun Relay Learning Model and Observation of Cognitive, Affective, Psychomotor Aspects of Elementary School Students. International Journal of Human Movement and Sports Sciences, 11(6), 1277–1286. https://doi.org/10.13189/saj.2023.110611
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Danang Endarto Putro, Ngatman, Sridadi, Catur Wahyu Priyanto, Trisnar Adi Prabowo (Autor/a)
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
The works published in this journal are subject to the following terms:
The author retains the economic rights (copyright) of the published works and grants the journal the right of first publication.
The works are published in the electronic edition of the journal under a Creative Commons Attribution–NonCommercial–ShareAlike license. They may be copied, used, distributed, transmitted, and publicly displayed, provided that: (i) authorship and the original source of publication (journal, publisher, and URL of the work) are cited; (ii) they are not used for commercial purposes; (iii) the existence and specifications of this license are indicated.
Self-archiving conditions. Authors are permitted and encouraged to disseminate electronically the post-print versions (publisher’s version), as this facilitates earlier circulation and dissemination, potentially increasing citation and reach within the academic community. Authors may also deposit their articles in repositories and other platforms that support the dissemination of information, provided that the version used is the post-print (publisher’s version). RoMEO color: Blue.
