Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability

Yıl: 2023 Cilt: 13 Sayı: 2 Sayfa Aralığı: 191 - 206 Metin Dili: İngilizce DOI: 10.19126/suje.1187470 İndeks Tarihi: 27-09-2023

Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability

Öz:
Developing students' positive attitudes toward a situation is extremely important. Many attitude scales aim to measure students' general attitudes toward a situation, but there is a scarcity of tools that can be easily employed to determine the type of questions students prefer in an exam. This paper reports the development and testing of an instrument like this for secondary school students, and 781 secondary school students participated in this study. The Exam Question Types Attitude Scale (EQTA-S) consisting of 10 items was developed in this study, and its validity and reliability were analyzed. Exploratory factor analysis was performed for the construct validity of the EQTA-S and an EQTA-S consisting of 10 items was obtained. The result of the confirmatory factor analysis showed that the scale is a good fit for the proposed one-factor structure. Additionally, the reliability of the scale was established by acceptable Cronbach alpha values that indicated reliability coefficients (Cronbach's alpha) of .81, .85, .84, and .82, respectively. Therefore, the findings of the study revealed that secondary school students' attitude scale toward exam question types provides valid and reliable results. As a result, this scale can be used to measure students' attitudes towards five different types of exam questions.
Anahtar Kelime: Attitude exam question types test format validity reliability

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık
  • Ajzen, I. (2005). Attitudes, personality, and behavior. UK: McGraw-Hill Education.
  • Akın, A., & Demirci, İ. (2012). Revised test anxiety scale: A validity and reliability study. Educational Sciences and Practice, 11(21), 103-118. Retrieved from https://www.researchgate.net/publication/264550506_Revize_Edilmis_Sinav_Kaygisi_Olcegi_Gec erlik_ve_guvenirlik_calismasi
  • Astalini A., Kurniawan, D, A., Darmaji, D., Sholihah, L, R., & Perdana, R. (2019). Characteristics of students’ attitude to physics in muaro jambi high school. Humanities & Social Sciences Reviews (HSSR), 7(2), 91- 99. https://doi.org/10.18510/hssr.2019.7210
  • Ayaydın, A. (2010). A research on measurement and evaluation in design education. Journal of Ahi Evran University Faculty of Education, 11(2), 159-172. Retrieved from https://dergipark.org.tr/en/pub/kefad/issue/59503/855357
  • Azwar, S. (2019). Penyusunan skala psikologi [Making psychological scale] (2nd ed.). Pustaka Pelajar. Bahar, M., Nartgün, Z., Durmuş, S., & Bıçak, B. (2012). Traditional complementary assessment and evaluation techniques (5th Edition). Ankara: Pegem Akademi.
  • Benjamin, M., McKeachie, W.J., Lin, Y.G., & Holinger, D. P. (1981). Test anxiety: Deficits in information processing. Journal of Educational Psychology, 73(6), 816-824. https://psycnet.apa.org/doi/10.1037/0022-0663.73.6.816
  • Benson, L., & El-Zahar, N. (1994). Further refinement and validation of the Revised Test Anxiety Scale. Structural Equation Modeling, 1, 203-221. https://doi.org/10.1080/10705519409539975
  • Bhardwaj, J. S., & Kaushik, V. (2014). Developing an attitude scale toward science at middle school level. International Journal of Education and Science Research Review, 1(1), 6-13. Retrieved from https://ijesrr.org/archive_issue.php?j_id=1
  • Birenbaum, M., & Feldman, R. A. (1998). Relationships between learning patterns and attitudes toward two assessment formats. Educational Research, 40(1), 90-98. https://doi.org/10.1080/0013188980400109
  • Birenbaum, M., & Rosenau, S. (2006). Assessment preferences, learning orientations, and learning strategies of pre service and in service teachers. Journal of Education for Teaching, 32(2), 213-225. https://doi.org/10.1080/02607470600655300
  • Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research. A primer. Frontiers in Public Health, 6, 149. https://doi.org/10.3389/fpubh.2018.00149
  • Chapman, K. J., & van Auken, S. (2001). Creating positive group project experiences: An examination of the role of the instructor on students’ perceptions of group projects. Journal of Marketing Education, 23, 117–127. https://doi.org/10.1177/0273475301232005
  • Chen, H. (2003). A study of primary school english teachers’ beliefs and practices in multiple assessments: a case study in taipei city (Unpublished master theses). Taipei: National Taipei Teachers College.
  • Crocker, L., & J. Algina. 1986. Introduction to classical and modern test theory. Orlando, FL: Harcourt Brace Jovanovich.
  • Çolak, E., & Fer, S. (2007). Linguistic equivalence reliability and validity study of learning approaches inventory. Çukurova University Journal of Social Sciences Institute, 16(1), 197-211. Retrieved from https://dergipark.org.tr/tr/pub/cusosbil/issue/4376/59944
  • Danili, E., & Reid, N. (2005). Assessment Formats: do they make a difference? Chemistry Education Research and Practice, 6, 204–212. https://doi.org/10.1039/B5RP90011E
  • Darmaji, D., Kurniawan, D. A., & Suryani, A. (2019). Effectiveness of basic physics II practicum guidelines based on science process skills. Jurnal Ilmu Pendidikan Fisika (JIPF), 4(1), 1-7. https://dx.doi.org/10.26737/jipf.v4i1.693
  • Delice, A., & Ergene, Ö. (2015). Ölçek geliştirme ve uyarlama çalışmalarının incelenmesi: Matematik eğitimi makaleleri örneği [Examination of scale development and adaptation studies: The case of mathematics education articles]. Karaelmas Journal of Educational Sciences, 3, 60-75. Retrieved from https://dergipark.org.tr/en/pub/kebd/issue/67216/1049114
  • Dodeen, H. (2008). Assessing test-taking strategies of University students: Developing a scale and estimating its psychometrics indices. Assessment and Evaluation in Higher Education, 33(4), 409- 419. https://doi.org/10.1080/02602930701562874
  • Dodeen, H. (2009). Test-related characteristics of uaeu students: test-anxiety, test-taking skills, guessing, attitudes toward tests, and cheating. Journal of Faculty of Education, 26, 31-66. Retrieved from http://search.shamaa.org/PDF/Articles/TSIjre/JfeNo26Y2009/jfe_2009-n26_031- 066_eng.pdf
  • Doğan, C. D., & Kutlu, Ö. (2011). The learning-related features that are effective in pre-service teachers' choice of new situation determination methods. Kastamonu Journal of Education, 19(2), 459-474. Retrieved from https://dergipark.org.tr/en/pub/kefdergi/issue/49052/625761
  • Dusic, D. M. (1998). What social cognitive factors influence faculty members’ use of computers for teaching? A literature review. Journal of Research on Computing in Education, 31, 123-137. https://doi.org/10.1080/08886504.1998.10782246
  • Ekinci, H. Y., & Köksal, E. A. (2011). Developing an assessment and evaluation competency scale for primary school science and mathematics teachers. Kastamonu Journal of Education, 19(1),167-184. Retrieved from https://dergipark.org.tr/en/pub/kefdergi/issue/49053/625830
  • Fraser, B. J. (1978). Development of a test of science related attitudes. Science Education, 62(4), 509- 515. https://doi.org/10.1002/sce.3730620411
  • Garson, D. 1998. Quantitative research in public administration. http://www2.chass.ncsu.edu/garson/pa765/validity.htm
  • Güler, N., & Gelbal, S. (2010). Examining the reliability of open-ended mathematics questions according to classical test theory and generalizability theory. Educational Sciences in Theory and Practice, 10(2), 991-1019. Retrieved from https://eric.ed.gov/?id=EJ889199
  • Hembree, R. (1988). Correlates, causes, effecs and treatment of test anxiety. Review of Educational Research, 58(1), 47-77. https://doi.org/10.3102/00346543058001047
  • Hlebowitsh, P. S. (2005). Desinging the school curriculum. USA: Pearson Education.
  • Hudson, R. D., & Treagust, D. F. (2013). Which form of assessment provides the best information about student performance in chemistry examinations? Research in Science & Technological Education, 31(1), 49–65. https://doi.org/10.1080/02635143.2013.764516
  • Huxham, G. J., Lipton A., & Cummins, R. A. (1976). Student test type preference and its relation to personality and achievement. Medical Education, 10(2), 90–96. https://doi.org/10.1111/j.1365- 2923.1976.tb00538.x
  • Inceoglu, M. (1993). Attitude perception communication. Ankara: V Publishing.
  • Kılıç, Z., & Çetin, S. (2018). Investigation of students’ examination type preferences in terms of some variables. Elementary Education Online, 17(2), 1051-1065. https://doi.org/10.17051/ilkonline.2018.419353
  • Kind, P., Jones, K., & Barmby, P. (2007). Developing attitudes toward science measures. International Journal of Science Education, 29, 871–893. https://doi.org/10.1080/09500690600909091
  • Kızılcık, H. Ş., & Tan, M. (2011). Developing a multiple-choice test on propulsion and momentum. Kastamonu Journal of Education, 19(1), 185-198. Retrieved from https://dergipark.org.tr/en/pub/kefdergi/issue/49053/625831
  • Koklu, N. (1995). Measurement of attitudes and options used in Likert type scales. Ankara University Journal of Faculty of Educational Sciences, 28(2), 81–93. https://doi.org/10.1501/Egifak_0000000299
  • Kubiszyn, T., & Borich, G. (2003). Educational testing and measurement: classroom application and practice. Hobokon NJ, USA: John Wiley and Sons.
  • Kumandaş, H., & Kutlu, Ö. (2014). The effects of the risk factors created by the exams used in student selection and placement in higher education on school success. Turkish Journal of Psychology, 29(74), 15-31. Retrieved from https://www.psikolog.org.tr/en/publications/yayinlar/10.31828/tpd1300443320140000m000046. pdf
  • Kurniawan, D. A., Perdana, R., & Kurniawan, W. (2019). Identification Attitudes of Learners on Physics Subjects. Journal of Educational Science and Technology (EST), 5(1), 56-63. Retrieved from https://ojs.unm.ac.id/JEST/article/view/8231/5282
  • Maison, M., Darmaji, D., Astalini, A., Kurniawan, D, A., & Indrawati, P, S. (2019). Science Process Skills and Motivation. Humanities & Social Sciences Reviews (HSSR), 7(5), 48- 56. https://doi.org/10.18510/hssr.2019.756
  • McGuire, J., & Priestley, P. (1985). Offending behavior: Skills and stratagems for going straight. London: Batsford Academic and Educational.
  • Oliva, P. F. (2005). Developing the curriculum (6.Edition). Newyork: Pearson Education.
  • Ozcan, H., & Koca, E. (2020). Development of the attitude towards science scale: A validity and reliability study. Eurasian Journal of Educational Research, 85, 109-134. Retrieved from https://dergipark.org.tr/en/pub/ejer/issue/52308/685271
  • Önder, O. (2008). The effect of preparation with multiple choice and classical type questions on mathematics achievement and test anxiety levels. Unpublished Master Thesis. Marmara University, İstanbul.
  • Öner, N. (1990). Test anxiety inventory handbook. Foundation for Disseminating Guidance in Higher Education. No:1, İstanbul.
  • Oosterhof, A. (2001). Classroom Applications of Educational Measurement. Upper Saddle River, New Jersey, Columbus, Ohio: Merill Prentice Hall, Inc.
  • Pell, T., & Jarvis, T. (2001). Developing attitude to science scales for use with children of ages from five to eleven years. International Journal of Science Education, 23, 847–862. https://doi.org/10.1080/09500690010016111
  • Popham, W. J. (1999). Why standardized test scores don’t measure educational quality. Educational Leadership, 56(6), 8-15. Retrieved from http://cepd410101.pbworks.com/w/file/fetch/48464721/measure.doc
  • Reteguiz, J. (2006). Relationship between anxiety and standardized patient test performance in the medicine clerkship. Journal of General Internal Medicine, 21, 415-418. https://doi.org/10.1111/j.1525-1497.2006.00419.x
  • Schreiner, C., & Sjoberg, S. (2004). Sowing the seeds of ROSE. Background, Rationale, Questionnaire Development and Data Collection for ROSE (The Relevance of Science Education): A comparative study of students' views of science and science education. Oslo: Unipub AS.
  • Spielberger, C.D. (1980). Test anxiety inventory: Preliminary professional manual. Palo Alto, CA: Consulting Psychologist Press.
  • Tabachnick, B. G., & Fidell, L. S. (2014) Using Multivariate Statistics. 6th edn. Harlow: Pearson.
  • Tavsancil, E. (2014). Measurement of attitudes and data analysis with SPSS. Nobel Publishing, Ankara.
  • Taylor, J. R. (1999). An introduction to error analysis: The study of uncertainties in physical measurements. University Science Books. pp. 128–129. ISBN 0-935702-75-X.
  • Tezbaşaran, E., & Yiğit, R. (2015). A study on developing attitude scale toward nurses. Hasan Ali Yücel Eğitim Fakültesi Dergisi,12(24), 69-80. Retrieved from https://dergipark.org.tr/en/pub/iuhayefd/issue/8803/110063
  • Tozoglu, D., Tozoglu, M. D., Gurses, A., & Dogar, C. (2004). The students’ perceptions: essay versus multıple-choıce type exams. Journal of Baltic Science Education, 2(6), 52-59. Retrieved from https://www.researchgate.net/profile/Cetin- Dogar/publication/291325299_The_students'_perceptions_essay_versus_multiple- choice_type_exams/links/5d072dcd458515b055d8e65d/The-students-perceptions-essay-versus- multiple-choice-type-exams.pdf
  • Turgut, M. F., & Baykul, Y. (2012). Measurement and evaluation in education (4th Edition). Ankara:Pegem Akademi.
  • Zeidner, M. (1987). Essay versus multiple-choice type classroom exams: The student’s perspective. Journal of Educational Research, 80(6), 352-58. https://doi.org/10.1080/00220671.1987.10885782
  • Zeidner, M. (1993). Essay versus multiple-choice-type classroom exams: The student’s perspective. In B. Nevo and R. S. Jäger (Eds.), Educational and psychological testing: The test taker’s outlook (pp.85- 111). Stuttgart: Hogrefe and Huber Publishers.
  • Zeidner, M. (2004). Test anxiety. in: spielberger CD (Ed.), Encyclopedia of Applied Psychology (pp. 545- 556). New York: Elsevier.
  • Zoller, U., & Ben-Chain, D. (2007). Interaction between examination type, anxiety state and academic achievement in college science: An action oriented research. Journal of Research in Science Teaching, 26(1), 65-77. https://doi.org/10.1002/tea.3660260107
APA kurbanoğlu n, OLCAYTÜRK M (2023). Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability. , 191 - 206. 10.19126/suje.1187470
Chicago kurbanoğlu namudar izzet,OLCAYTÜRK MEVLÜDE Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability. (2023): 191 - 206. 10.19126/suje.1187470
MLA kurbanoğlu namudar izzet,OLCAYTÜRK MEVLÜDE Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability. , 2023, ss.191 - 206. 10.19126/suje.1187470
AMA kurbanoğlu n,OLCAYTÜRK M Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability. . 2023; 191 - 206. 10.19126/suje.1187470
Vancouver kurbanoğlu n,OLCAYTÜRK M Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability. . 2023; 191 - 206. 10.19126/suje.1187470
IEEE kurbanoğlu n,OLCAYTÜRK M "Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability." , ss.191 - 206, 2023. 10.19126/suje.1187470
ISNAD kurbanoğlu, namudar izzet - OLCAYTÜRK, MEVLÜDE. "Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability". (2023), 191-206. https://doi.org/10.19126/suje.1187470
APA kurbanoğlu n, OLCAYTÜRK M (2023). Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability. Sakarya University Journal of Education, 13(2), 191 - 206. 10.19126/suje.1187470
Chicago kurbanoğlu namudar izzet,OLCAYTÜRK MEVLÜDE Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability. Sakarya University Journal of Education 13, no.2 (2023): 191 - 206. 10.19126/suje.1187470
MLA kurbanoğlu namudar izzet,OLCAYTÜRK MEVLÜDE Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability. Sakarya University Journal of Education, vol.13, no.2, 2023, ss.191 - 206. 10.19126/suje.1187470
AMA kurbanoğlu n,OLCAYTÜRK M Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability. Sakarya University Journal of Education. 2023; 13(2): 191 - 206. 10.19126/suje.1187470
Vancouver kurbanoğlu n,OLCAYTÜRK M Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability. Sakarya University Journal of Education. 2023; 13(2): 191 - 206. 10.19126/suje.1187470
IEEE kurbanoğlu n,OLCAYTÜRK M "Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability." Sakarya University Journal of Education, 13, ss.191 - 206, 2023. 10.19126/suje.1187470
ISNAD kurbanoğlu, namudar izzet - OLCAYTÜRK, MEVLÜDE. "Investigation of the Exam Question Types Attitude Scale for Secondary School Students: Development, Validity, and Reliability". Sakarya University Journal of Education 13/2 (2023), 191-206. https://doi.org/10.19126/suje.1187470