Abstract

An examination of gender-related differential item functioning was conducted on the verbal subtests of the Anadolu-Sak Intelligence Scale. Analyses were conducted using the scale standardization data (N = 4641). A Mantel-Haenszel statistic was used to detect differential item functioning (DIF). A total of 58 verbal analogical reasoning items, 20 verbal short-term memory items, and 70 vocabulary items were analyzed. Initially, items displaying DIF in different age groups were determined, and then experts were consulted to determine whether these items were biased. There were three items with item effects on the Verbal Analogical Reasoning subtest and five items on the Vocabulary subtest. Short-term Memory subtests did not reveal any bias. Several implications regarding cognitive development, gender perceptions, and cultural factors were discussed.  

Keywords

References

• Abad, F. J., Colom, R., Rebollo, I. & Escorial, S. (2004). Sex differential item functioning in the Raven's Advanced Progressive Matrices: Evidence for bias. Personality and İndividual Differences, 36(6), 1459-1470. https://doi.org/10.1016/S0191-8869(03)00241-1
• Agresti, A. (1984). Analysis of ordinal categorical data. John Wiley & Sons.
• American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Author.
• Angoff, W. H. (1993). Perspectives on differential item functioning methodology. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 3-24). Lawrence Erlbaum.
• Arslan, D., Sak, U., & Atesgöz, N. N. (2021). Are more humorous children more intelligent? A case from Turkish Culture. Humor, 34(4), 567-588. https://doi.org/10.1515/humor-2021-0054
• Borghi, A. M., Barca, L., Binkofski, F., Castelfranchi, C., Pezzulo, G., & Tummolini, L. (2019). Words as social tools: Language, sociality and inner grounding in abstract concepts. Physics of Life Reviews, 29, 120-153. https://doi.org/10.1016/j.plrev.2018.12.001
• Bradbard, M. R. (1985). Sex differences in adults' gifts and children's toy requests at Christmas. Psychological Reports, 56(3), 969-970. https://doi.org/10.2466/pr0.1985.56.3.969
• Camilli, G. & Shepard L. A., (1994). Methods for identifying biased test items. Sage.
• Carroll, J. B. (2005). The three-stratum theory of cognitive abilities. In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (pp. 69–76). The Guilford Press.
• Cırık, M., Sak, U., & Öpengin, E. (2020). An investigation of cognitive profiles of children with attention deficit hyperactivity disorder on Anadolu Sak Intelligence Scale. Ankara University Faculty of Educational Sciences Journal of Special Education, 21(4), 663-685. https://doi.org/10.21565/ozelegitimdergisi.570505
• Colom, R., Escorial, S. & Rebollo, I. (2004). Sex differences on the Progressive Matrices are influenced by sex differences on spatial ability. Personality and Individual Differences, 37(6), 1289-1293. https://doi.org/10.1016/j.paid.2003.12.014
• Doolittle, A. E. & Cleary, T. A. (1987). Gender-based differential item performance in mathematic achievement items. Journal of Educational Measurement, 24(2), 157-166. https://doi.org/10.1111/j.1745-3984.1987.tb00271.x
• Educational Testing Service [ETS]. (2009). ETS Guidelines for Fairness Review of Assessments. Author.
• Hambleton, R. K., Swaminathan, H. & Rogers, H. (1991). Fundamentals of item response theory. Sage.
• Hong, S., & Roznowski, M. (2001). An investigation of the influence of internal test bias on regression slope. Applied Measurement in Education, 14(4), 351-368. https://doi.org/10.1207/S15324818AME1404_3
• Horn, J. L., & Blankson, A. N. (2012). Foundations for better understanding of cognitive abilities. In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues. Guilford Press.
• Immekus, J. C. & Maller, S. J. (2009). Item parameter invariance of the Kaufman Adolescent and Adult Intelligence Test across male and female samples. Educational and Psychological Measurement, 69(6), 994-1012. https://doi.org/10.1177/0013164409344489
• Inci Kuzu, Ç. (2015). The gender prejudice and the toy choice of the children in preschool period and the effect of the parents on this. Journal of International Social Research, 8(39), 651- 655.
• Kalaycıoglu, D. B. & Berberoglu, G. (2010). Differential item functioning analysis of the science and mathematics items in the University Entrance Examinations in Turkey. Journal of Psychoeducational Assessment, 29(5), 467-478. https://doi.org/10.1177/0734282910391623
• Kalaycıoglu, D. B. & Kelecioglu, H. (2011). Item bias analysis of the university entrance examination. Education and Science, 36(161), 3-13.
• Köprü, F., & Ayas, M. B. (2020). An investigation of the criterion validity of Anadolu Sak Intelligence Scale (ASIS): The case of EPTS. Talent, 10(2), 110-128. https://doi.org/10.46893/talent.857308
• Kristanjansonn E., Aylesworth, R., McDowell, I. & Zumbo, B. D. (2005). A comparison of four methods for detecting differential item functioning in ordered response model. Educational and Psychological Measurement, 65(6), 935-953. https://doi.org/10.1177/0013164405275668
• Li, Y., Cohen, A. S. & Ibarra, R. A. (2004). Characteristics of mathematics items associated with gender DIF. International Journal of Testing, 4(2), 115–136. https://doi.org/10.1207/s15327574ijt0402_2
• Maller, S. J. (2000). Item invariance in four subtests of the Universal Nonverbal Intelligence Test (UNIT) across groups of deaf and hearing children. Journal of Psychoeducational Assessment, 18(3), 240-254. https://doi.org/10.1177/073428290001800304
• Maller, S. J. (2001). Differential item functioning in the WISC-III: Item parameters for boys and girls in the national standardization sample. Educational and Psychological Measurement, 61(5), 793-817. https://doi.org/10.1177/00131640121971527
• Murray, A. L., Booth, T. & McKenzie, K. (2015). An analysis of differential item functioning by gender in the Learning Disability Screening Questionnaire (LDSQ). Research in Developmental Disabilities, 39(2015), 76-82. https://doi.org/10.1016/j.ridd.2014.12.006
• Nolan, R. F., Watlington, D. K. & Willson, V. L. (1989). Gifted and nongifted race and gender effects on item functioning on the Kaufman Assessment Battery for Children. Journal of Clinical Psychology, 45(4), 645-650. https://doi.org/10.1002/1097-4679(198907)45:4<645::AID-JCLP2270450422>3.0.CO;2-E
• Onur, B., Çelen, N., Çok, F., Artar, M. & Şener Demir, T. (1997). Türkiye’de iki kentte annelerin bakış açısıyla çocukların oyuncak gereksinmesi [Children's need for toys from the perspective of mothers in two cities in Turkey]. Ankara University Journal of Faculty of Educational Sciences (JFES), 30(1), 45-74. https://doi.org/10.1501/Egifak_0000000276
• Osterlind, S. J. (1983). Test item bias. Sage.
• Özer-Özkan, Y. & Acar-Güvendir, M. (2021). Differential item functioning analysis of a high stake test in terms of statistical regions of Turkey. Journal of Pedagogical Research, 5(3), 122-134. https://doi.org/10.33902/JPR.2021371303
• Rogers, H. J., & Swaminathan, H. (1993). A comparison of logistic regression and Mantel-Haenszel procedures for detecting Differential Item Functioning. Applied Psychological Measurement, 17(2), 105–116. https://doi.org/10.1177/014662169301700201
• Roznowski, M., & Reith, J. (1999). Examining the measurement quality of tests containing differentially functioning items: do biased items result in poor measurement? Educational and Psychological Measurement, 59(2), 248-269. https://doi.org/10.1177/0013164992196983
• Sak, U., Bal-Sezerel, B., Ayas, B., Tokmak, F., Özdemir, N. N., Demirel-Gürbüz, Ş., & Öpengin, E. (2016). Anadolu Sak Intelligence Scale: ASIS practitioner’s book. Eskisehir: Anadolu University UYEP Center.
• Sak, U., Bal-Sezerel, B., Dulger, E., Sozel, K., & Ayas, M. B. (2019). Validity of the Anadolu-Sak Intelligence Scale in the identification of gifted students. Psychological Test and Assessment Modeling, 61(3), 263-283.
• Schneider, W. J., & McGrew, K. S. (2012). The Cattell-Horn-Carroll model of intelligence. In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (pp. 99–144). The Guilford Press.
• Sözel, H. K., Öpengin, E., Sak, U., & Karabacak, F. (2018). The discriminant validity of the Anadolu-Sak Intelligence Scale (ASIS) for gifted and other special education groups. Turkish Journal of Giftedness and Education, 8(2), 160-180.
• Tamul, Ö. F., Sezerel, B. B., Sak, U., & Karabacak, F. (2020). Social validity study of the Anadolu-Sak intelligence Scale (ASIS). PAU Journal of Education, 49, 393-412. https://doi.org/10.9779/pauefd.575479
• Vatandaş, C. (2007). Toplumsal cinsiyet ve cinsiyet rollerinin algılanışı [Perception of gender and gender roles]. Istanbul Journal of Sociological Studies, 35, 29-56.
• Wechsler, S., de Cassia Nakano, T., da Silva Domingues, S. F., Rosa, H. R., da Silva, R. B. F., Silva-Filho, J. H. & Minervino, C. A. D. S. M. (2014). Gender differences on tests of crystallized intelligence. European Journal of Education and Psychology, 7(1), 59-72.
• Weisgram, E. S., Fulcher, M., & Dinella, L. M. (2014). Pink gives girls permission: Exploring the roles of explicit gender labels and gender-typed colors on preschool children's toy preferences. Journal of Applied Developmental Psychology, 35(5), 401-409. https://doi.org/10.1016/j.appdev.2014.06.004
• Wood, W., & Eagly, A. H. (2015). Two traditions of research on gender identity. Sex Roles, 73, 461-473. https://doi.org/10.1007/s11199-015-0480-2
• Yagan Güder, S. & Alabay, E. (2016). Examination of the toys preferences in children aged 3-6 in the context of gender. Journal of Kirsehir Education Faculty, 17(2), 91-111.
• Yagan Güder, S. (2014). Investigating preschool children's perception of gender (Publication No: 363226) [Doctoral dissertation, Hacettepe University]. Council of Higher Education Thesis Center.
• Zieky, M. (1993). Practical questions in the use of DIF statistics in test development. In P. Holland & H. Wainer (Eds.), Differential item functioning (pp. 337-347). Erlbaum.
• Zotos, Y. C., & Tsichla, E. (2014). Female stereotypes in print advertising: A retrospective analysis. Procedia-Social and Behavioral Sciences, 148(2014), 446-454. https://doi.org/10.1016/j.sbspro.2014.07.064

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.