For whom are school digital citizenship programmes associated with adolescent life satisfaction? Person and context interaction across three independent PISA cohorts
Esen Spahi Kovac 1, Sezen Haskuka Abdullahi 2 *
More Detail
1 University “Ukshin Hoti” Prizren, Kosovo
2 Department of Preschool Education, Faculty of Education, Trakya University, Türkiye
* Corresponding Author

Abstract

Schools increasingly run programmes that prepare students for responsible internet behaviour, yet little is known about whether such programmes are associated with how adolescents evaluate their lives, or for whom. Drawing on the bioecological model and the differential susceptibility to media effects model, we examined associations between a school-level indicator of digital citizenship provision and adolescent life satisfaction in three independent cohorts of the Programme for International Student Assessment (2018, 2022 and 2025). School principals reported whether their school had a specific programme to prepare students for responsible internet behaviour. We used causal forests to estimate conditional associations with life satisfaction and to test whether these associations differed by socioeconomic status, home digital access, gender and immigrant background, and we tested whether the pattern found in 2018 appeared in the independent 2025 cohort. Students in schools with a programme did not report meaningfully higher life satisfaction than comparable students in schools without one, and the programme indicator was not associated with feeling pressured to be online or anxious without a device. In the primary analyses the association did not differ by the four student characteristics, and the 2018 ranking of students did not identify stronger associations in 2025. Analyses that took the survey design, country weighting, missing data and school-level differences into account led to the same overall conclusion, although conventional models that weighted countries equally showed small and inconsistent differences across student characteristics. The confidence intervals ruled out average associations larger than a few hundredths of a standard deviation. A principal's report that a programme exists tells us little about adolescent wellbeing; measures of programme content, implementation and students' experience are needed.  

Keywords

Supplementary Files

References

  • Athey, S., Tibshirani, J., & Wager, S. (2019). Generalized random forests. The Annals of Statistics, 47(2), 1148–1178. https://doi.org/10.1214/18-AOS1709
  • Athey, S., & Wager, S. (2019). Estimating treatment effects with causal forests: An application. Observational Studies, 5(2), 37–51. https://doi.org/10.1353/obs.2019.0001
  • Austin, P. C., & Stuart, E. A. (2015). Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies. Statistics in Medicine, 34(28), 3661–3679. https://doi.org/10.1002/sim.6607
  • Banaruee, H., & Bieg, S. (2026). Teacher humour as a predictor of student emotions and motivation: The mediating role of socio-emotional and motivational factors. Motivation and Emotion. Advance online publication. https://doi.org/10.1007/s11031-026-10252-3
  • Belsky, J., & Pluess, M. (2009). Beyond diathesis stress: Differential susceptibility to environmental influences. Psychological Bulletin, 135(6), 885–908. https://doi.org/10.1037/a0017376
  • Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Methodological), 57(1), 289–300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x
  • Beyens, I., Pouwels, J. L., van Driel, I. I., Keijsers, L., & Valkenburg, P. M. (2020). The effect of social media on well-being differs from adolescent to adolescent. Scientific Reports, 10, Article 10763. https://doi.org/10.1038/s41598-020-67727-7
  • Bieg, S., Banaruee, H., & Dresel, M. (2026). The impact of teacher humour on teaching quality and student learning: An experimental approach. Learning and Instruction, 102, Article 102311. https://doi.org/10.1016/j.learninstruc.2025.102311
  • Bronfenbrenner, U., & Morris, P. A. (2006). The bioecological model of human development. In W. Damon & R. M. Lerner (Eds.), Handbook of child psychology: Vol. 1. Theoretical models of human development (6th ed., pp. 793–828). Wiley. https://doi.org/10.1002/9780470147658.chpsy0114
  • Diener, E. (1984). Subjective well-being. Psychological Bulletin, 95(3), 542–575. https://doi.org/10.1037/0033-2909.95.3.542
  • Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350. https://doi.org/10.1007/s10464-008-9165-0
  • Eccles, J. S., Midgley, C., Wigfield, A., Buchanan, C. M., Reuman, D., Flanagan, C., & Mac Iver, D. (1993). Development during adolescence: The impact of stage-environment fit on young adolescents' experiences in schools and in families. American Psychologist, 48(2), 90–101. https://doi.org/10.1037/0003-066X.48.2.90
  • Funder, D. C., & Ozer, D. J. (2019). Evaluating effect size in psychological research: Sense and nonsense. Advances in Methods and Practices in Psychological Science, 2(2), 156–168. https://doi.org/10.1177/2515245919847202
  • Gaffney, H., Farrington, D. P., Espelage, D. L., & Ttofi, M. M. (2019). Are cyberbullying intervention and prevention programs effective? A systematic and meta-analytical review. Aggression and Violent Behavior, 45, 134–153. https://doi.org/10.1016/j.avb.2018.07.002
  • Kraft, M. A. (2020). Interpreting effect sizes of education interventions. Educational Researcher, 49(4), 241–253. https://doi.org/10.3102/0013189X20912798
  • Kraut, R., Kiesler, S., Boneva, B., Cummings, J., Helgeson, V., & Crawford, A. (2002). Internet paradox revisited. Journal of Social Issues, 58(1), 49–74. https://doi.org/10.1111/1540-4560.00248
  • Lakens, D. (2017). Equivalence tests: A practical primer for t tests, correlations, and meta-analyses. Social Psychological and Personality Science, 8(4), 355–362. https://doi.org/10.1177/1948550617697177
  • Lakens, D., Scheel, A. M., & Isager, P. M. (2018). Equivalence testing for psychological research: A tutorial. Advances in Methods and Practices in Psychological Science, 1(2), 259–269. https://doi.org/10.1177/2515245918770963
  • Livingstone, S., & Helsper, E. (2010). Balancing opportunities and risks in teenagers' use of the internet: The role of online skills and internet self-efficacy. New Media & Society, 12(2), 309–329. https://doi.org/10.1177/1461444809342697
  • Odgers, C. L., & Jensen, M. R. (2020). Annual research review: Adolescent mental health in the digital age: Facts, fears, and future directions. Journal of Child Psychology and Psychiatry, 61(3), 336–348. https://doi.org/10.1111/jcpp.13190
  • OECD. (2024). PISA 2022 technical report. OECD Publishing. https://doi.org/10.1787/01820d6d-en
  • OECD. (2026a). Bullying in education: Prevalence, impact and responses across countries (OECD Education Working Papers No. 341). https://doi.org/10.1787/d9f8bd9f-en
  • OECD. (2026b). PISA 2025 assessment and analytical framework. https://doi.org/10.1787/86c36975-en
  • Orben, A., & Przybylski, A. K. (2019). The association between adolescent well-being and digital technology use. Nature Human Behaviour, 3(2), 173–182. https://doi.org/10.1038/s41562-018-0506-1
  • Orben, A., Przybylski, A. K., Blakemore, S.-J., & Kievit, R. A. (2022). Windows of developmental sensitivity to social media. Nature Communications, 13, Article 1649. https://doi.org/10.1038/s41467-022-29296-3
  • Pluess, M., & Belsky, J. (2013). Vantage sensitivity: Individual differences in response to positive experiences. Psychological Bulletin, 139(4), 901–916. https://doi.org/10.1037/a0030196
  • Proctor, C. L., Linley, P. A., & Maltby, J. (2009). Youth life satisfaction: A review of the literature. Journal of Happiness Studies, 10(5), 583–630. https://doi.org/10.1007/s10902-008-9110-9
  • R Core Team. (2025). R: A language and environment for statistical computing (Version 4.5.2) [Computer software]. R Foundation for Statistical Computing. https://www.R-project.org/
  • Rutkowski, L., Gonzalez, E., Joncas, M., & von Davier, M. (2010). International large-scale assessment data: Issues in secondary analysis and reporting. Educational Researcher, 39(2), 142–151. https://doi.org/10.3102/0013189X10363170
  • Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78. https://doi.org/10.1037/0003-066X.55.1.68
  • Sarzhanova, G., & Nurgabdeshov, A. (2025). Mapping psychological well-being in education: A systematic review of key dimensions and an integrative conceptual framework. Journal of Pedagogical Research, 9(3), 327–349. https://doi.org/10.33902/JPR.202534832
  • Seaman, S. R., & White, I. R. (2013). Review of inverse probability weighting for dealing with missing data. Statistical Methods in Medical Research, 22(3), 278–295. https://doi.org/10.1177/0962280210395740
  • Tibshirani, J., Athey, S., Sverdrup, E., & Wager, S. (2026). grf: Generalized random forests (Version 2.6.1) [Computer software]. https://doi.org/10.32614/CRAN.package.grf
  • Valkenburg, P. M., & Peter, J. (2007). Preadolescents' and adolescents' online communication and their closeness to friends. Developmental Psychology, 43(2), 267–277. https://doi.org/10.1037/0012-1649.43.2.267
  • Valkenburg, P. M., & Peter, J. (2013). The differential susceptibility to media effects model. Journal of Communication, 63(2), 221–243. https://doi.org/10.1111/jcom.12024
  • VanderWeele, T. J., & Ding, P. (2017). Sensitivity analysis in observational research: Introducing the E-value. Annals of Internal Medicine, 167(4), 268–274. https://doi.org/10.7326/M16-2607
  • Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48. https://doi.org/10.18637/jss.v036.i03
  • Wager, S., & Athey, S. (2018). Estimation and inference of heterogeneous treatment effects using random forests. Journal of the American Statistical Association, 113(523), 1228–1242. https://doi.org/10.1080/01621459.2017.1319839
  • Wickham, H., Miller, E., & Smith, D. (2025). haven: Import and export 'SPSS', 'Stata' and 'SAS' files (Version 2.5.5) [Computer software]. https://doi.org/10.32614/CRAN.package.haven
  • Yadlowsky, S., Fleming, S., Shah, N., Brunskill, E., & Wager, S. (2025). Evaluating treatment prioritization rules via rank-weighted average treatment effects. Journal of the American Statistical Association, 120(549), 38–51. https://doi.org/10.1080/01621459.2024.2393466

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.