Systematic Validation of a Self-Administered Questionnaire to Assess Bullying: from Elementary School to College and by Sex

Arnulfo Ramos-Jiménez, Óscar Armando Esparza del Villar, Alberto Castro-Valles, Rosa Patricia Hernández-Torres, Miguel Murguía-Romero, Rafael Villalobos-Molina

Texto completo

HTML (English) PDF (English)



There is a need to develop and validate an instrument to assess school bullying in the Mexican population in order to evaluate the issue and intervene accordingly. This study validates a bullying assessment instrument named Bull-M in children from 5th to 12th grade. The Bull-M was administered to a sample size of 2,030 students from 5th to 12th grade in several schools in Ciudad Juárez, Mexico. A two-factor structure of the Bull-M was analyzed with confirmatory factor analyses across the whole sample and gender and educational levels. The confirmatory factor analyses indicate good model fits, strong factor loadings and adequate Cronbach’s alpha values to assess internal reliability of the factors and scale. The Bull-M can be used to assess bullying in students from 5th to 12th grade in northern Mexico.

Palabras clave

confirmatory factor analysis; school violence; internal reliability; emotional health, children


Alzahrani, H. A. (2012). Bullying among medical students in a Saudi medical school. BMC Research Notes, 5(335), 1-3.

Bauman, S., Toomey, R. B., & Walker, J. L. (2013). Associations among bullying, cyberbullying, and suicide in high school students. Journal of adolescence, 36(2), 341-350.

Bickmore, K. (1997). Teaching conflict and conflict resolution in school: (Extra-) curricular considerations. Sydney, Australia: Connections ’97 International Social Studies Conference. Retrieved from

Byrne, B. M. (2004). Testing for multigroup invariance using AMOS graphics: A road less traveled. Structural Equation Modeling: A Multidisciplinary Journal, 11(2), 272-300. doi.10.1207/s15328007sem1102_8

Casey, S., Hayward, C., & Gowen, K. (2001). Middle-school girls’ reports of peer victimization: Concerns, consequences, and implications. Professional School Counseling, 5, 138-147.

Cerezo, F. (2006). Violencia y victimización entre escolares. El bullying: estrategias de identificación y elementos para la intervención a través del Test Bull-S [Violence and victimization among students. Bullying: Identification strategies and elements for intervention through the Bull-S test]. Electronic Journal of Research in Educational Psychology, 4(9), 333-352.

Cheung, G. W. & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233-255.

Craig, W., Harel-Fisch, Y., Fogel-Grinvald, H., Dostaler, S., Hetland, J., Simons-Morton, B., & Pickett, W. (2009). A cross-national profile of bullying and victimization among adolescents in 40 countries. International Journal of Public Health, 54(2), 216-224.

Creswell, J. W. (2003). Research design: qualitative, quantitative, and mixed methods approaches. Thousand Oaks, CA: Sage.

Cristobal, E., Flavián, C., & Guinalíu, M. (2007). Perceived e-service quality (PeSQ): Measurement validation and effects on consumer satisfaction and web site loyalty. Managing Service Quality: An International Journal,17(3), 317-340. doi:10.1108/09604520710744326

Crothers, L. M. & Levinson, E. M. (2004). Assessment of bullying: a review of methods and instruments. Journal of Counseling and Development, 82(4), 496-503.

Due, P., Damsgaard, M. T., Lund, R. & Holstein, B. E. (2009). Is bullying equally harmful for rich and poor children?: A study of bullying and depression from age 15 to 27. European Journal of Public Health, 19(5), 464-469.

Fatima, S. & Khatoon, S. (2015). Causes of students’ aggressive behavior at secondary school level. Journal of Literature, Languages and Linguistics, 11, 49-65. Retrieved from

Fleming, L. C. & Jacobsen, K. H. (2009). Bullying and symptoms of depression in Chilean middle school students. The Journal of school health, 79(3), 130-137.

Gilmartin, B. G. (1987). Peer group antecedents of severe love-shyness in males. Journal of personality, 55(3), 467-489.

Glover, D., Gough, G., Johnson, M., & Cartwright, N. (2000). Bullying in 25 secondary schools: Incidence, impact, and intervention. Educational Research, 42(2), 141-156.

Hanley, A. J., & Gibb, B. E. (2011). Verbal victimization and changes in hopelessness among elementary school children. Journal of clinical child and adolescent psychology, 40(5), 772-776.

Hu, L. & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55.

Instituto Federal Electoral [Federal Electoral Institute]. (2012). Consulta infantil y juvenil 2012 [Infant and juvenile consultation 2012]. Mexico: Author.

Instituto Federal Electoral [Federal Electoral Institute]. (2015). Consulta infantil y juvenil 2015 [Infant and juvenile consultation 2015]. Mexico: Author.

Instituto Nacional de Salud Pública [National Institute of Public Health] (2006). Encuesta nacional de salud y nutrición 2006 [National Survey of Health and Nutrition]. Mexico: Secretaría de Salud.

Instituto Nacional de Salud Pública [National Institute of Public Health]. (2012). Encuesta nacional de salud y nutrición 2012: Resultados nacionales [National Health and Nutrition Survey 2012: National results]. Mexico: Secretaría de Salud.

Kline, R. B. (2013). Exploratory and confirmatory factor analysis. In Y. Petscher, C. Schatsschneider, & Compton, D. (Eds.), Applied quantitative analysis in the social sciences (pp. 171-207). New York: Routledge.

Levine, E. & Tamburrino, M. (2014). Bullying among young children: strategies for prevention. Early Childhood Education Journal, 42(4), 271-278.

Nansel, T. R., Overpeck, M., Pilla, R. S., Ruan, W. J, Simons-Morton, B., & Scheidt, P. (2001). Bullying behaviors among US youth: Prevalence and association with psychosocial adjustment. Journal of the American Medical Association, 285(16), 2094-2100.

Ozkal, U. U. (2011). Bullying among university students and the relationship between bullying and psychological problems (Master’s thesis). Middle East Technical University, Ankara, Turkey.

Patton, D. U., Hong, J. S, Patel, S. & Kral, M. J. (2015). A systematic review of research strategies used in qualitative studies on school bullying and victimization. Trauma Violence Abuse, 18(1), 3-16.


Ramos-Jimenez, A., Wall-Medrano, A., Esparza-Del Villar, O., & Hernández-Torres, R. P. (2013). Design and validation of a self-administered test to assess bullying (bull-M) in high school Mexicans: a pilot study. BMC Public Health, 13(334), 2-7. doi:10.1186/1471-2458-13-334.

Sawyer, A. L., Bradshaw, C. P., & O'Brennan, L. M. (2008). Examining ethnic, gender, and developmental differences in the way children report being a victim of “bullying” on self-report measures. The Journal of Adolescent Health, 43(2), 106-114.

Secretaría de Salud [Secretary of Health]. (2006). Extracto del informe nacional sobre violencia y salud [Extract from the national report on violence and health]. Mexico: Author.

Shapiro, E. & Heick, P. (2004). School psychologist assessment practices in the evaluation of students referred for social/behavioral/emotional problems. Psychology in the Schools, 41(5), 551–561.

Tyler, L. (1972). Tests and measurements. Cliffs, NJ: Prentice-Hall.

Valencia, N. & Chacon, A. (2013, January 5). Juarez shedding violent image, statistics show. CNN. Retrieved from

Yong, A. G. & Pearce, S. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79-94. doi: 10.20982/tqmp.09.2.p079