PDF
FLIP
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Authors who publish in this journal agree to the following terms:
Acta Colombiana de Psicología complies with international intellectual property and copyright laws, and particularly with Article No. 58 of the Political Constitution of Colombia, Law No. 23 of 1982, and the Agreement No. 172 of September 30, 2010 (Universidad Católica de Colombia Intellectual Property Regulation).
Authors retain their copyright and grant to the Acta Colombiana de Psicología the right of first publication, with the work registered under Creative Commons attribution license, which allows third parties to use the published material, provided they credit the authorship of the work and the first publication in this Journal.
Abstract
This article aimed to develop and analyze an instrument for assessing group processes involved in collaborative problem-solving tasks in higher education. The Scale for the Assessment of Group Processes in Collaborative Problem Solving (GROUPS) consisted of 24 self-reporting items grouped into four dimensions: Exploring and Understanding, Representing and Formulating, Planning and Executing, and Monitoring and Reflecting. The study followed an instrumental design and took place in Chile. The test was administered to 939 higher education students, all of whom answered the instrument upon completing a 3-week task on collaborative problem-solving. The task was designed by the research team in collaboration with the students' teachers. Regarding validity, the instrument structure showed appropriate fit indexes according to the theoretical model’s four factors (RMSEA and SRMR under and SRMR under <.05; ; CFI and TLI over .95). The instrument also showed appropriate indices of reliability (ordinal alpha over .80 in all factors). The different group processes observed are described. Moreover, the instrument’s characteristics are discussed, as are the results obtained and their implications for developing collaborative problem-solving skills in higher education.
References
American Psychological Association (APA). (2017). Ethical Principles of Psychologists and Code of Conduct. https:// www.apa.org/ethics/code/ethics-code-2017.pdf
Borsinger, A. M. (2009). Writer development in the sciences: Expressing new meanings in research. In C. Andersen, N. Scheuer, M. P. Pérez Echeverría, & E. Teubal (Eds.), Representational systems and practices as learning tools (pp. 267–280). Sense. https://doi.org/10.1163/9789087905286_016
Care, E., & Griffin, P. (2017). Collaborative problem solving processes. In B. Csapó & J. Funke (Eds.). The nature of problem solving. Using research to inspire 21st century learning. OECD Publishing.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46. https://doi.org/10.1177/001316446002000104
Dindar, M., Järvelä, S., & Järvenoja, H. (2020). Interplay of metacognitive experiences and performance in collaborative problem solving. Computers & Education, 154, 103922. https://doi.org/10.1016/j.compedu.2020.103922
Doane, D., & Seward, L. E. (2011). Measuring Skewness: A Forgotten Statistic? Journal of Statistics Education, 19(2), 1–18. https://doi.org/10.1080/10691898.2011.11889611
Domínguez-Lara, S. (2012). Propuesta para el cálculo del alfa ordinal y theta de armor. Revista de Investigación en Psicología, 15(1), 213–217. https://doi.org/10.15381/rinvp.v15i1.3684
Ferrando, J., & Anguiano-Carrasco, F. (2010). El análisis factorial como técnica de investigación en psicología. Papeles del psicólogo, 31(1), 18–33. https://papelesdelpsicologo.es/pdf/1793.pdf
Graesser, A. C., Fiore, S. M., Greiff, S., Andrews-Todd, J., Foltz, P. W., & Hesse, F. W. (2018). Advancing the science of collaborative problem solving. Psychological Science in the Public Interest, 19(2), 59–92. https://doi. org/10.1177/1529100618808244
Graesser, A. C., Greiff, S., Stadler, M., & Shubeck, K. T. (2020). Collaboration in the 21st century: The theory, assessment, and teaching of collaborative problem solving. Computers in Human Behavior, 104, 106134. https://doi.org/10.1016/j.chb.2019.09.010
Griffin, P., McGaw, B., & Care, E. (Eds.) (2012). Assessment and teaching of 21st century skills. Springer. https://doi. org/10.1007/978-94-007-2324-5
Hayes, A. F., & Krippendorff, K. (2007). Answering the Call for a Standard Reliability Measure for Coding Data. Communication Methods and Measures, 1(1), 77–89. https://doi.org/10.1080/19312450709336664
Hesse, F., Care, E., Buder, J., Sassenberg, K., & Griffin, P. (2015). A Framework for Teachable Collaborative Problem Solving Skills. In P. Griffin & E. Care, Assessment and Teaching of 21st Century Skills. Melbourne Graduate School of Education. http://doi.org/10.1007/978-94-017-9395-7
Hu, L., & Bentler, P. M. (1995). Evaluating Model Fit. In R. H. Hoyle (Ed.), Structural Equation Modelling: Concepts, Issues, and Applications (pp. 77–99). SAGE.
IBM Corp. (2021). IBM SPSS Statistics for Windows, Version 28.0.
Kirschner, P. A., & Erkens, G. (2013). Toward a Framework for CSCL Research. Educational Psychologist, 48(1), 1–8. http://doi.org/10.1080/00461520.2012.750227
Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada. Anales de Psicología, 30(3), 1151–1169. http:// dx.doi.org/10.6018/analesps.30.3.199361
Lu, Y., Li, K. R., Sun, Z., Ma, N., & Sun, Y. (2023). Exploring the effects of role scripts and goal-orientation scripts in collaborative problem-solving learning. Education and Information Technology, 28, 12191–12213. https:// doi.org/10.1007/s10639-023-11674-z
Mercer, N. (2019). Language and the Joint Creation of Knowledge: The Selected Works of Neil Mercer. Routledge. https://doi.org/10.4324/9780429400759
Montero, I., & León, O. (2007). A guide for naming research studies in Psychology. International Journal of Clinical and Health Psychology, 7, 847–862. http://www.aepc.es/ijchp/GNEIP07_es.pdf
Muñiz, J., & Fonseca-Pedrero, E. (2019). Diez pasos para la construcción de un test. Psicothema, 31(1), 7–16. http:// doi.org/10.7334/psicothema2018.291
Organisation for Economic Co-operation and Development (OECD). (2017a). PISA 2015 Assessment and Analytical Framework: Science, Reading, Mathematic, Financial Literacy and Collaborative Problem Solving. OECD Publishing. https://doi.org/10.1787/9789264281820-en
Organisation for Economic Co-operation and Development (OECD). (2017b). PISA 2015 Results. Collaborative problem solving. Volume V.
Pazos, P., Micari, M., & Light, G., (2010). Developing an instrument to characterise peer-led groups in collaborative learning environments: assessing problem solving approach and group interaction. Assessment and Evaluation in Higher Education, 35(2), 191–208. https://doi.org/10.1080/02602930802691572
Pérez-Echeverría, M. P., Martí, E., & Pozo, J. I. (2010). Los sistemas externos de representación como herramientas de la mente. Cultura y Educación, 22(2), 133–147. https://doi.org/10.1174/113564010791304519
Prieto, G., & Delgado, A. R. (2010). Fiabilidad y Validez. Papeles del Psicólogo, 31(1), 67–74. https://www2.papelesdelpsicologo.es/pdf/1797.pdf
RStudio Team. (2023). RStudio: Integrated Development Environment for R. RStudio. http://www.rstudio.com/
Scoular, C., & Care, E. (2020). Monitoring patterns of social and cognitive student behaviors in online collaborative problem solving assessments. Computers in Human Behavior, 104, 105874. https://doi.org/10.1016/j. chb.2019.01.007
Slavin, R. E. (2017). Instruction based on cooperative learning. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction (pp. 388–404). Routledge Press.
The jamovi project. (2023). jamovi. (Version 2.3) [Computer Software]. https://www.jamovi.org
Visschers-Pleijers, A., Dolmans, D., Wolfhagen, I., & van der Vleuten, C. (2005). Development and validation of a questionnaire to identify learning-oriented group interactions in PBL. Medical Teacher, 27(4), 375–81. http://doi.org/10.1080/01421590500046395
##submission.citations.for##
