Revista Electrónica de Investigación Educativa
Vol. 9, Num. 2, 2007
Conceptions of Learning: The Design
and Validation of a Questionnaire
for Trainee Teachers
Silvia L. Vilanova
(1)
svilano@mdp.edu.ar
María B. García
(1)
bagarcia@mdp.edu.ar
Orlanda Señoriño
(2)
orlase@copetel.com.ar
1
Facultad de Ciencias Exactas y Naturales
Universidad Nacional de Mar del Plata
Funes 3350–7600
Mar del Plata, Buenos Aires, Argentina
2
Facultad de Humanidades
Universidad Nacional de Mar del Plata
Funes 3350–7600
Mar del Plata, Buenos Aires, Argentina
(Received: December 19, 2007; accepted for publishing: September 11, 2007)
Teachers as well as trainee teachers have conceptions of teaching and learning that do not correspond to the learning theories studied within the university course programs. The predominating ideas in this paradigmatic context, which are based upon the fact that subjects understand an action scenario, posses an implicit character and differ from the notion that they are expressed explicitly most of times. The objective of this article is to introduce the adaption and validation of an instrument designed to research on the conceptions of trainee teachers of the School of Humanities as well as the School of Exact and Natural Sciences of the National University of Mar del Plata (Universidad Nacional de Mar del Plata) in Argentina about learning. Also, it intends to conduct a first analysis of the results obtained after it has been administered. The instrument is an adaption of a dilemma questionnaire designed by Martín, Mateos, Pérez-Echeverría, Pozo, Pecharromán, Martínez, and Villalón, which they administered to 120 students. Cronbach’s Alpha was used to determine factor analysis reliability, and consequently construct validity. The following data analysis shows the application of the interpretative theory of learning based on an epistemological conception related to critical realism.
Key words: Conceptions, learning, teaching students, questionnaire
The literature review about research on conceptions and beliefs has demonstrated that teachers as well as trainee teachers conceive and develop their own learning and teaching representations intuitively: teachers through professional practice and trainee teachers through the result from their own experiences. This does not correspond to the learning theories which are formally studied within university courses (Porlán, Rivero, and Martín, 1998; Strauss and Shilony, 1994).
The predominating ideas in this paradigmatic context, which are based upon the fact that subjects understand an action scenario, posses an implicit character and differ from the notion that they are expressed explicitly most of times. Different research (Gil and Pessoa, 2000) suggests making teachers’conceptions explicit to analyze them later and redefine them eventually, in order to set a starting point for every effort to improve teaching.
Background research on this matter evidence that the analysis of different conceptions about what learning is and how people learn has gained importance during the last years. The topic has been studied from the perspectives of experimental design (Aldridge, Taylor and Chi Chen, 1997; Hammer, 1994; McGinnis, Greber and Watanabe, 1997; Schommer, 1990), and qualitative problem analysis (Baena, 2000; Belenky, Clinchy, Goldberger and Tarule, 1997; Perry, 1997); however, a great number of those studies analyze the explicit representations. On the contrary, this research aims to provide an instrument that allows a closer look to the most implicit level of representation.
Different studies have found connections between teachers’ conceptions and their assumptions on teaching and learning, which play a fundamental role for their performance at the classroom (Haney, Czerniak and Lumpe, 1996; Hewson and Hewson, 1987; Gil, 1991; Gil and Pessoa, 2000; Maor and Taylor, 1995; Medina, Zimancas, and Garzón, 1999; Nespor, 1987, Porlán, 1994). This study attempts to provide information on two aspects, since very little research has been made up to now:
Regarding the first aspect, it is important to understand that conceptions may have different cognitive structure complexity level and that representations of a more implicit nature are the most deeply-rooted; this implies a different perspective from that of the majority of the studies referred here. Most of the time, what subjects express explicitly is not completely related to the implicit representations, which are built upon the subject’s own experience in the world more than upon the formal education he or she received. Thus, it is important to study the representations of trainee teachers, analyze those representations to design spaces where to reflect on, and eventually, redefine them.
As regard to the second, the problem concerning the lack of analysis in the university context is observed, and it highlights the utmost importance to collect empirical information on this matter, since the number of research works is limited (Hativa, 2000; Lantz and Kass, 1987; Van Driel, Bulte and Verloop, 2005).
II.1 Conceptual Framework Studies based on cognitive psychology, consider the possibility of interpreting individuals’actions in terms of their mental representations and processes. From a cognitive perspective, the subject comprehends the object and creates representations to interpret it. Conceptions of learning may come from different representational levels; nonetheless, there is a continuum including all implicit theories on the topic, including the explicit knowledge. Together, the three aforementioned domain theories constitute a theoretical approach, which gives information on the most important positions found.
These representations are information units that individuals manage and process, and they account for mental constructions through which individuals understand the world. The notion derives from the assumption that there is a language in thought, a collection of mental representations that work as immediate objects of the mental process control (Martínez Freire, 2002). This perspective considers an elemental difference between perceptions and representations: objects of perception are perceptible for several individuals; while contents of perception are individual.
Current research studies evidence the importance that representation analysis has gained during the last years, as far as its organization and processes of change are concerned (Greca and Moreira, 2000; Pesa, 1997; Tyson, Venville, Harrison and Treagust, 1997). These research works suggest that representations created by individuals have different cognitive structure complexity levels and their modification depend, to a great extent, on the representational level involved.
II.2 Representational Levels
Mental Models
Mental models consist of beliefs, attitudes, and judgments that every subject has when he or she faces different situations. Mental models are representations created in response to specific demands and, in most cases, are developed ad hoc, in other words, from the construction of situation models. They are ideas of lower hierarchy, or uncertain answers that subjects will not hesitate to change when facing similar problems, and which are short-term memory activated (Rodrigo, 1997; Rodrigo, and Correa, 1999).
Domain Theories
Mental models correlate with a second level: domain theories. While these theories are of implicit nature, there is a possibility that the subject can be aware of them. Domain theories are explicitly represented within one’s memory; consequently, they are more stable than mental models are. They are a collection of rules or regulations upon which situation models are created (Pozo and Scheuer, 1999), and due to their implicit nature, they are less accessible to researchers through the traditional data collecting methods. They are constructed from representations of a field of knowledge; they determine the conceptions every subject activates in order to fulfill task demands, since they provide the mental models’invariable characteristics which are activated in different contexts.
Implicit Theories
Domain theories are organized upon general and stable structures based on a series of tacit assumptions composed by implicit theories. They are integrated by semantic, schematic, and prototypical knowledge, which is relative to a domain. They are constructed by associative assumptions based on a collection of episodic experiences according to the description of modern theories of connectionism. Implicit theories provide an epistemological and ontological conceptual framework upon which the subject creates domain theories, thus they restrain the selection of processed information, as well as the links between the elements of that information (Rodrigo, 1997).
II.3 Learning as a Representational Change
Rodrigo and Correa (1999) state that changes in domain and implicit theories, which are representations of a higher level, occur throughout processes at the level of mental models; for this reason, learning is understood as a representational change. From the theoretical perspective of Karmiloff-Smith (1994), it is a process of representational re-description through which implicit representations become progressively explicit “by redefining internally the already acquired representations; this is, by representing them again in different representation formats, although they are already represented, so that implicit information turns into explicit knowledge” (p.34).
Learning Domain Theories
According to some authors, individuals’intuitive conceptions of learning can be described upon three domain theories: direct, interpretive, and constructive theories (Pozo and Scheuer, 1999).
The research conducted was descriptive and transversal. The dilemma questionnaire designed by Martín, Mateos, Pérez-Echeverría, Pozo, Pecharromán, Martínez, and Villalón (2004) was adapted and administered to 120 students. Cronbach’s Alpha was used to determine factorial analysis reliability as well as the construct validity for the statistical analysis. Results evidence an Alpha of .705 for all the questionnaire items and four main components that explain 59.7% of the variance. Data analysis demonstrates the interpretative theory preponderance, based on an epistemological conception related to critical realism. Subjects Content validity. In order to determine whether the instrument items assessed the categories selected, content validity was measured through a system of independent judges, who classified and diagnosed the adaption of categories established for the variable according to the theoretical fundamentals and the questionnaire objective. Three judges were selected, all university professors who were philosophy, psychology and pedagogy specialists. At an interview, they expressed their opinions on the pertinence and adaption of items. Questionnaire reliability. Cronbach’s Alpha coefficient was used to determine the questionnaire reliability; in order words, to demonstrate results’stability and consistency. This coefficient is one of the most common ones used to determine the internal consistency or reliability of a questionnaire or scale. It is the average of Pearson correlation coefficients between questionnaire items, if scores are standardized, or covariances if they are not standardized. The coefficient depends on the number of items and on the correlation between the them and their covariances; their value must be between 0.0 and 1.0, and they are acceptable values at 0.70. The statistical package SPSS 12.0 was used for this analysis. Procedures for Data Analysis To analyze the influence of field of education on the conceptions of the future teachers about learning, subjects were separated into two groups, depending on their school of origin:
Variables
For the variable Conceptions of Learning, three categories were established according to the conceptual framework chosen for this research work:
The population considered for this research was the entire population of trainee teachers of the School of Humanities and the School of Exact and Natural Sciences of the National University of Mar del Plata (Universidad Nacional de Mar de la Plata).1 The non- probability sample, stratified by quota of subjects and subject type consisted of 120 students. Stratification was established by undergraduate program and by a proportional student representation for each program.
Data Collection Instrument
Due to the fact that the objective of this research was to study implicit conceptions, such as the domain theories, a dilemma questionnaire was used. An instrument with these characteristics allows its administration to a relative high number of individuals and, at the same time, it allows collecting more deep information, since questions are not directly formulated, but instead context situations are posed and subjects must get involved and adopt a position.
The dilemma questionnaire was based on a bibliographical search of different questionnaire proposals and it was an adaption of the dilemma questionnaire on learning elaborated by Martín et al. (2004).
The final version of the instrument consisted of 12 dilemmas, each with three multiple answer choices, which corresponded to the direct, interpretative and constructive domain theories about teaching and learning, which were described in the theoretical framework.
The instrument used poses dilemmas based on situations related to teaching and learning and it examines domain theories within this field, which are constructed upon epistemological assumptions which are also implicit. Thus, besides providing information about learning implicit theories, the instrument allowed a general approach to the underlying epistemological conceptions. For example, direct theory is built upon epistemological principles related to naive realism; the interpretative theory is associated to a critical realistic position; and the constructive theory is based on relativist epistemological principles. The questionnaire can be observed in the appendix.
Instrument Validation
Testing the instrument: check for clarity. In order to assess question items’ clarity regarding their wording and to check if they were easily understood by the subjects, a pilot testing was run by administering the questionnaire to a group of people who shared similar characteristics with the subjects who constituted the sample.
Construct validity. A construct is the measurable variable of a theory or theoretical frame. Its validity refers to the extent that the measurement obtained through the questionnaire correlates with theoretical hypotheses which are related to the assessed concepts.
Factor analysis was used to determine construct validity. Factor analysis is a multivariate statistical method, which establishes the number and characteristics of a collection of constructs that underlie a set of measurements. Its purpose is to interpret a correlation matrix of a number of variables in terms of the lower number of factors. This analysis generates artificial variables, called factors, which represent constructs. Factors derive from original variables and must be interpreted according to them. The analysis includes the explanation of variance.
In this study, a principal components analysis using Varimax rotation was performed. Principal components method consist of a linear combination of all variables, so that the first component explains the maximal amount of total sample variance; the second component explains the next largest amount of variance not accounted for the first component hence it is uncorrelated with the first component, and so on until all variables and components are covered. The number of intercorrelated variables is reduced to a smaller number of uncorrelated factors. On the other hand, the purpose of rotation is to interpret the factors’meaning and significance, if they are not clear in the unrotated matrix (Visauta Vinacua, Martori, and Cañas, 2003). The Varimax procedure is commonly used to minimize the number of variables with weights or high loadings on each factor.
Questionnaire Administration
After the questionnaire was administered, two aspects from the collected data were analyzed:
The following procedures were used to analyze the content of conceptions of learning:
Group 1: Trainee teachers from the School of Natural and Exact Sciences, from the undergraduate programs of Teacher of Mathematics, Chemistry, Physics, and Biology Sciences.
Group 2: Trainee teachers from the School of Humanities, from the undergraduate programs of Teacher of History, Geography, Philosophy, Letters, and Library Sciences.
The comparison was not based on the undergraduate program but on the school, due to the fact that some teacher training programs had few students, and the data collected could have not been significant if the analysis was based on the academic field.
The Chi-square, a statistical test used to test hypotheses and their association between categorical variables, was calculated; for which, appropriate contingency tables had been previously constructed.
IV.1 Results obtained in the validation of the questionnaire = 0.7055 As it was mentioned before, the value obtained for this coefficient depends on the number of questionnaire items and their covariances. Since it had only twelve items, the obtained value was considered acceptable and the questionnaire was reliable. Table I. Rotated Component Matrix As seen in Table I, factor 1 grouped dilemmas 1,7,10, and 12. Factor 2 grouped dilemmas 6, 8, and 9, although dilemma 11 had also higher load than .50. Factor 3 grouped dilemmas 2, 5, and 11. Finally, factor 4 only included dilemma 4. Table II. Variances Explained for Each Factor Table II shows total amount of variance explained for each factor. The first four factors grouped the eleven dilemmas included in the questionnaire, due to the fact that dilemma 3 was eliminated. These dilemmas were 59.77% of the total variability, which was an acceptable percentage. Table III. Mode for Each Dilemma Table IV and Figure 1 show frequency distribution for each answer submitted by the subjects discriminated by each implicit theory of learning for each dilemma considered in the questionnaire. Table IV. Answer -Frequency Distribution The analysis of the previous data, which can be carried out based on the table included in Annex 2 and which synthesizes the main concepts of each learning domain theory according to the three dimensions of the variable obtained from the statistical analysis, allows to obtain some conclusions: IV.2.2. Influence of Field of Education on Conceptions Table V. Chi-square Results As it can be observed, the values obtained from this study are not less than 0.05, which shows there is no association between the variables studied. Field of education seems to have no influence on learning conceptions of the subjects from the sample.
According to the opinion of the independent judges, who objected to some questionnaire dilemmas because they were confusing, the dilemmas were restated. In the second consultation some dilemmas were refused again so they were eliminated, as was the case of dilemma 3.
Results from the pilot testing showed that some questions were not clear enough, because subjects needed further explanation in order to be able to give an answer. Also, it evidenced that the way some dilemmas were posed was too extensive. In both cases, dilemmas were modified, so they expressed clearly the main idea.
In the implementation of Cronbach’s Alpha coefficient, in order to determine questionnaire’s validity, dilemma 3 was omitted due to its lack of clarity. This increased the internal consistency of the questionnaire. The result for the scale was:
Results of the principal components analysis used to examine construct validity are shown in the following table. Items in bold had a higher load than 0.5 in each component.
Results showed four main components, possible dimensions for variable analysis. The first factor grouped dilemmas 1,7,10, and 12, this indicated that the underlying dimension was related to the concept of learning, in other words, the four dilemmas included in the questionnaire were related to the question: what is learning?
The second factor, which included dilemmas 6, 8, 9, and 11, clearly showed that the underlying dimension was connected to the process and the way of learning. They answered the question: how is learning achieved?
Factors 3 and 4 grouped dilemmas 2, 4, and 5, which were related to the content of learning. They were associated with the question: what is learned?
In short, the results from the principal components analysis demonstrated the existence of three main dimensions of the variable which answered to three fundamental questions: what is learning? what is learned? and how is learning achieved? These dimensions were used to examine the collected data through the questionnaire administration.
IV.2 Results Interpretation
IV. 2. 1 Learning Concept Content
The following table shows the results obtained from the calculation of the mode, in other words, the most selected answer by the subjects in each dilemma.
Figure 1: Answer -Frequency Distribution for Each Dilemma
The following table shows the results of a Chi-square test conducted to analyze the relationship between the variables of education field and learning conceptions of the three categories: direct, interpretative and constructive.
V. Discussion and Future Steps
This article presented the results related to the validation of the instrument, the content of implicit conceptions of learning, and the analysis of the relationship between education and the type of conception of learning.
Instrument validation, through the use of Cronbach’s Alpha, determined the questionnaire’s reliability, as well as factor analysis showed three dimensions of the variable studied.
To summarize results interpretation regarding the content of conceptions, two out of three fundamental dimensions in the questionnaire, represented by 8 of the 11 dilemmas, showed that trainee teachers have implicit conceptions of learning related to the interpretative theory. This theory prioritizes content over strategy, and has an epistemological realistic critical position on knowledge.
The statistical analysis conducted did not evidence a correlation between the education field and the predominating implicit theory of learning.
In order to complement data analysis, there is work being developed to analyze the characteristics or level of consistency of conceptions so as to determine whether they include theories or they are beliefs with a lower level of internal articulation.
Annex 1: Dilemma Questionnaire
In a department meeting, teachers are discussing the different topics related to teaching. In this discussion different points of view are explained. Please select the answer that best describes your opinion.
Annex 2. Results Interpretation
In order to interpret the results, the following table A2 may be used to synthesize the main concepts of each learning domain theory, according to the three dimensions of the variable from the statistical analysis. Table A2. Relation between the main concepts of learning
domain theories and dimensions of the variable
Aldridge, J., Taylor, P., & Chi Chen, Ch. (1997). Development, Validation a use of the Belief about Science and School Science Questionnaire. Retrieved March 20, 2002, from: http://www.chem.arizona.edu/
Baena, M. D. (2000). Pensamiento y Acción en la Enseñanza de las Ciencias. Enseñanza de las Ciencias, 18 (2), 217-226.
Belenky, M. F., Clinchy, B. M., Goldberger, N. R., & Tarule, J. M. (1997). Women’s Ways of Knowing: The Development of Self, Voice & Mind. In B.K. Hofer and P.R. Pintrich, The Development of Epistemological Theories: Beliefs about Knowledge and Knowing and Their Relation to Learning. Review of Educational Research, 67 (1), 88-140. (Published in 1986).
Gil, D. (1991). ¿Qué Hemos de Saber y Hacer los Profesores de Ciencias? Enseñanza de las Ciencias, 9 (1), 69-77.
Gil, D. and Pessoa, A. M. (2000, April). Dificultades para la Incorporación a la Enseñanza de los Hallazgos de la Investigación e Innovación en Didáctica de las Ciencias. Educación Química, 11 (2), 244-251.
Greca, I. M. & Moreira, M. A. (2000). Mental Models, Conceptual Models, and Modelling. International Journal on Science Education, 22 (1), 1-11.
Hammer, D. (1994). Epistemological Beliefs in Introductory Physics. Cognition and Instruction, 12 (2), 151-183.
Haney, J. J., Czerniak, C., & Lumpe, A. (1996). Teacher Beliefs and Intentions Regarding the Implementation of Science Education Reform Strands. Journal of Research in Science Teaching, 33 (9), 971-993.
Hativa, N. (2000, September). Teacher Thinking, Belief, and Knowledge in Higher Education: An Introduction. Instructional Science, 28 (5/6), 331-334.
Hewson, P. and Hewson, M. (1987). Science Teacher’s Conceptions of Teaching: Implications for the Teacher Education. International Journal of Science Education, 9 (4), 425-440.
Karmiloff-Smith, A. (1994). Más Allá de la Modularidad. Madrid: Alianza
Lantz, O. and Kass, H. (1987). Chemistry Teachers: Functional Paradigms. Science education, 71 (1), 117-134.
Maor, D. and Taylor, P. C. (1995). Teacher Epistemology and Science Inquiry in Computerized Classroom Environment. Journal of research in Science Teaching, 32 (8), 839-854.
Martín, E., Mateos, M., Pérez Echeverría, P., Pozo, J. I., Pecharromán, A., Martínez, P., & Villalón, R. (2004, febrero). Las Concepciones del Profesorado: Formación y Cambio Conceptual. Reunión Internacional Mente y Cultura: Cambios Representacionales en el Aprendizaje. Centro Regional Universitario Bariloche, Argentina. Accessed on July 22th, 2004 at: www.uncoma.edu.ar/novedades/index/htm
Martínez Freire, P. (2002). La Nueva Filosofía de la Mente. Barcelona: Gedisa.
McGinnis, S., Greber A., & Watanabe, T. (1997, March). Development on an Instrument to Measure Teacher Candidate’s Attitudes and Beliefs about the Nature of and the Teaching of Mathematics and Science. Annual meeting of the National Association for Research in Science Teaching, Oak Brook, il, United States.
Medina, A., Zimancas, K., & Garzón, C. (1999). El Pensamiento de los Profesores Universitarios en torno a la Enseñanza y Demás Procesos Implícitos. Revista Electrónica Interuniversitaria de Formación del Profesorado, 2 (1), 563-569.
Nespor, J. (1987). The Role of Beliefs in the Practice of Teaching. Journal Curriculum Studies, 19 (4), 317-328.
Perry, W. G. (1997). Forms of Intellectual and Ethical Development in the College Years: A Scheme. In B. K. Hofer and P. R. Pintrich, The Development of Epistemological Theories: Beliefs about Knowledge and Knowing and Their Relation to Learning. Review of Educational Research, 67 (1), 88-140. (Original Work Published in 1970).
Pesa, M. (1997). Concepciones y Preconcepciones Sobre Formación de Imágenes. Tesis Doctoral, Universidad Nacional de Tucumán, Argentina.
Porlán, R. (1994) Las Concepciones Epistemológicas de los Profesores. El Caso de los Estudiantes de Magisterio. Investigación en la Escuela, 22, 67-84.
Porlán Ariza, R.; Rivero García, A., & Martín del Pozo, R. (1998). Conocimiento Profesional y Epistemología de los Profesores, II: Estudios Empíricos y Conclusiones. Enseñanza de las Ciencias, 16 (2), 271-288.
Pozo, J. I. &Scheuer, N. (1999). Las Concepciones Sobre el Aprendizaje como Teorías Implícitas. En J. I. Pozo & C. Monereo (Coords.), El Aprendizaje Estratégico (pgs. 87-108). Madrid: Santillana.
Rodrigo, M. J. (1997). Del Escenario Socio-Cultural al Constructivismo Episódico: Un Viaje al Conocimiento Escolar de la Mano de las Teorías Implícitas. In M. J.
Rodrigo & J. Arnay (Eds.), La Construcción del Conocimiento Escolar (pgs. 177-191). Barcelona: Paidos.
Rodrigo, M. J. & Correa, N. (1999). Teorías Implícitas, Modelos Mentales y Cambio Educativo. In I. Pozo & C. Monereo (Coord.), El Aprendizaje Estratégico (pgs. 75-86). Madrid: Santillana.
Schommer, M. (1990). Effects of Beliefs about the Nature of Knowledge on Comprehension. Journal of Educational Psychology, 82 (3), 498-504.
Strauss, S. & Shilony, T. (1994). Teachers Models of Children’s Minds and Learning. In L.A. Hirschfeld & S.A. Gelman (Eds.), Mapping the Mind. Domain Specificity in Cognition and Culture (pp. 455-473). Cambridge, MASS: Cambridge University Press.
Tyson, L. M., Venville, G. J., Harrison, A. G., & Treagust, D. F. (1997). A Multidimensional Framework for Interpreting Conceptual Change Events in the Classroom. Science Education, 81 (4), 387-404.
Van Driel, J., Bulte, A., & Verloop, N. (2005). The Conceptions of Chemistry Teachers about Teaching and Learning in the Context of a Curriculum Innovation. International Journal of Science Education, 27 (3), 303-322.
Visauta Vinacua, B., Martori, J., & Cañas, I. (2003). Análisis Estadístico con SPSS para Windows. Volumen II Estadística Multivariante (2nd. ed.). Madrid: McGraw Hill.
Translators: Eleonora Lozano Bachioqui and María Isabel Ramos
1The university programs of Teacher of Mathematics, Physics, Chemistry, and Biology are offered at the School of Exact and Natural Sciences, while Teacher of History, Geography, Letters, Philosophy, English, and Library Science are offered at the School of Humanities; both schools are from the National University of Mar del Plata (Universidad Nacional de Mar del Plata). The programs prepare graduates to give classes at a secondary and higher education level at the educational system in Argentina. The programs last 4 years and share classes of other undergraduate programs. Teacher training is complemented with a number of pedagogical courses that prepare students for their teaching practice.
Vilanova, S., García M. B., & Señoriño, O. (2007). Conceptions of Learning: The Design and Validation of a Questionnaire for Trainee Teachers. Revista Electrónica de Investigación Educativa, 9 (2). Retrieved month day, year, from: http://redie.uabc.mx/vol9no2/contents-vilanova.html