Revista Electrónica de Investigación Educativa
Vol. 9, No. 1, 2007
Out-of-School Activities Related to
Science and Technology
Ángel Vázquez Alonso
angel.vazquez@uib.es
Facultad de Ciencias de la Educación
Universidad de las Islas Baleares
Edificio Guillem Cifre de Colonya,
Carretera de Valldemossa, Km. 7.5, 07122
Palma de Mallorca, España
María Antonia Manassero Mas
ma.manassero@uib.es
Departamento de Psicología
Universidad de las Islas Baleares
Edificio Guillem Cifre de Colonya,
Carretera de Valldemossa, Km. 7.5, 07122
Palma de Mallorca, España
(Received: October 12, 2006; accepted for publishing: February 7, 2007)
Artificial and natural environments constitute an extensive educational resource in whose framework the basic experiences that contribute to the development process of human beings occur. These experiences are the source of previous knowledge that students bring to school and that are key for building scientific school learning. This article reports the results of a study that addresses out-of-school experiences related to science and technology, through the application of an inventory list to a sample of students who were in their last year of compulsory education. The results show a relatively low overall frequency of experiences, characterized by some qualitative and quantitative differences according to a few grouping variables such as gender, the choice of an elective science subject, and different scientific topics and disciplines. In spite of its importance for learning, the school curriculum often ignores students’ previous experiences. Finally, we discuss the relevance of these results for developing a more equitable science and technology curriculum, from a perspective of a universal, humanistic science education.
Key words: Educational background, socioeconomic background, science teaching, gender differences, science and technology curriculum.
The reduced innate load of human beings at birth must be compensated for by a long period of intense interaction with the environment, which gives rise to the process of maturing and learning. At the end of this period, of all creatures, humans are the most able to adapt to the hostility of their context. In the early 20th century the American educator, John Dewey (1995), had already argued that there is a solid and productive relationship between experience and education.
From a general innovative educational perspective, the educational value of the out-of-school context as an irreplaceable source of education is widely recognized, in such wise that attention to the experiences of students outside of school is an important complement to school itself. To look at the environment as a source of curriculum and allow it to be present in the school implies opening the school, affirming the educational capacity of the environment, territory and city and overcoming the chronic isolation resulting from the divorce of the school from society (Carbonell, 2001).
As recognized an educational expert (Tonucci, 2004), promoter of the importance of the environment and the city as educational agents—while not downplaying the role of the school—argues that the most important experiences for personal development in childhood and adolescence are those occurring outside the school. Students acquire an experiential, anecdotal and informal culture outside of school which is relevant to the individual, whereas the school promotes a public culture, systematic, organized and relevant to society, the result of reflection and humanity’s historical journey. The crucial function of the school is to integrate both cultures—experiential and public—for all students, so that this integration makes public culture significant and relevant; in other words, to develop socially relevant learning (Pérez Gómez, 1993). A truly meaningful education should also build on the informal experiences students have before or in parallel with school learning.
Academically, it is common to distinguish between non-formal and informal education. Although there is still argument about both, we can say that non-formal education is any organized activity (and which therefore has the intention of educating) that takes place outside the formally established system (the school) and that serves the learning needs of objective and identifiable clientele (Coombs, 1973). In contrast, informal education has a broader sense, since it includes all kinds of activities (incidental, spontaneous, supplementary, random, etc.) that are not specifically structured as educational per se, but that can produce learning (Sarramona, 1992).
The Relevance of Science Education project (ROSE),1 is an international comparative study that seeks to identify the factors crucial to the learning of Science and Technology (S&T) from the students’ perspective (Schreiner and Sjøberg, 2004). In this project, one of these factors is the students’ out-of-school experiences, which constitute a core of practical learning that students bring with them as previous knowledge to add to school learning. The distinction between non-formal and informal learning is not important here, because the activities considered are mostly informal.
This article studies the background experiences of students from their responses on an inventory list of informal activities of daily life that can be done outside of school and which have some kind of relationship with science and technology. It analyzes the relationship of these activities with the student’s gender, the selection of school science subjects and the number of books at home. It discusses the influence of these activities on students’ interest in formal school S&T education and learning.
Experiences with the physical and natural world are especially interesting for the teaching of science, because—beyond simply identifying pre-existing ideas—they allow the integration of students’ previous experiences into classroom activities. Moreover, they also provide empirical knowledge of nature that is relevant to the learning of science and develop the epistemological thinking that determines the use of metacognitive and learning strategies in S&T (see review in Campanario and Otero, 2000).
Constructivism has emphasized the importance of students’ previous ideas as the key element that determines subsequent learning. During the last two decades of the 20th century, a constructivist line of research emerged—one which has generated an enormous amount of results—, focused on previous ideas or alternative conceptions, which are, presumably, a consequence and result of students’ previous experiences (Driver, Guesne and Tiberghien, 1989; Duit, 2006; Hierrezuelo and Montero, 1988; Pozo, Sanz, Gómez and Limón, 1991).
Research finds that these ideas exist in students of all ages; they are repeated and reiterated in various historical and cultural contexts. Frequently they are the opposite of the scientifically correct ideas (i.e., they are scientifically heterodox) and, above all, they are very resistant to change, decisively hindering scientific learning in the school environment. Previous ideas act as veritable implicit theories or alternative conceptions to the scientific theories presented in school curriculum and thus constitute an important epistemological obstacle to learning science. Previous ideas are the most significant challenge for teaching the sciences; consequently educational and organizational proposals for science teaching frequently include strategies for overcoming them (Reid and Hodson, 1993).
Nevertheless, the limited success of different teaching methodologies aimed at overcoming previous ideas in the classroom (e.g. cognitive conflict), as well as criticism arising from a more general and theoretical perspective and directed at constructivism as a philosophy and general theory—for example, the mental “perversity” of its design—have contributed to a more realistic rethinking of educational goals (Millar, 1989). It seems clear that previous ideas cannot have another source than the everyday experience that students accumulate in the course of their evolutionary development, which involves cognitive skills, but also, and above all, procedural and affective abilities (Preece, 1984).
Other lines of research and numerous studies have suggested the need to take into account all of the dimensions of the person involved in learning, especially the procedural dimension—know-how—and the attitudinal dimension –learning the values needed to be a person (Vázquez and Manassero, 1998). In this latter theoretical framework, affective and attitudinal variables, particularly those related to expectations, values, motivation, interests, responsibilities and emotions, play an essential role in classroom learning (Manassero and Vázquez, 2001; Oliva et al., 2004; Vázquez and Manassero, 2007), claiming the attention of various science education forums (Watts and Alsop, 2000).
In today’s world, young people live in environments that are not only configured by the natural world, but ever more deeply by the pervasive presence of different artificial environments (technology). The daily opportunities for students to have meaningful and relevant experiences outside the classroom—endless sources of previous ideas—are significant and quite intense.
In the socio-cultural context of youth, Doll, Prenzel and Duit (2003) structure three basic spaces of informal science learning: the family, the peer group and media. For adults, Falk (2002) adds the workplace as a fourth space for informal science learning. In a survey conducted by this author, the findings showed that for a third of the sample the school is the main source of knowledge about science and technology, for less than a fourth it is the workplace and nearly half of all respondents learned during their leisure time (through informal learning experiences such as the Internet, reading books and magazines, visiting museums, zoos and aquariums or by participating in clubs and special interest groups).
Currently, the social environment offers an increasingly attractive array of non-formal cultural and leisure educational institutions (zoos, science and technology museums, school-farms, parks, nature schools, environmental education centers, botanical gardens, factories and industries, planetariums, astronomical observatories, science fairs, etc.): as well as informal activities related to science and technology (workshops, clubs, associations of all kinds, leisure centers, interactive games, etc.).
At the same time, research on science teaching gives increasing importance to the educative influence of these spaces, where science and technology are presented to the general public in an informal and relaxed manner, to the extent that today they constitute not only a thriving line of research around the world (Benlloch and Williams, 1998; Braund, Reiss, Tunnicliffe and Moussouri, 2004; Errington, Stocklmayer and Honeyman, 2001; Griffin, 1998; Jones, 1997; Medved and Oatley, 2000; Oliva et al., 2004; Semper, 1990; Stevenson, 1991; Tunnicliffe and Moussouri, 2003), but also real instruments for public communication of science and technology to society (Parque de las Ciencias, 1999; Toharia, 2003).
Although the school continues to be an important source of scientific learning, it has now ceased to be the principal source of science information for most people. Experiences outside of school form a valuable contribution to the organization and teaching of science in the school, since they influence its outcomes (Schibeci, 1989). In fact, students spend three-quarters of their lives outside of school, where learning, because it is informal, never stops. In spite of this, there is no awareness of its importance; indeed, government education policies do not support the informal education sector (Falk, 2002). School teachers tend to forget the powerful influence that out-of-school experiences have on knowledge, motivation, beliefs and attitudes toward science (Oliva et al., 2004). In this context, it is to be expected that the importance of informal education will further increase, so the challenge ahead will be to integrate the growing volume of results and studies and identify the critical properties of non-formal learning (in institutions such as museums and others) to properly connect the areas of informal and school-centered science and technology learning (Martin, 2004; Wellington, 1991).
The National Science Foundation (2006) defines informal scientific education as voluntary self-directed learning activities for all, motivated mainly by intrinsic interests, curiosity, exploration, manipulation, fantasy, task completion and social interaction. The distinguishing feature of informal scientific education is freedom of choice, which is why one author even calls it “free-choice learning” (Falk, 2002), because learners control and select what and how they learn, increasing the likelihood of being emotionally and intellectually more motivated by the science they are studying. Rennie, Feher, Dierking and Falk (2003) view informal science learning as “self-motivated, voluntary and guided by the needs and interests of learners” (p. 113).
According to Rahm (2002) informal science learning has six characteristics: 1) the science that is taught is not limited to a curriculum, but arises in response to the questions and interests of the students; 2) scientific knowledge is not simply absorbed, it penetrates through the students’ interactions with each other and with science; 3) informal environments offer an educational context that is focused on the students, rather than science; 4) it provides a variety of learning opportunities 5) the science is accessible to the participants; and, lastly 6) informal science content is broader than traditional science.
Informal experiences are not only a source of knowledge, they also provide the most basic affective reinforcements (goal achievement, a passion for discovery, satisfaction of curiosity), which are essential for maintaining motivation and interest in the object of the experience. It is commonly accepted that motivation and interest do not produce learning in and of themselves, but are prerequisites for learning. Hence, students’ science-and-technology-related experiences are important, because they reflect exposure to and contact with S&T. Thus, they are a significant attitudinal indicator for learning (Eagly and Chaiken, 1993).
Informal learning in diverse contexts such as the home (Schibeci and Riley, 1986), participation in extracurricular science activities (Tamir, 1990) and visits to science museums (Lucas, 1991) are useful for improving the students’ scientific reasoning skills (Gerber, Cavallo and Marek, 2001), addressing the problem of attention to diversity in science class (Jones, 1997), awakening positive attitudes and feelings towards science—curiosity, surprise, fascination, fun, self-confidence, interest and so on—(Medved and Oatley, 2000; Rix and McSorley, 1999; Russell, 1990; Stevenson 1991); and even strengthening scientific learning through spontaneous interaction with friends, family and teachers (Benlloch and Williams, 1998; Semper, 1990). Therefore, informal experiences can and should be exploited as a resource for school education. To this end, the first step should be to become familiar with these experiences, not ignore them (Lucas, McManus and Thomas; 1986; Tamir, 1990; Rix and McSorley, 1999).
Although the literature on science learning in informal educational settings (museums, science centers, clubs, etc.) is relatively abundant, few studies relate these experiences with academic learning processes in the school (Lucas, 1991). Many educators worry that school curricula for science and technology are boring, outdated and irrelevant, designed for a minority instead of trying to provide the majority with literacy, understanding and basic reasoning in science and technology (Millar and Osborne, 1998). All this makes the lack of interest in school science the most dramatic problem of science education because it translates into the flight of students from scientific options and majors when the time comes for choosing a course of study in college (Fensham, 2004).
Moreover, science and technology have a clear gender brand that is detrimental to girls and that also extends to previous experiences. Young people’s early experiences and out-of-school activities could influence the affinity and differential performance of boys and girls in science (Greenfield, 1996). Female students’ disinterest in scientific and technical subjects is circularly reinforced by girls’ fewer previous experiences with S&T (Keller, 1985). The imbalance in the previous experiences of men and women is also a decisive factor in the selection of scientific-technological studies and professions; boys make this decision much earlier than girls and through different mechanisms (Alemany, 1992).
In this theoretical framework, the study of previous S&T experiences can be a very interesting element for the teaching of science because informal experiences outside of school control reveal the roots of students’ motivation and interest in science and technology, and provide an additional resource for its improvement.
2.1. Sample Table I. Inventory of out-of-school experiences and activities This questionnaire has also been used in a slightly different form in the Norwegian SISS and in various studies (Sjøberg, 2000, Sjøberg e Imsen, 1987; Vázquez, 1996; Whyte, Kelly and Smail, 1987). For a more generalized analysis, the experiences on the inventory list are grouped according to the scientific discipline to which they are most directly related (Universe, Geology, Physics, Technology, Chemistry or Biology) or as general activities if they do not clearly belong to any of the above fields. In addition, students were requested to provide their sex, the science subject they had chosen to study as their elective course and the approximate number of books in their home.
The target population of the ROSE study is the students at the end of compulsory education (aged 15–16) in the participating countries. The study questionnaire was applied in an opinion sample of 32 schools in the Balearic Islands (Spain), in a randomly selected fourth course secondary group (ESO). We thus obtained a valid sample of 774 students, of whom 443 (57%) were female and 331 (43%) were male; most were 15 (n=466; 60%) and 16 years of age (n=223; 29%), with a minority of 14-year-olds (n=32; 4%); the rest were older as a result of having repeated a previous grade.
The students surveyed had for the first time chosen their elective science subjects (Physics and Chemistry and/or Biology and Geology) during the year in which the questionnaire was applied (55% were enrolled in at least one of these subjects). The group that chose to study science had approximately the same proportion of females (57%) as the group that didn’t study science and as the total sample. A social descriptor of the sample is the number of books in each student’s home, measured on a scale with seven positions, ranging from “no book” (1) to “over 500 books” (7).
2.2. Instrument
The instrument of extracurricular experiences in the ROSE study is a Likert-type inventory list called “My out-of-school experiences: What I’ve done”, which consists of a set of 69 phrases (Schreiner and Sjøberg, 2004). Each phrase describes an activity (see Table I) that can be carried out by the students outside of school, although the relation of each activity with S&T varies; for example, some are simply recreational (playing, fishing) and some are forms of entertainment (reading a horoscope, e-mail). The students rate the frequency with which they have undertaken each activity on the list on a four-point scale, never (1), seldom (2), sometimes (3) and often (4).
and the coding applied to each response category
2.3. Procedure
After preparation with the research team, the teacher of the selected class groups administered the questionnaire, between November 2002 and April 2003. The student’s gender, the number of books in his or her home and the science subject chosen by the student in fourth course of secondary education (ESO) were considered as independent variables.
To facilitate the overall assessment of the frequencies of responses to the items on the inventory list, the weighted average of the four response positions was used as a centralizing measure. The differences between groups were studied by means of an analysis of variance, considering the significance probability and the observed effect size (the difference between the averages divided by the standard deviation); on this statistic we carried out the interpretation of the magnitude of the differences.
The average scores for the entire sample of different items are distributed fairly evenly in the range between 1 and 4 points on the scale (skewness 0.29), with a slight tendency to accumulate in the lowest scores. The average of the distribution is somewhat below the midpoint of the scale (2.35 points, S.D. 0.91) and, therefore is considered a slightly negative indicator of participation in activities. Table II. Descriptive statistics of raw scores for the total sample The out-of-school activities the students participated in most frequently, which make up the highest range (the items with average scores located approximately one-half a standard deviation above the overall average), and in descending order, are as follows: The set of items with the highest frequency of activity is clearly tilted towards activities related to the information and communication technologies (ICT), such as the computer (Internet, games, dictionaries), mobile phone, camera, television and calculators, which dominate the most frequent activities. The only exception is measuring the size of objects. The least frequent activity is milking an animal, an activity that not so many years ago was still common in rural areas, but today is an experience that seems completely out of reach for the average schoolchild. The other activities on this list of the least frequent are now, in fact, out of the reach of most young people in our society, including, of course, the most manual, such as how to make dairy products and composting, but also the most technical, like using a car jack (cars today suffer less flat tires) or charging a car battery (if the battery goes dead or fails, our unsustainable throwaway consumer mentality often results in it being replaced by a new one, because it is safer and cheaper). 3.1. Thematic variables of previous experiences Table III. Descriptive statistics and statistical significance (ANOVA) for the thematic variables, together with the effect size for gender differences Given the very open and diverse nature of the items, some of their assignments to themes may be surprising, but they were the only possible choices (e.g. read horoscope was assigned to the universe theme). On the other hand, it should be added that these thematic variables are not intended to form subscales based on an analysis of reliability, but only to endeavor to establish a correspondence with the usual areas in which S&T curricular content is generally grouped. Table IV. Items whose gender differences are statistically significant (p <0.01) and favorable to the female students, sorted by the effect size of the differences. The qualitative analysis of activities where male and female students differ most from each other sheds more light on the differential gender experiences that girls and boys bring to science class as hidden curriculum. Girls reported having participated in the following out-of-school activities with significantly greater frequency than the boys (see Table IV): These activities show a more even distribution by theme and less focus on the physics and technology themes than the boys’ activities (as shown in the paragraphs below): Universe (read horoscopes); Geology (collected stones or shells); Physics (measuring, mobile phone, messages); Chemistry (making bread, cooking); Biology (caring for the sick). Grouped by themes, these activities are related predominantly to physics and technology: Physics (binoculars, water pump, electric bulbs, electric outlets, stopwatch, wheelbarrow, crowbar, rope and pulley, mending a tire); Technology (building with wire, bow and arrow, air gun, models, windmill, computer games, open a device, use tools, carjack, charge battery); Chemistry (composting, fire); Biology (hunting, fishing); general activities (watch nature programs on TV, use a science kit). Qualitatively then, the most significant activities for the boys are focused on object manipulation and artificial devices. Table V. Items whose gender differences are statistically significant (p <0.01) and favorable to the male students, sorted by the effect size of the differences. In some specific items, the effect size of gender differences is unusually large (about one standard deviation), both in favor of the male as well as the female students. For two items, there is a very great effect size that favors the girls, that is, the girls far exceed the boys in their experience: In contrast, there is a very large effect size in favor of the boys for the following four items, in which they greatly surpass the girls in their experience: The qualitative analysis of the social significance of the group of activities that are significantly more frequent for one gender group than the other reveals a very striking characteristic. It is clear that, together, the experiences reported by the students reflect a certain maintenance and transmission of gender roles and social stereotypes in the activities themselves. Thus, whereas the girls carry things on their heads, sew, knit, cook and care for people more than the boys, the latter, in contrast, reflect the stereotype of the hunter, fisherman and domestic handyman who uses and manipulates tools, cords, equipment, etc. Therefore, the strength of social gender stereotypes emerges as a powerful determinant and regulator of out-of-school S&T experiences. Table VI. Items with a statistically significant difference between students who choose to study science and those who do not (p < 0.01), sorted by the effect size of the differences The qualitative analysis of activities in which the science and non-science students significantly differ sheds more light on the differential experiences that each group brings to science class, perhaps as hidden curriculum. Listed in order of least to greatest difference in favor of the science students, the out-of-school activities in which science students participate with a significantly greater frequency than the non-science students are the following (see Table VI): The number of experiences where science students reported a significantly higher frequency of activity than the non-science students is very large (nearly half the total list). Grouped by themes, these activities are: Universe (constellations) Geology (map reading); Physics (binoculars, camera, water pump, light bulbs, electrical connections, electrical outlets, stopwatch, thermometer, measuring tape, wheelbarrow, crowbar, pulley, mend tire); Technology (build with wire, air gun, models, windmill, recordings, computer games, downloading music, e-mail, word processor, open a device, Internet); Chemistry (recycling); Biology (watched the birth of an animal, incubation, watched an animal nurse, zoo, milk an animal, make dairy products, grow plants, X-ray, hospital, microscope); General themes (read science books and magazines, visit science museum, use science kit). The differences according to the number of books in the home are complicated to analyze, because the encoding of the original variable (books) has seven categories and a very unequal number of individuals is assigned to each one of them. Under these conditions, the analysis of statistical difference would only indicate that at least two of these groups have significant differences between them. More interesting than the mere significant differences would be the type of variation observed in the frequency of activities over the entire range of categories of numbers of books in the home, whether monotonous (increasing or decreasing) or irregular; however, with seven groups, this variation is difficult to interpret. Although a correlational analysis might be considered (though the merely ordinal nature of the rating scale with only four points does not make this plausible), we opted for the same analysis of variance. To this end, we collapsed the original variable into a new variable of only four groups (few books, some books, quite a lot of books and many books). With this greater balance in relation to the sample and with fewer groups, the analyses of variance were performed on these four groups of the new variable (comparison between pairs of groups). Table VII. Descriptive statistics and statistical significance (ANOVA) for items whose differences, according to the number of books in the home, are statistically Only a few items of out-of-school experiences have significant differences depending on the number of books in the home (see Table VII). In the vast majority of these (with the exception of the G19 and G32 experiences), there is also a pattern of increasing monotony between the groups that have books and a greater frequency of out-of-school experiences; in other words, as the number of books in the home increases, the frequency of reported activities also increases. The content of the experiences with significant differences and a monotonous increase in relation to the number of books in the home are the following: As can be seen at first glance, these activities are very diverse and pertain to many different themes. If we agree to consider the number of books in the home as an indicator of the cultural level of the family, some of these activities–such as searching the Internet, word processing or making collections–could plausibly be interpreted as being related to a higher household cultural level in the strictest academic sense; still, others such as baking, setting up a tent or reading a map could hardly be explained with an interpretation of this nature.
The distribution of average scores is negatively skewed, as the number of items with extreme scores is skewed toward the lowest scores; there is a greater number (28% of items) in the lowest range (between 1.5 and 2 points) than in the highest range (3 to 3.5 points), where just 12% of items are found (see Table II).
In the lower half of the most frequent activities are some that fall outside of the framework of electronic technology, forming a category that is actually more manipulative of objects, such as connecting electrical cords, measuring times and temperature, cooking, etc.
On the opposite pole, the least frequent activities (those with average scores located approximately one-half a standard deviation below the overall average) are more numerous than the activities in the most frequent range. In descending order from highest to lowest score, these activities are:
As already mentioned, from a comprehensive look at the distribution of the average scores of the responses, the most relevant feature of the results emerges as a certain negative skewness in favor of the lowest scores, which correspond to the least preferred activities. Specifically, this difference focuses on the different number of items located on the symmetrically extreme ends of the range of scores, between those on the high end of the scale (e.g., between 3 and 3.5 points) and those on the low end (e.g., between 2 and 1.5 points). Whereas there are only 8 activities on the high end, the number of activities whose average score is located on the low end is 20, more than double the former number.
This result can have two immediate interpretations: on the one hand, the most evident and direct one is that the less frequent activities are more numerous but are performed much less frequently than the activities which are carried out with a symmetrical intensity. On the other hand, a more indirect interpretation would suggest a hypothesis of broader reach: that science generates more rejection than acceptance among students, which—as suggested by the indicator examined—results in a smaller share of pre-scientific experiences for the students. The asymmetry between the smaller number of activities that are most often undertaken and the larger number of less frequently performed activities would be a consequence and an indicator of this overall tendency toward rejection of science, as manifested in lower overall experience with science-related activities.
The individual items of previous experiences have been grouped into more comprehensive thematic variables according to their connection with different scientific disciplines (physics, chemistry, biology, etc.). Each variable is the average of the scores for the items assigned to the theme and is, in consequence, a more global indicator. In addition, these variables are more representative of the theme than the individual items by themselves, since they summarize a set of items belonging to each theme (Table III).
and for students who elected science courses
Using as a reference the average overall frequency of the sample (2.35), it can be observed that previous experiences in two themes (universe and technology) obtained average scores above the overall average. In contrast, at the other extreme, previous experiences in geology had the lowest frequency, with a significant differential effect size compared with the overall average. The rest of the themes—which showed great similarity to each other—had slightly lower scores than the general average. It is noteworthy that of this intermediate set, experiences related to physics had the highest score of the group.
3.2. Gender differences
In addition to the transnational comparisons, the ROSE project has stated that an important objective is the analysis of differences between male and female students. The present analysis shows that out-of-school experiences are an important source of qualitative differences between the genders.
Overall, the average frequency of girls’ activities (2.30; S.D. 0.86) is lower than boys’ (2.41; S.D. 0.93), although the gender gap in this parameter is not statistically significant. Therefore, from this indicator we can conclude that boys performed activities related to science and technology more frequently than girls, although the overall gender difference is not statistically significant.
Another approach for further comparison of previous experiences of male and female students is to compare the most and least frequent activities in one group and the other, using as a criteria, as in the above paragraphs, the activities that are separated by more than one-half a standard deviation from the mean. A qualitative comparison of the lists of boys and girls reveals that many of the activities listed are shared by both genders; although they may be located in different positions of the table. The differences arise in a few activities, which are absent in one or the other gender, and in another small group of activities, where the differences in the respective positions are relatively far apart within this same group. Nevertheless, a table summarizing this type of results is very tedious and the data it reflects is very partial; therefore, the more systematic method of identifying the individual activities which were the cause of significant gender differences was preferred, directly comparing each activity for the boys’ group and the girls’ group.
Female Male Effect size female-male ANOVA
Out-of-school activities that male students carried out with a significantly higher frequency than female students, listed from least to greatest favorable difference for boys, are the following:
In general, one can conclude that boys exhibit a greater frequency of experiences in out-of-school activities, for not only is their overall average frequency of activity higher than that of the girls, but, considering those activities where the boys report a significantly higher frequency than the girls, their number (25) is remarkably higher than the group of activities performed most frequently by the girls (12) (see Table V).
Female Male Female-male effect ANOVA
From the perspective of the different themes in which the experiences can be grouped, male students surpassed the female students quantitatively in physics and technology activities; still, it should be noted that the girls outperformed the boys in some of the activities in these two groups, such as measurements, the use of cameras, calculators and mobile phones. Girls also surpass boys in themes pertaining to the universe, with a very significant effect size of nearly one standard deviation (Table III).
Certainly, the difference observed in the interest in horoscopes is not unrelated to the difference in this theme.
In summary, although the results of gender differences in out-of-school experiences are not significant overall, still, the more detailed qualitative analysis reveals some interesting differences, which lead to a suspicion of the influence of social gender stereotypes on them. These stereotypes could be summed up as “DIY boys” and “cook and care for people girls”; nonetheless, the incorporation of women in the world of science can also be perceived in the study, in the themes of the universe and technology, where, as already mentioned, the females even surpass the males in some aspects.
3.3. Differences between science students and other students
The election (or not) of a science subject (the class in which the questionnaire was administered) is also expected to be a pertinent indicator for analyzing out-of-school experiences. Overall, the average frequency of activities of students who did not elect to take a science class (2.28; S.D. 0.92) is lower than that of those who did choose science (2.41; S.D. 0.90), and the difference on this global parameter is perched on the very edge of statistical significance. This indicator allows us to conclude that science students participate in the activities on the list more often, overall, than students who choose not to study science.
One way to further compare the previous experiences of science students and non-science students would be to generate lists of the most and least frequent activities in one group and the other, using as criteria the separation from the upper average of one-half a standard deviation. On these lists, many of the activities included for both groups match, although they appear in slightly different positions on the lists; the few that comprise the difference may be absent from one list or the other, making their identification more complicated. Only a few are on both lists, in positions relatively remote from each other.
As in the case of the gender differences, consulting these comparative lists is very tedious and, for the purpose of identifying differences, the data they reflect is very partial, since they only refer to a small percentage of items. We therefore preferred the more systematic method of identifying those activities which directly caused significant differences between the two groups.
In general, there is a prevalence of previous experiences related to technology, physics and biology, a result which in itself would not reflect any special circumstance, except perhaps as a purely numerical and proportional parameter, because these three groups also have the largest number of items, so it might simply be amplifying a general effect favorable to the science students.
The effect size of the differences between the science group and the group that chose not to study science is relatively small for all items. The most notable aspect of the differences between those who selected some science subject and those who did not is the qualitative and quantitative extension of the differences: the former have greater experience in nearly all 69 items on the list. This difference is statistically significant in almost half of them. In contrast the non-science group does not present a single item where their experience is significantly greater than that of the science group.
The differences in relation to the different themes are also in favor of the science students, although the effect size continues to be moderate or small; it is highest in technology, physics and biology (Table III). Thus, even though the differences are not particularly noteworthy in any theme, the qualitative differences are indeed quite large in the vast majority of the themes, conferring on students’ out-of-school experiences the character of hidden curriculum, an indicator and inducer to science and technology.
In short, the frequency of out-of-school previous experiences seems to have a definite consequence in the selection of a science course at the end of compulsory education: the students that chose to study a science subject have a superior background of previous experiences in all aspects than those who choose not to study science. These results do not show whether the students’ out-of-school experiences are the cause of their choice of science or not, but they certainly furnish a profile and a sharp border: the students who decide not to study science have an out-of-school experience that is clearly inferior in relation to those who choose to study science. Hence, regardless of whether students’ early out-of-school experiences are a determining factor or not for the future choice of scientific studies, such experiences should be promoted by all possible means, in-school and out-of-school, as a compensatory measure. In particular, in primary and secondary education, students should find in the science classroom an inexhaustible source of experience for their daily lives that would stimulate their curiosity and their contact with those experiences which will, in the long run, influence their interest in science.
3.4. Differences according to the number of books in the home
significant (p < 0.01), in order of the effect size of the differences
• 27. Sorted garbage for recycling or for appropriate disposal;
• 46. Used a calculator;
• 59. Baked bread, pastry, cake, etc;
• 47. Used a stopwatch;
• 57. Used a word processor;
• 5. Collected different stones or shells;
• 3. Read a map to find my way;
• 48. Measured the temperature with a thermometer;
• 24. Put up a tent or shelter;
• 52. Searched the internet for information.
These results establish that previous S&T experiences are only weakly related to the number of books in a home, and that this relationship is predominantly positive in the case of items with the most significant differences. The number of books variable is a modest indicator of out-of-school experiences; the dozen variables of experiences that show significant differences are an indicator that supports a moderate significance of the variable of books in the home on the out-of-school experiences.
The experiences that students pursue in their daily life outside of school form a previous parallel background, often hidden (or ignored) by the school, which appears insensitive to them, but they are the source of previous ideas that continually interact with the construction (or reconstruction) of school learning. From a constructivist approach to learning, it seems reasonable to argue that students’ previous science-related out-of-school experiences affect school learning of science and technology. In the case of an intense and enriching experience, it facilitates school S&T learning, whereas in the case of inadequate or deficient experiences, they hinder it. In the latter case, especially in compulsory, universal education and a humanistic scientific education, focused on scientific literacy, the school should play a compensatory role in relation to the initial inequalities among students, as a guarantee of genuine equality of educational opportunities (Acevedo, Vázquez and Manassero, 2003). This study provides sufficient data and evidence for an innovative approach to science curriculum that takes both of the above issues into account, facilitating the design of a science curriculum focused more on previous experiences in general and more gender balanced in particular. One possible design approach would be to develop the experiences most frequently detected in girls as key motivational elements while the experiences in which the girls are deficient could guide the development of compensatory curriculum and classroom activities (selecting examples, materials and motivational or compensatory elements) to better accommodate girls in science class. In both cases, not only would the boys not be adversely affected, but they could also benefit, in turn, by compensating their own group imbalances in relation to science and technology. Increase by at least 15% the total number of college graduates in mathematics, science and technology, reducing, during the same period, the imbalance in the representation of men and women. (UNESCO-OCDE-Eurostat questionnaire, quoted in Council of Europe, 2003). In summary, schools should give priority to innovations for achieving a more equitable curriculum (Vázquez, Acevedo and Manassero, 2005) and, in particular, for achieving true gender equity in the sciences, as one aspect of a real contribution to the building of a more inclusive general education, for science and technology as well.
This study helps to reveal this hidden background, giving voice to the protagonists—the students—in order to clarify the intensity and diversity of the previous experiences that students bring to school. In general, the analysis of the students’ out-of-school experiences offers interesting elements for the teaching of science, as a general indicator of attitudinal disposition to S&T. The main results obtained show that the greatest differences do not appear as a social indicator (the number of books in the home) or an indicator of interest (electing to study a science subject)—where the detected differences are certainly visible, although minor or moderate—but specifically as the gender variable.
The results demonstrate that boys and girls have a background of science-related experiences that are clearly different, both qualitatively and quantitatively. This difference intensely reflects social gender stereotypes translated into the well-known gender brand of science (“DIY boys” and “cook and care for people girls”). From the perspective of science teaching, this differential background is very important, because it can dramatically condition school learning of science for male and female students. If the organization of school science education is more in line with the male pattern of previous experiences (DIY) as some studies suggest (Barton, 1998; Brickhouse, 1998; Jiménez and Álvarez, 1992), it will be encouraging science learning in the boys while discouraging girls’ interest in science as well as their learning of it. This differential background may also explain some of the indicators of gender differences in science which are common in evaluation studies, such as female students’ inferior school performance and poorer attitudes toward science compared with male students; less interest in science in general on the part of girls, as well as girls’ flight from scientific and technical studies, in which the incompatibility of school science and females is discerned (Farenga and Joyce, 2000; Sahuquillo, Jiménez, Domingo and Álvarez, 1993).
The heavy burden of gender stereotyping is manifest in the dominant and differential experiences of each of the genders. Presumably, the gender differences in out-of-school S&T experiences can be an (additional) indicator of the different socialization of girls and boys from birth, through the action of gender roles and stereotypes in society, whose influence on young people can determine the very different previous S&T experiences of girls and boys and the subsequent implications for the learning of science and technology.
In the teaching of science—which seems to favor males to the detriment of females—and faced with the reality of gender inequity with its social roots, the school must strengthen its role in compensating for initial inequalities. This compensatory function could be accomplished by:
Informal out-of-school experiences not only provide extra initial support for school learning (Lucas, McManus and Thomas; 1986; Tamir, 1990; Rix and McSorley, 1999), but can also be a relevant indicator of general attitude towards science and technology (greater previous experience would indicate a better attitude and more interest in S&T). The school must interrelate both ways of learning, informal and academic, to avoid disconnection or fragmentation between the achievements of one context and the other, or even, possible conflicts between them (Wellington, 1991).
Furthermore, there is increasing evidence that the contexts that offer informal out-of-school experiences contribute to science learning; they improve not only the learning of more traditional features of school science (e.g., the development and integration of concepts, authentic and comprehensive practical work and access to up-to-date materials and high-level science), but also more generic, basic, attitudinal and social dimensions, such as personal development, responsibility, socialization and attitudes towards school science, which help stimulate further learning (Braund et al., 2004). Formal science teaching should revisit aspects of informal learning, in order to supplement, enrich and improve the science education that is usually offered in the more formal classroom situation (Griffin, 1998; Oliva et al., 2004).
Today we observe increasingly significant efforts to promote, coordinate and integrate the growing influence of out-of-school, informal and non-formal education, with school education. Some examples are: the Center for Informal Learning and Schools under the Exploratorium of San Francisco (http://www.exploratorium.edu/cils/documents/bridging_k12-isi.pdf), the Center for Integrating Out-of-School Learning into the School Curriculum of Israel, (http://www.weizmann.ac.il/acadaff/Scientific_Activities/current/Davidson_center.html), the program “Science Linkages in the Community” (SLIC) of the American Association for the Advancement of Science (http://www.aaas.org/programs/education/slic), the program of the Coalition for Science After School (http://qt.exploratorium.edu/csas/) or the Michigan Gateways Guide of the state of Michigan (http://www.gateways.msu.edu/203pn.html).
The European Union has recently recognized the educational value of non-formal and informal education in young people’s contexts: non-formal and informal activities can provide significant value to society, to the economy and to young people themselves; they are effective instruments of the educational process that make learning attractive; they promote a disposition in young people to lifelong learning, social integration, the acquisition of new knowledge, skills and competencies; and they contribute to their personal development, social inclusion and active citizenship, thereby improving their employability (Council of Europe, 2006). Consequently, the European states are invited to promote formal and informal activities and to recognize the competencies and knowledge acquired by young people through non-formal and informal education.
The design of curricula and school practices that compensate for potential initial inequality is a necessary condition for building a school that is more inclusive in science and technology, especially for female students. This is in line with the proposed target of the European Council of Education for the year 2010, namely:
Acevedo, J. A., Vázquez, A. & Manassero, M. A. (2003). Papel de la educación CTS en una alfabetización científica y tecnológica para todas las personas. Revista Electrónica de Enseñanza de las Ciencias, 2 (2). Retrieved june 12, 2006, from: http://www.saum.uvigo.es/reec/volumenes/volumen2/Numero2/Art1.pdf
Alemany, C. (1992). Yo también he jugado con Electro-L (Alumnas en enseñanza superior técnica). Madrid: Instituto de la Mujer.
Barton, A. C. (1998). Feminist science education. New York: Teachers College Press.
Benlloch, M. & Williams, V. N. (1998). Influencia educativa de los padres en una visita al museo de la Ciencia: actividad compartida entre padres e hijos frente a un módulo. Enseñanza de las Ciencias, 16 (3), 451-460.
Braund, M., Reiss, M., Tunnicliffe, S. D. & Moussouri, T. (2004). Beyond the classroom: the importance of outside-of-school contexts for learning science. In R. M. Janiuk & E. Samonek-Miciuk (Eds.), 11th Symposium Proceedings (pp. 87-88). Lublin, Poland: International Organization for Science and Technology Education.
Brickhouse, N. W. (1998). Feminism(s) and science education. In B. J. Fraser & K. G. Tobin (Eds.), International Handbook of Science Education (pp. 1067-1081). London: Kluwer Academic Publishers.
Campanario, J. M. & Otero, J. (2000). Más allá de las ideas previas como dificultades de aprendizaje: las pautas de pensamiento, las concepciones epistemológicas y las estrategias metacognitivas de los alumnos de ciencias. Enseñanza de las Ciencias, 18, 155-170.
Carbonell, J. (2001). La aventura de innovar. El cambio en la escuela. Madrid: Morata.
Consejo de Europa. (2003). Conclusiones del Consejo de 5 de mayo de 2003 sobre los niveles de referencia del rendimiento medio europeo en educación y formación, published in the Official Journal C 134, June 7, 2003. Retrieved June 21, 2006, from: http://europa.eu.int/scadplus/leg/es/cha/c11064.htm
Consejo de Europa (July 20, 2006). Resolución del Consejo y de los Representantes de los Gobiernos de los Estados miembros, reunidos en el seno del Consejo, sobre el reconocimiento del valor de la educación no formal e informal en el ámbito de la juventud europea, published in the Official Journal of the European Union (2006/C 168/01), June 20, 2006. Retrieved December 7, 2006, from: http://eur-lex.europa.eu/LexUriServ/site/es/oj/2006/c_168/c_16820060720es00010003.pdf
Coombs, P. (1973). ¿Hay que enseñar la educación no formal? Perspectivas, 3, 3, 331-333.
Dewey, J. (1995). Democracia y educación (L. Luzuriaga, Trans.). Madrid: Morata. (Original work published 1916).
Doll, J., Prenzel M. & Duit, R. (August, 2003). Improving math and science instruction-The Program “Quality of Schools” (BiQua) sponsored by the German Science Foundation. Paper presented at 4th Conference of the European Science Education Research Association (ESERA): Research and the Quality of Science Education, Noordwijkerhout, Netherlands.
Driver, R., Guesne, E. & Tiberghien, A. (1989). Ideas científicas en la infancia y en la adolescencia (P. Manzano, Trans.). Madrid: Morata-Ministerio de Educación y Ciencia. (Original work published 1985).
Duit, R. (Comp.). (2006). Bibliography-STCSE. Students' and teachers' conceptions and science education. Kiel, Alemania: IPN-Leibniz Institut für die Pãdagogik der Naturwissenschaften. Retrieved June 20, 2006, from: http://ipn.uni-kiel.de/aktuell/stcse/stcse.html
Eagly, A. H. & Chaiken, S. (1993). The psychology of attitudes. Forth Worth, TX: Harcourt Brace College Publishers.
Errington, S. Stocklmayer, S. & Honeyman, B. (Eds.). (2001). Using museums to popularise science and technology. London: Commonwealth Secretariat.
Falk, J. H. (2002). The contribution of free-choice learning to public understanding of science. Interciencia, 27, 62-65.
Farenga, S. J., & Joyce, B. A. (2000). Intentions of young students to enrol in science courses in the future: an examination of gender differences. Science Education, 83, 55-75.
Fensham, P. J. (2004). Beyond knowledge: Other outcome qualities for science education. In R. M. Janiuk & E. Samonek-Miciuk (Eds.), 11th Symposium Proceedings (pp. 23-25). Lublin, Poland: International Organization for Science and Technology Education.
Gerber, B. L., Cavallo, A. M. L. & Marek, E. A. (2001). Relationships among informal environments, teaching procedures and scientific reasoning ability. International Journal of Science Education, 23 (5), 535-549.
Greenfield, T. A. (1996). Gender ethnicity, science achievement, and attitudes, Journal of Research in Science Teaching, 33, 901-934.
Griffin, J. (1998). Learning science through practical experiences in museums. International Journal of Science Education, 20 (6), 655-663.
Hierrezuelo, J. & Montero, A. (1988). La ciencia de los alumnos. Barcelona: Laia- Ministerio de Educación y Ciencia.
Jiménez, M. P. & Álvarez, M. (1992). Género, ciencia y tecnología. In M. Moreno (Ed.), Del silencio a la palabra (pp. 178-196). Madrid: Instituto de la Mujer.
Jones, L. S. (1997). Opening doors with informal science: exposure and access for our undeserved students. Science Education, 81 (6), 663-677.
Keller, E. F. (1985). Reflections on gender and science. New Haven, CT: Yale University Press.
Lucas, A. M. (1991). ‘Info-attainment’ and informal sources for learning science. International Journal of Science Education, 13 (5), 495-504.
Lucas, A. M., MacManus, P. M. & Thomas, G. (1986). Investigating learning from informal sources: listening to conversations and observing play in science. European Journal of Science Education, 8 (4), 341-352.
Manassero, M. A. & Vázquez, A. (2001). Análisis empírico de dos escalas de motivación escolar. Revista Española de Motivación y Emoción, 2, 37-58.
Martin, L. M. W. (2004). An emerging research framework for studying informal learning and schools. Science Education, 88, 71-82.
McCormick, T. (1994). Creating the non-sexist classroom. New York: Teachers College Press.
Medved, M. I. & Oatley, K. (2000). Memories and scientific literacy: remembering exhibits from a science centre. International Journal of Science Education, 22 (10), 1117-1132.
Millar R. (1989). Constructive criticism. International Journal of Science Education, 11, 587-596.
Millar, R. & Osborne, J. (1998). Beyond 2000: Science education for the future. London: School of Education, King’s College.
National Science Foundation (2006). Informal science education. Supplements to active research awards. Retrieved September 4, 2006, from: http://www.nsf.gov/pubs/1997/nsf9770/isesupl.htm
Oliva, J. M., Matos, J., Bueno, E., Bonat, M., Domínguez, J., Vázquez, A. & Acevedo, J. A. (2004). Las exposiciones científicas escolares y su contribución en el ámbito afectivo de los alumnos participantes. Enseñanza de las Ciencias, 22 (3), 435-440.
Parque de las Ciencias. (1999). Comunicar la ciencia en el siglo XXI. I Congreso sobre Comunicación Social de la Ciencia. Granada, Spain: Author.
Pérez Gómez, A. I. (1993). La función social y educativa de la escuela obligatoria. Signos. Teoría y Práctica de la Educación, 8/9, 16-27.
Pozo, J. I., Sanz, A., Gómez, M. A., & Limón, M. (1991). Las ideas de los alumnos sobre la ciencia: una interpretación desde la psicología cognitiva. Enseñanza de las Ciencias, 9 (1), 83-94.
Preece, P. (1984). Intuitive science: learned or triggered? European Journal of Science Education, 6, 7-10.
Rahm, J. (2002). Emergent learning opportunities in an inner-city youth gardening program. Journal of Research in Science Teaching, 39, 164-184.
Reid, D. J. & Hodson, D. (1993). Ciencia para todos en secundaria. Madrid: Narcea.
Rennie, L. J., Feher, E., Dierking, L. D. & Falk, J. H. (2003). Toward an agenda for advancing research on science learning in out-of-school settings. Journal of Research in Science Teaching, 40, 112-120.
Rix, C. & McSorley, J. (1999). An investigation into the role that school-based interactive science centres may play in the education of primary-aged children. International Journal of Science Education, 21 (6), 577-593.
Rosser, S. V. (1997). Re-engineering female friendly science. New York: Teachers College Press.
Rubio Herráez, E. (1991). Desafiando los límites de sexo/género en las ciencias de la naturaleza. Madrid: Ministerio de Educación y Ciencia, Servicio de Publicaciones.
Russell, I. (1990). Visiting a science centre: what's on offer? Physics Education, 25, 258-262.
Sahuquillo, E., Jiménez, M. P., Domingo, F. & Álvarez, M. (1993). Un currículum de ciencias equilibrado desde la perspectiva de género. Enseñanza de las Ciencias, 11 (1), 51-58.
Sarramona, J. (Ed.). (1992). La educación no formal. Barcelona: CEAC.
Schibeci, R. (1989). Home, school, and peer group influences on student attitudes and achievement in science. Science Education, 73, 13-24.
Schibeci, R. A. & Riley, J. P. (1986). Influence of students’ background and perceptions on science attitudes and achievement. Journal of Research in Science Teaching, 23 (3), 177-187.
Schreiner, C. & Sjøberg, S. (2004). Sowing the seeds of ROSE. Background, rationale, questionnaire development and data collection for ROSE (The Relevance of Science Education)-a comparative study of students' views of science and science education (Acta didactica). Oslo, Norway: University of Oslo, Department of Teacher Education and School Development.
Semper, R.J. (1990). Science museums as environments for learning. Physics Today, 43, 2-8.
Sjøberg, S. (2000). Science and scientists. The SAS-study. Acta Didactica, 1, 1-73.
Sjøberg, S. e Imsen, G. (1987). Gender and science education I. In P. Fensham (Ed.), Development and dilemmas in science education (pp. 218-248). London: The Falmer Press.
Smail, B. (1991). Como interesar a las chicas en las ciencias de la naturaleza. Madrid: Ministerio de Educación y Ciencia, Servicio de Publicaciones.
Stevenson, J. (1991). The long-term impact of interactive exhibits. International Journal of Science Education, 13 (5), 521-531.
Tamir, P. (1990). Factors associated with the relationship between formal, informal, and nonformal science learning. Journal of Environmental Education, 22 (1), 34-42.
Toharia, M. (Coord.). (2003). La ciencia es cultura. II Congreso sobre Comunicación Social de la Ciencia. Valencia: Museo de las Ciencias Príncipe Felipe.
Tonucci, F. (July 1, 2004). Semanario Escuela, 3630, p. 7.
Tunnicliffe, S.D. & Moussouri, T. (2003). Methods for assessing out of school science learning experiences. Paper presented at 4th Conference of the European Science Education Research Association (ESERA): Research and the Quality of Science Education, Noordwijkerhout, Netherlands.
Vázquez, A. (1996). Actividades y preferencias relacionadas con la ciencia en estudiantes de secundaria. Revista de Ciència, 19, 107-115.
Vázquez, A., Acevedo, J. A. & Manassero, M. A. (2005). Más allá de una enseñanza de las ciencias para científicos: hacia una educación científica humanística. Revista Electrónica de Enseñanza de las Ciencias, 4 (2). Retrieved July 14, 2006, from: http://www.saum.uvigo.es/reec/volumenes/volumen4/ART5_Vol4_N2.pdf
Vázquez, A. & Manassero, M. A. (1998). Una propuesta de modelo integrado de aprendizaje como cambio conceptual, metodológico y actitudinal. In E. Banet & A. de Pro (Coords.), Investigación e innovación en la enseñanza de las ciencias (Vol. I, pp. 148-158). Murcia, España: DM.
Vázquez, A. & Manassero, M. A. (2007). En defensa de las actitudes y emociones en la educación científica (I): evidencias y argumentos generales. Revista Eureka sobre Enseñanza y Divulgación de las Ciencias, 4(2), 247-271. Retrieved April 18, 2007, from:
http://www.apac-eureka.org/revista/Volumen4/Numero_4_2/Vazquez_Manassero_2007.pdf
Watts, M. & Alsop, S. (2000). The affective dimensions of learning science. International Journal of Science Education, 22 (2), 1219-1220.
Wellington, J. (1991), Newspaper science, school science: friends or enemies? International Journal of Science Education, 13 (4), 363-372.
Whyte, J. Kelly, A. & Smail, B. (1987). Girls into science and technology: Final report in Science for Girls. London: Open University Press.
Willis, S. (1996). Gender justice and the mathematics curriculum: Four perspectives. In L. H. Parker, L. J. Rennie, & B. J. Fraser (Eds.), Gender, science, and mathematics: Shortening the shadow (pp. 41-52). Dordrecht, Netherlands: Kluwer Academic Publishers.
Translator: Jeanne Eileen Soennichsen
1 ROSE is an international project in which approximately 40 countries participate. ROSE is organized by Svein Sjøberg and Camilla Schreiner at the University of Oslo and financed by the Research Council of Norway. Information and other details can be consulted at:
http://www.ils.uio.no/english/rose
Vázquez, Á. & Manassero, M. A. (2007).Out-of-school activities related to science and technology. Revista Electrónica de Investigación Educativa, 9 (1). Retrieved month day, year, from: http://redie.ens.uabc.mx/vol9no1/contents-vazquez3.html