SYSTEMATIC REVIEW article

A study of the impact of project-based learning on student learning effects: a meta-analysis study.

Lu Zhang\n

  • 1 Institute of Computer and Information Science, Chongqing Normal University, Chongqing, China
  • 2 Institute of Smart Education, Chongqing Normal University, Chongqing, China

Introduction: With the educational reform for skills in the 21st century, a large number of scholars have explored project-based learning. However, whether project-based learning can effectively improve the learning effect of students has not yet reached a unified conclusion.

Method: This study uses a meta-analysis method to transform 66 experimental or quasi-experimental research papers based on project-based learning over the past 20 years into 190 effect values from the sample size, mean, and standard deviation of experimental data during their experiments, and to conduct in-depth quantitative analysis.

Results: The results of the study showed that compared with the traditional teaching model, project-based learning significantly improved students’ learning outcomes and positively contributed to academic achievement, affective attitudes, and thinking skills, especially academic achievement.

Discussion: The results of the moderating effects test indicated that the effectiveness of project-based learning and teaching was influenced by different moderating variables, including country region, subject area, type of course, academic period, group size, class size, and experimental period : (1) from the perspective of country geography, the effects of project-based learning in Asia, especially in Southeast Asia, were significantly better than those in Western Europe and North America; (2) in terms of curriculum, project-based learning promotes student learning effects more significantly in engineering and technology subjects, and is better applied in laboratory classes than in theory classes; (3) from a pedagogical point of view, project-based learning is more suitable for small group teaching, in which the group size is 4-5 people teaching the best results; (4) in view of the experimental period, 9-18 weeks is more appropriate and has more obvious advantages for application at the high school level.

1. Introduction

Project-based learning (PBL) is a new model of inquiry-based learning that is centered on the concepts and principles of a subject, with the help of multiple resources and continuous inquiry-based learning activities in the real world, with the aim of producing a complete project work and solving multiple interrelated problems within a certain period of time ( Jingfu and Zhixian, 2002 ). s a new student-centered teaching approach, project-based learning directly points to the goal of cultivating 21st-century skills, especially higher-order thinking skills, and higher-order thinking occurs based on problem-solving, a challenging problem that emphasizes real-world situations and open environments, and project-based learning motivates students to continuously explore in the process of problem-solving, thus promoting the development of higher-order thinking.

In the era of digital transformation of education, the new generation of information technologies such as artificial intelligence, big data, and metaverse are bringing great changes to education at an unimaginable speed, and at the same time posing unprecedented challenges to talent training. Cultivating students with higher-order thinking skills that can adapt to the future development of society and reasonably cope with the complex real world has become an important mission in the current education reform and development around the world ( Ma and Yang, 2021 ). Different types of problems produce different teaching methods and also guide the development of students’ different thinking skills. Project-based learning, as a new type of teaching and learning method in the context of curriculum and teaching reform, takes real life as the background, is driven by practical problems, breaks the disciplinary boundaries, integrates multiple disciplines into one project, and develops students’ future-oriented abilities——creative thinking, problem raising, problem solving, critical thinking, communication and collaboration, etc. The advantages of this approach over traditional teaching and learning models are being recognized and explored. A large number of studies on the effects of project-based learning have been done, but there is not complete agreement on the effects on the development of students’ thinking skills, academic performance, and affective attitudes.

Over the past few decades, project-based learning has received a lot of attention in the field of education. Many studies have shown that project-based learning can improve students’ learning motivation, problem-solving skills, teamwork, and communication skills. However, due to the complexity and diversity of project-based learning, as well as differences in research methods, research findings on its effectiveness and influencing factors vary. A key research question in project-based learning meta-analytic studies is to assess the impact of project-based learning on student learning outcomes, including student performance in the areas of academic achievement, thinking skills, and affective attitudes. By combining the results of multiple independent studies, more accurate and reliable conclusions can be obtained to further understand the effects of project-based learning. In addition, project-based learning meta-analysis studies can help reveal the factors and mechanisms influencing project-based learning. By comparing the learning effects under different project-based learning conditions, researchers can analyze the impact of factors such as project characteristics, instructional design, and learning environment on student learning. This can help guide the design and implementation of project-based learning and promote effective student learning. Based on this, this study compensates for the limitations of individual studies by integrating and synthesizing multiple independent studies in order to systematically assess the effects of project-based learning, provide more accurate and reliable evidence, and reduce the chance of research findings. At the same time, project-based learning meta-analysis can provide a broader perspective to help researchers and educational policy makers gain a comprehensive understanding of the effects and influencing factors of project-based learning, so that they can develop more effective teaching strategies and policies to promote the improvement and development of project-based learning.

2. Literature review and theoretical framework

One view is that project-based learning can significantly improve student learning outcomes, including academic achievement, motivation, and higher-order thinking skills. Karpudewan et al. (2016) explored the feasibility of improving energy literacy among secondary school students using a project-based instructional approach. The quantitative results of the study showed that students exposed to a PBL curriculum had better performance on energy-related knowledge, attitudes, behaviors, and beliefs. The quantitative results of the study showed that students exposed to the PBL curriculum outperformed students taught using the traditional curriculum. The quantitative results of the study showed that students exposed to the PBL course outperformed students taught with traditional courses in terms of energy-related knowledge, attitudes, behaviors, and beliefs. The results of Zhang Ying’s intrinsic motivation scale, which was administered to 21 private university students before and after they received project-based learning, showed that there were significant differences in students’ interest, autonomy, and competence before and after, which positively influenced students’ intrinsic motivation to learn ( Zhang, 2022 ). Yun (2022) used the fifth-grade project “Searching for Roots. Xu Hui Yuan” project-based learning as an example to discuss that project-based in-depth ritual education can develop students’ core literacy. Biazus and Mahtari (2022) conducted a quasi-experiment using project-based learning and direct instructional learning models and found that the PBL model had a significant impact on the enhancement of creative thinking skills of secondary school students. Parrado-Martínez and Sánchez-Andújar (2020) explored the effects of project-based learning on ninth-grade students’ writing skills and found that cooperative work in project-based learning potentially promoted students’ critical thinking, communication, and collaboration skills, significantly improving middle school students’ English writing skills. Hernández-Ramos and De La Paz (2009) found that students in project-based learning conditions showed significant improvements in content knowledge measures and growth in their historical thinking skills compared to students in control schools. Most researchers agree that STEM as a form of project-based learning and STEM integration will have a positive impact on education, with the advantages outweighing the disadvantages ( Hamad et al., 2022 ; Wardat et al., 2022 ).

Another view is that project-based learning has the same effect or even some negative effects compared to traditional instruction. García-Rodríguez et al. (2021) conducted an intervention experiment in undergraduate education to test the effectiveness of a student-centered project-based learning approach in promoting student skill acquisition. The study found that students’ problem-solving and information management skills, two instrumental general competencies were not improved. The results of ÇAKICI’s project-based learning activities on fifth-grade children’s science achievement showed that although project-based activities significantly improved children’s science achievement, attitudes toward science did not change. Gratchev and Jeng (2018) explored whether the combination of traditional teaching methods and project-based learning activities improved students’ learning experiences, and data collected over 3 years showed that the two groups’ achievements were very similar, and the findings indicated that students were less motivated to accept new learning methods such as PBL. Parrado-Martínez and Sánchez-Andújar (2020) found that the implementation of PBL did not significantly change students’ perceived utility of teamwork, communication, and creativity. Kızkapan and Bektaş (2017) examined the effects of project-based learning and traditional learning methods on the academic performance of seventh graders, and the results showed no significant differences between the experimental and control groups on post-test “achievement test” scores. Sivia et al. (2019) used a mixed triangulation-convergence approach to examine the difference in student engagement between project-based and non-project-based learning units and found that project-based learning did not significantly increase student engagement. Karaçalli and Korur (2014) used a quasi-experimental design to teach the experimental group using a project-based learning approach, and the results showed no statistically significant effect on students’ attitudes toward learning across groups.

In summary, a review of the literature reveals that the research findings and teaching effectiveness of project-based learning have not yet been uniformly determined, and few studies have systematically analyzed and evaluated the optimal group size, class size, curriculum type, and subject area of project-based learning. Therefore, based on 66 empirical research papers that conducted experimental or quasi-experimental studies on project-based learning and traditional teaching, this study quantifies the true magnitude of the impact of the project-based learning approach on students’ learning outcomes and seeks to summarize the experience of applying project-based learning in schools in order to provide a reference for developing project-based teaching. And an attempt is made to answer the following research questions:

1. Does project-based learning significantly improve students’ thinking skills, academic performance, and affective attitudes compared to traditional teaching methods?

2. How do different moderating variables (type of course, learning section, group size, class size, subject category, experiment period, country region.) affect students’ learning effects?

Since the purpose of this study was to explore the effect of project-based learning on learning effectiveness and to explore other factors that may moderate this effect. Therefore, based on relevant research findings on the effect of project-based integrated learning on learning effectiveness and the results of literature coding, the meta-analytic theoretical framework for this study, as shown in Figure 1 .

www.frontiersin.org

Figure 1 . Research framework diagram.

3. Study design

3.1. methods.

Meta-Analysis is a quantitative analysis method that extracts and organizes multiple results of experimental or quasi-experimental studies on the same research question and then produces an average effect value by weighting the sample size, standard mean deviation, and other data from the existing research results and analyzes the effect value to obtain the results. The meta-analysis method has been widely used in education. This study compares and combines literature on the same research topic but with different research results by extracting data such as pre and post-test means, sample sizes, and standardized mean differences from relevant literature, while using the standard deviation (SMD), which can correct for small sample bias, as the effective value to indicate the degree of influence of project-based instruction on student learning outcomes. The study entered the relevant data into CMA meta-analysis software (Comprehensive Meta Analysis 3.0) for data analysis.

3.2. Research process

To ensure the quality of the study, this study strictly followed the meta-analysis criteria proposed by Glass (1976) , which was mainly divided into four assessment procedures: literature collection, literature coding, effect size calculation, and moderating variable analysis, and finally a comprehensive effect size exploration and study results.

3.2.1. Literature search

To ensure the timeliness of the study, this study mainly searched the relevant research on the topic of project-based learning since 2003 to 2023, mainly in CNKI, Springer Link, Web of Science, Semantic Scholar and other databases, and searched the literature by “AND” or “OR” logical word collocation of project-based learning and learning effectiveness keywords. The keywords of project-based learning include: project-based learning, PBL, project teaching; the keywords of learning effect include: learning effect, learning performance, learning achievement, learning*, learning outcome, learning result, etc. And the selected articles are all from SSCI or SCI authoritative journals, Chinese core journals of article literature type and part of the master’s degree thesis. To avoid omissions, this study also supplemented the search with the references of relevant articles.

3.2.2. Literature selection and inclusion criteria

To find articles that meet the subject matter requirements, this study used the ( Page, 2021 ) process for literature processing ( Vrabel, 2009 ), the literature search, screening, and inclusion process is shown in Figure 2 . Combining the needs of the meta-analysis method itself and ensuring the accuracy and rigor of the research results, the following selection and inclusion criteria were used: (1) duplicate literature had to be removed; (2) it had to be a study of the effects of project-based learning versus traditional teaching models on learning effectiveness; (3) it had to be an empirical research type article; (4) complete data that could calculate the effect values had to be available. A total of 91 articles were screened by two researchers in the inclusion phase, and those with inconsistent screening were discussed, and the final decision was made to include 66 articles in the meta-analysis, which met the inclusion criteria for the number of articles in the meta-analysis method.

www.frontiersin.org

Figure 2 . Flow chart of literature screening.

3.2.3. Literature code

The concept of project-based learning was first introduced by American educator William Heard Kilpatrick proposed ( Kilpatrick, 1918 ). In the 1920s and 1930s, project-based learning was widely used in the lower grades of elementary and secondary schools in the United States; in 1969, McMaster University in Canada officially launched the PBL teaching model within the school. To compare the variability of the effects of project-based learning in countries around the world, the regions of the countries where the study was conducted were coded and divided into North America, Oceania, Southeast Asia, and other regions. As project-based learning is used more frequently in the classroom, whether there is an ideal group size to facilitate student learning outcomes ( Wei et al., 2020 ), and the impact of group size on academic achievement ( Al Mulhim and Eldokhny, 2020 ), which academic section, subject, and course type is better taught, are questions that should be addressed. Therefore, the coding of this study included the following seven main items: subject category, course type, country region, academic section, class size, group size, and experimental period, and categorized learning outcomes into three main categories: academic achievement, thinking skills, and emotional attitudes. Because this study included 66 documents with 190 effect sizes, only part of the feature coding content is displayed, as shown in Table 1 ( Kelly and Mayer, 2004 ; Mioduser and Betzer, 2007 ; Hernández-Ramos and De La Paz, 2009 ; Domínguez and Elizondo, 2010 ; Keleşoğlu, 2011 ; Çakici and Türkmen, 2013 ; Karaçalli and Korur, 2014 ; Bilgin et al., 2015 ; Astawa et al., 2017 ; Kızkapan and Bektaş, 2017 ; ShiXuan, 2017 ; Yuan, 2017 ; Praba et al., 2018 ; Yexin, 2019 ; Faqing, 2020 ; Gao, 2020 ; Lei, 2020 ; Ling, 2020 ; Linxiao, 2020 ; Lu, 2020 ; Luo, 2020 ; Mingquan, 2020 ; Rui, 2020 ; Yanan, 2020 ; Yang, 2020 ; Akharraz, 2021 ; Cong, 2021 ; Migdad et al., 2021 ; Xiaolei, 2021 ; Wang, 2021a , b , 2022 ; Jina, 2022 ; Ma, 2022 ; Xu, 2022 ; Xuezhi, 2022 ; Yating, 2022 ; Ying, 2022 ; Yuting, 2022 ; Zhang, 2022 ). To ensure the objectivity of the coding process, this study was completed independently by two researchers for the 66 empirical research articles included in the meta-analysis, and the coding results were tested for consistency using SPSS 24.0, and the Kappa value was 0.864, which was greater than 0.7, indicating that the coding effect was valid and the results were credible.

www.frontiersin.org

Table 1 . Code list (due to space limitation, only part of the coding content is shown).

3.2.4. Data analysis

Based on the completion of the literature coding, the calculation of the effect size (Standardized difference in means), including sample size, standard deviation, and mean value, was performed by finding the relevant experimental data in the literature. The effect size values were calculated as follows:

Starting with Mean, SD, N in each group.

Raw difference in means.

RawDiff = Mean1-Mean2.

SDP = Sqr (((N1–1) * SD1^2 + (N2-1) * SD2^2)/(N1 + N2–2))).

Standardized difference in means.

StdDiff = RawDiff/SDP.

The next stage was data analysis by (1) publication bias test. A funnel plot was used for qualitative analysis, while a combination of Begg’s rank test and loss of safety coefficient was used for quantitative analysis; (2) Heterogeneity test. The aim was to determine whether there was heterogeneity among the samples in this study; (3) Calculation of effect size values. To quantify the degree of influence of project chemistry learning on learning outcomes; (4) the moderating variables were tested. All data analyses in this study were conducted using Comprehensive Meta Analysis 3.0.

4.1. General effect size results

4.1.1. publication bias test.

In this study, the std. diff in means (SMD) value was selected as the unbiased effect value, and also to ensure the possibility that the results reported in the literature do not deviate from the true results, the publication bias was analyzed qualitatively using funnel plots, and the publication bias was analyzed qualitatively using Begg’s rank test, Trim and Fill and Fail-safe N to quantitatively analyze publication bias. Publication bias is critical to the results of meta-analysis, and if the research literature is not systematically representative of all existing research in the field in general, it indicates that publication bias may exist ( Higgins and Thompson, 2002 ). As shown in Figure 3 , the majority of study effect values were clustered within the funnel plot, and a small number of effect values were relative to the right, with Begg’s rank test Z  = 5.082 > 1.960 ( p  < 0.05), indicating a possible publication bias. Therefore, the severity of publication bias was further identified using the loss of safety factor, which showed N  = 2,546, much larger than “5K + 10” ( K  = 190), suggesting that an additional 2,546 unpublished studies would be required to reverse the results ( Rothstein et al., 2006 ), and it can be concluded that there is no significant publication bias in this study.

www.frontiersin.org

Figure 3 . Publication bias funnel plot.

4.1.2. Heterogeneity test

To ensure that the effect values of the independent samples in this study are combinable, Q and I2 values were used to define heterogeneity. Higgins et al. classified heterogeneity as low, medium, or high, as measured by the magnitude of the I2 statistic, which was 25, 50, and 75%, respectively. In addition, if the Q statistic is significant then the hypothesis that there is no heterogeneity among the sample data should be rejected. Based on the forest plot of I2 = 87.4% > 50% and Q  = 1496.2 ( p  < 0.001), the results indicate that there is a high degree of heterogeneity between the samples, therefore, this study used a random effects model for correlation analysis to eliminate some of the effects of heterogeneity, and also further indicates that it is necessary to conduct a moderated effects test to examine the effect of project-based learning on learning effects.

4.2. Results about problem of studies’ fields

4.2.1. the overall impact of project-based learning on student learning outcomes.

Cohen (1988) proposed the effect value analysis theory in 1988, he believed that the effect standard measure effect is determined by the effect value (ES), when the ES is less than 0.2, it means that there is a small effect impact, when the ES is between 0.2–0.8 means that there is a moderate effect, when the ES > 0.8 means that there is a significant effect impact. This study included 190 experimental data from 66 empirical research papers, and as shown in Table 2 , the combined effect value of the impact of project-based learning on student learning outcomes was 0.441, close to 0.5 and p  < 0.001, indicating that project-based learning has a large degree of impact on learning outcomes and is an effective teaching approach.

www.frontiersin.org

Table 2 . Main effects test.

In this study, the literature included in the meta-analysis was divided into three subcategories of academic achievement, thinking skills, and emotional attitudes according to the “three-dimensional goals” for analysis. Moderately positive impact (SMD = 0.650), and the total effect values for affective attitudes and thinking skills were 0.389 and 0.386, respectively.

Based on the deeper connotation of “three-dimensional goals,” this study classifies affective attitudes into learning motivation, learning attitude, learning interest, and self-efficacy; thinking skills into creative thinking ability, computational thinking ability, decision-making ability, critical thinking ability, problem-solving ability, problem raising ability, collaboration ability, and comprehensive application ability. As shown in Table 3 . In terms of affective attitudes, project-based learning influenced more on students’ interest in learning (SMD = 0.713), and also had moderate positive effects on learning motivation (SMD = 0.401) and learning attitudes (SMD = 0.536), with lower effects on self-efficacy; in terms of thinking skills, project-based learning had the most significant effects on students’ creative thinking skills (SMD = 0.626) and computational thinking skills (SMD = 0.719) had the most significant effect, followed by problem solving, collaboration, and general application skills, but the effects on decision making, critical thinking, and problem raising skills did not reach a statistically significant level.

www.frontiersin.org

Table 3 . Effects of project-based learning on different learning outcomes.

4.2.2. Examining the effects of different moderating variables on student learning

First, in terms of country region as a moderating variable, the overall effect value of its moderating effect on learning effectiveness was 0.358 and p  < 0.001, indicating a moderate effect and the effects varied across countries. In terms of effect values between groups, although project-based learning originated in the United States and was first applied in American countries such as Canada, its effect on student learning outcomes was not significant (SMD = 0.061, p  = 0.429 > 0.05), and there was no significant difference in whether or not project-based learning was used; instead, the application of project-based learning produced better learning outcomes in Asian countries, especially in Southeast Asian countries (SMD = 0.684), followed by West Asia (SMD = 0.594).

Second, looking at the school level as the moderating variable, the overall effect value SMD = 0.355, in order of effect value from smallest to largest, is university (SMD = 0.116) < junior high school (SMD = 0.520) < primary school (SMD = 0.527) < high school (SMD = 0.720), which indicates that there are differences in the effects of project-based learning on the learning outcomes of students in different school levels, with the effects on high school, primary school, and junior high school, while the effect on college was relatively small.

Third, using group size as the moderating variable, the combined effect value of group size on learning effectiveness is 0.592 ( p  < 0.001), which is close to 0.6, indicating that the effect of group size on students’ learning effectiveness is more significant and has a moderate to a high degree of facilitating effect. In terms of the effect values of different sizes, the effect values are all positive, indicating that the group learning style is effective and has different degrees of facilitating effects on learning effects, with the most significant facilitating effect of a group size of 4–5 students on learning effects (SMD = 0.909).

Fourth, to test the applicability of project-based learning on different class sizes, the class sizes were divided into three sizes according to the sample size: small (1 ~ 100 students), medium (100 ~ 200 students), and large (200 ~ 300 students), and the data in Table 4 show that the overall effect value of the moderating effect of class size on the learning effect is 0.378, p  < 0.001, indicating that project-based learning on different class size. Looking specifically at each size, the degree of impact was higher for small class sizes (SMD = 0.483), followed by medium size (SMD = 0.466), but lower and not significant for large class sizes (SMD = 0.106, p  = 0.101 < 0.05).

www.frontiersin.org

Table 4 . Results of moderating effects of different moderating variables.

Fifth, when subject categories were viewed as moderating variables, all subject effect values were larger than 0, with a combined effect value of SMD = 0.443 ( p  < 0.001), suggesting that project-based learning had a positive degree of enhancement on learning effectiveness across subjects, reaching a statistically significant difference. Due to the relatively small amount of literature in other categories and life sciences, this study focuses on the effects of project-based learning on learning outcomes in engineering and technology, humanities and social, and natural sciences. In each of the subjects, Engineering and Technology (SMD = 0.619) > Natural Sciences (SMD = 0.484) > Humanities and Society (SMD = 0.284), the results indicate that project-based learning has the most significant impact on learning effectiveness in Engineering and Technology and relatively less in Humanities and Society.

Sixth, the overall effect value SMD = 0.441 when looking at the type of course as a moderating variable, while the between-group effect test between experimental and theoretical classes reached a statistically significant level ( p  < 0.001). The effect of project-based learning on student learning outcomes was more pronounced in experimental classes (SMD = 0.498), which was greater than the overall combined effect value, consistent with the finding that project-based learning is more suitable and effective teaching strategy for engineering and technology disciplines, while the use of project-based teaching in theory classes (SMD = 0.393) was below the average effect value.

Seventh, in terms of the experimental period as a moderating variable, there were significant differences in project-based learning across experimental periods ( p  < 0.001), with a moderating overall effect value of SMD = 0.424. The best effect of instructional facilitation was observed for the duration of 9–18 weeks (SMD = 0.673), which was better than single experiments (SMD = 0.359) and 1–8 weeks (SMD = 0.498), with a relatively weak effect on learning outcomes beyond 18 weeks (SMD = 0.3000).

5. Discussion

This study used meta-analysis to systematically review and quantitatively analyze 66 experimental or quasi-experimental research papers published between 2003 and 2023 on the effects of project-based instruction on student learning, and to dissect the differences brought about by different moderating variables. The results show that: ① project-based learning can significantly improve students’ learning outcomes compared with traditional teaching models; ② the effects of project-based teaching and learning are influenced by different moderating variables, including subject area, course type, academic period, group size, class size, and experiment period. The results derived from the meta-analysis are further discussed and analyzed below.

5.1. Project-based learning has a positive effect on student learning outcomes

First, the combined effect value of SMD = 0.441 ( p  < 0.001) for the effect of project-based learning on learning outcomes indicates that compared to the traditional teaching model, project-based teaching has a moderately positive contribution to students’ academic achievement, thinking skills, and affective attitudes, which is consistent with the results of previous studies ( Wenlan and Jiao, 2019 ). This is consistent with previous studies. Compared with the traditional “teacher teach-student receive-evaluate and feedback” model, project-based learning is closer to a “complete learning process” ( Changming, 2020 ). It is a student-centered learning activity in which students show richer affective attitudes such as interest in learning and attitudes toward learning, which can positively guide students’ motivation to learn and influence their academic performance, and is naturally more effective in developing students’ emotional attitudes and values, and thinking skills.

Second, project-based learning has a significant positive effect on students’ thinking skills (SMD = 0.387, p  < 0.001) and affective attitudes (SMD = 0.379, p  < 0.001), indicating that the effect of project-based learning on students’ learning outcomes is not only the effect of academic performance, but also the effect of self-emotional attitudes and values, creative thinking skills, computational thinking skills, and other higher-order The impact of project-based learning on students’ learning is not only on their academic performance, but also on their self-emotional attitudes and values, creative thinking skills, computational thinking skills and other higher-order thinking skills. Project-based learning is a classroom activity that effectively develops students’ core literacies ( Hongxing, 2017 ) and promotes the development of higher-order thinking ( Weihong and Yinglong, 2019 ). The real value of project-based learning lies in its ability to enhance students’ higher-order thinking skills, such as creative thinking skills, problem-solving skills, and integrated application skills, by exploring real problems in small groups as a way to acquire the core concepts and principles of subject knowledge, and by posing driving questions around a topic based on real situations and students’ deep involvement in the investigation. Education for the future requires project-based learning to develop students’ 21st century skills and core literacies for their future careers and lives.

5.2. Moderating effects of different variables on student learning outcomes

To better analyze the impact brought by different moderating variables, this study categorized the moderating variables into four major categories: first, country region; second, curriculum, including subject categories and course types; third, teaching, including experimental period and learning periods; and fourth, experimental scale, including class size and group size. The results of the meta-analysis show as follows: (1) the application effect of project-based learning in Asia is better than that in countries in Oceania and Western Europe; (2) project-based learning has different degrees of influence on different disciplines and is better applied in the type of laboratory course; (3) in terms of the experimental period, the experimental period of 9–18 weeks is more appropriate and the application advantage of project-based learning at the high school level is more obvious; (4) project-based learning is more suitable for small-class teaching, in which the best effect is achieved when the group size is 4–5 students.

In terms of country region, the combined effect value of project-based learning is 0.358, and the application effect varies in different countries. In the Asian region, especially Southeast Asia, the effect of project-based learning is significantly better than that of Western Europe and North America. This study suggests the following reasons: First, Southeast Asian countries are relatively lagging in economic development, and industrialization and modernization are slower, so students and teachers pay more attention to practical learning methods, and project-based learning is a practice-based, problem-solving-oriented learning method that can better help them adapt and master skills and knowledge in actual work. Secondly, because the level of basic education in some Southeast Asian countries is relatively low due to various factors such as history, culture, and society, the project-based learning method can help students understand practical problems more deeply, comprehend knowledge, and enhance their hands-on and problem-solving abilities. Third, in Western European countries, students and teachers focus more on theoretical knowledge and logical thinking, individual student performance, and competition, and in countries such as Oceania, students and teachers focus more on practicality and teamwork. In Asia, however, the educational culture emphasizes a focus on discipline, order, and respect for teachers, making project-based learning more acceptable to students and parents. Students’ attitudes toward learning are also generally more serious, hard-working, and diligent, focusing on academic performance and opportunities for advancement, so students are more willing to engage in project-based learning in the hope of achieving better learning outcomes. Fourthly, in Asia, especially in East Asia, there is a strong demand for high-quality human resources, and project-based learning can cultivate students’ practical skills and innovative spirit, making them more competitive and capable of adapting to the future society.

In terms of curriculum, the combined effects of project-based learning on different subject areas and different course types were approximately equal, at 0.443 and 0.441, respectively, and the effect on student learning in engineering and technology disciplines was more significant (SMD = 0.619) and larger than the average effect, which is consistent with previous research findings that PBL is more appropriate for teaching in engineering ( Kolmos and De Graaff, 2014 ). Facing the rapidly developing society, the traditional teaching methods seem to be unable to better develop students’ skills to meet the market demand, and the research results also show that the application effect of PBL in experimental classes (SMD = 0.498) is better than that in theoretical classes (SMD = 0.393), because PBL can give students a complete understanding of the process of a project from problem raising to problem-solving, which provides them with valuable practical experience.

From the instructional aspect, the experimental period of 9–18 weeks (SMD = 0.673) had the greatest impact on student learning effects, and the impact of project-based learning for more than 18 weeks (SMD = 0.359) was relatively low, while the results of the study showed that project-based learning had a greater impact at the high school level (SMD = 0.720), followed by elementary school, middle school, and university, a finding that supports the results of Mehmet’s study ( Ayaz and Soeylemez, 2015 ). The moderating effect of the experimental period showed that the longer the experiment, the better the effect of about half a semester, and the project-based learning did not have a lasting and stable effect on students’ learning outcomes. Currently project-based learning is carried out more often at the primary and secondary school levels, and the teaching effect is more significant, but the application effect in universities is relatively low (SMD = 0.116), and the results of the study also indicate that the application promotion effect is most obvious in engineering and technology disciplines, so in the follow-up study, the application of project-based learning at the higher education level should be actively explored.

In terms of experimental scale, the effect of project-based learning on small class teaching (SMD = 0.483) is greater than that of medium class (SMD = 0.466) and large class (SMD = 0.106), and the teaching effect is better for group size of 4–5 people (SMD = 0.909), 8 people and above (SMD = 0.514), and 6–7 people (SMD = 0.436) in decreasing order. Therefore, project-based learning is more suitable for small-class teaching, and the number of people in the group collaborative learning is more conducive to the learning effect of around 4–5 people, which is almost consistent with the results of Wei et al. (2020) study on the effect of cooperative learning on learning effect. The relationship between class size and educational output has been discussed by a number of economists from the perspective of the economics of education, and is referred to as the “class size effect.” In small classes, teachers can spend more time on teaching and learning, each student can receive more attention from the teacher, and teachers and students can have more time to interact, thus having more opportunities to demonstrate and participate in collaborative group learning. In terms of group size, although there is no uniform standard, in general, too few or too many group members are not conducive to a higher degree of impact on the learning effect. From the research results, the best learning effect is produced by 4–5 students, with more reasonable task distribution among group members, all with a clear division of labor and sufficient interaction, which is more conducive to the formation of the group effect, thus better promoting the learning effect.

5.3. How does the impact of project-based learning on learning outcomes occur?

The results of the study show that project-based learning has a moderate positive contribution to learning effectiveness under different measurement measures dimensions, and how its effect occurs. The theoretical framework of the impact of project-based learning on learning effectiveness is drawn in conjunction with the specific processes and key features of project-based learning, as shown in Figure 4 , and will be analyzed in the following in conjunction with the theoretical framework.

www.frontiersin.org

Figure 4 . Theoretical framework for the impact of project-based learning on learning effects.

In terms of the specific process of project-based learning, it includes five steps: identifying project goals and scope, developing a project plan, implementing the project, monitoring project progress and solving problems, completing the project and presenting and evaluating it, and these steps include key activities that affect learning outcomes such as problem orientation, cooperative learning, and authenticity, which together affect students’ learning outcomes.

Specifically, project-based learning is usually oriented to real-life problems, requiring students to apply their knowledge and skills to solve problems, and the driving questions stimulate students’ interest in learning; it integrates the knowledge and skills of multiple disciplines, blending theoretical knowledge with practice and cultivating students’ creative thinking skills and comprehensive application skills; in the process of implementing projects, group members divide the work and cooperate to identify problems and After the project is completed and presented, the teacher gives timely feedback and evaluation to influence students’ attitude in project-based learning and improve the learning effect. In conclusion, the specific process and characteristics of project-based learning are the key factors to enhance students’ learning effect. Reasonable design of project characteristics and the application of different variables in project-based learning can effectively enhance students’ learning effect.

5.4. When is it more effective to use project-based learning?

The findings suggest that learning effects are influenced by different moderating variables, and this study suggests combining the effects of different variables for project-based learning in order to achieve the optimal effect size. For high school students in the field of engineering and technology subject areas of laboratory courses to 9–18 weeks as the experimental period, based on small class teaching, and group size of 4–5 people using the PBL method of teaching, to promote the improvement of student learning outcomes more effective. In experimental courses, the use of project-based learning can enable students to gain a deeper understanding of the principles and practical operations of experiments, increase their interest and motivation, and promote the development of their active learning and innovative thinking skills, thus improving learning outcomes. Small class teaching and group work can better meet students’ individual needs, enhance their sense of participation and belonging, and increase their interest and motivation in learning. Finally, the 9–18 weeks experimental cycle allows students to make the most of their time and explore the subject matter in depth, enabling them to gain deeper understanding and experience in their learning. It is hoped that the results of this study will provide a reference for front-line educators to carry out project-based teaching and explore more effective ways to promote learning outcomes.

6. Conclusion

This study conducted a meta-analysis of 66 empirical research papers on the use of project-based learning interventions for learning, and the findings provide evidence for the use of project-based learning in education to develop students’ core literacy and higher-order thinking skills, and 21st-century skills. The results show that: (1) project-based learning can significantly improve students’ learning outcomes compared with traditional teaching models; (2) the effects of project-based teaching are influenced by different moderating variables, including subject area, course type, academic period, group size, class size, and experiment period. From the perspective of countries and regions, the effect of project-based learning in Asia, especially in Southeast Asia, is significantly better than that in Western Europe and North America; from the perspective of courses, project-based learning has a more obvious effect on promoting students’ learning in engineering and technology disciplines, and the application effect in experimental classes is better than that in theory classes; from the perspective of teaching, project-based learning is more suitable for small-class teaching, in which the best effect is achieved with a group size of 4–5 students From the perspective of teaching, project-based learning is more suitable for small class teaching, and the best effect is achieved in group size of 4–5 students.

7. Limitation

Although our findings have important implications for educators, they still have some limitations. For example, some studies using project-based learning for teaching and learning lacked sufficient statistical information for inclusion in the analysis, and most of the studies did not provide a specific classification of learning effectiveness, limiting our ability to analyze learning effectiveness enhancement in more detail. Subsequent research can be carried out in depth in two aspects: (1) the current empirical studies on project-based learning focus on primary and secondary schools, with less research on the impact on universities and young children; with the popularity of higher education, future research can be conducted on the above research subjects; (2) taking the digital transformation of education as an opportunity to explore the integration of technology and project-based learning to better develop students’ core literacy and 21st century skills.

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Author contributions

YM: critically review the work, provide commentary, supervise and direct the writing of the draft. LZ: conceptualization, methodology, validation, quantitative data analysis, writing, review and editing. All authors contributed to the article and approved the submitted version.

This work was supported by the Chongqing graduate education teaching reform research project (No. yjg201009), the Postgraduate Research Innovation Project of Chongqing in 2023 (No. CYS23419, No. CYS23416), and the Special Project of Chongqing Normal University Institute of Smart Education in 2023 (No. YZH23013).

Acknowledgments

We would like to sincerely thank all the teachers and students of Computer and Information Science, Chongqing Normal University, for their support and contributions to us, especially for the support from the Smart Education Research Institute.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Akharraz, M. (2021). The impact of project-based learning on students’ cultural awareness .

Google Scholar

Al Mulhim, E., and Eldokhny, A. (2020). The impact of collaborative group size on students’ achievement and product quality in project-based learning environments. Int. J. Emerg. Technol. Learn. 15, 157–174. doi: 10.3991/ijet.v15i10.12913

CrossRef Full Text | Google Scholar

Astawa, N. L., Artini, L. P., and Nitiasih, P. K. (2017). Project-based learning activities and EFL students’ productive skills in English. J. Lang. Teach. Res. 8, 1147–1155. doi: 10.17507/jltr.0806.16

Ayaz, M., and Soeylemez, M. (2015). The effect of the project-based learning approach on the academic achievements of the students in science classes in Turkey: a meta-analysis study. EB 40, 255–283. doi: 10.15390/EB.2015.4000

Beier, M. E., Kim, M. H., Saterbak, A., Leautaud, V., Bishnoi, S., and Gilberto, J. M. (2019). The effect of authentic project-based learning on attitudes and career aspirations in STEM. J. Res. Sci. Teach. 56, 3–23. doi: 10.1002/tea.21465

Biazus, M., and Mahtari, S. (2022). The impact of project-based learning (PjBL) model on secondary students’ creative thinking skills. Int. J. Essential Competencies Educ. 1, 38–48. doi: 10.36312/ijece.v1i1.752

Bilgin, I., Karakuyu, Y., and Ay, Y. (2015). The effects of project based learning on undergraduate Students' achievement and self-efficacy beliefs towards science teaching. Eurasia J Math Sci. Technol. Educ. 11, 469–477. doi: 10.12973/eurasia.2014.1015a

Çakici, Y., and Türkmen, N. (2013). An investigation of the effect of project-based learning approach on Children's achievement and attitude in science. Online J. Sci. Technol. 3, 9–17.

Castro-Vargas, C., Cabana-Caceres, M., and Andrade-Arenas, L. (2020). Impact of project-based learning on networking and communications competences. Int. J. Adv. Comput. Sci. Appl. 11:2020. doi: 10.14569/IJACSA.2020.0110957

PubMed Abstract | CrossRef Full Text | Google Scholar

Changming, L. (2020). Why do we need project-based learning? Primary Secondary School Manage 08, 5–6.

Chung, S.J. (2021). Students’ perception of self-regulated learning in a project-based learning .

Cohen, J. (1988). Statistical power analysis for behavioral science. Technometrics 31, 499–500.

Cong, Li. (2021). Research on the design and implementation of project-based teaching of high school chemistry based on STSE education . [Master’s thesis]. China: Hunan Institute of Technology Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202201&filename=1021880452.nh

Domínguez, C., and Elizondo, A. J. (2010). Database design learning: A project-based approach organized through a course management system. Comput. Educ. 55, 1312–1320. doi: 10.1016/j.compedu.2010.06.001

Duman, B., and Yavuz, Ö. K. (2018). The effect of project-based learning on students’ attitude towards English classes. J. Educ. Train. Stud. 6:186. doi: 10.11114/jets.v6i11a.3816

Ergül, N. R., and Kargın, E. K. (2014). The effect of project based learning on students’ science success. Procedia. Soc. Behav. Sci. 136, 537–541. doi: 10.1016/j.sbspro.2014.05.371

Faqing. (2020). Research on the impact of project-based learning STEM curriculum on elementary school students’ problem solving ability [Master’s thesis]. China: Huazhong Normal University. Available at: https://kns.cnki.net/kcms2/article/abstract?v=s1YNj1Y_QLPkngH9X91x7Fs23_bcTKtQ_HV8_ZRG-u1wLLGRrl6pB21f7OyV3756xBZmpbJQSOsehywyktxXqDM37fhvBhTkVIdtKvLX5mrirj4EiSiDZyCFW4nENRtZYbN0hR_pNI0=\u0026amp;uniplatform=NZKPT\u0026amp;language=CHS

Gao, Yan-jun. (2020). Research on the teaching model of high school biology unit based on project-based learning (Master’s thesis, Southwest University. Availabe at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202101&filename=1021533870.nh

García-Rodríguez, F. J., Ruiz-Rosa, I., and Gutiérrez-Tao, D. (2021). Project-based learning as a tool to foster entrepreneurial competences (el aprendizaje basado en proyectos como herramienta para potenciar la competencia emprendedora). Cult. Educ. 33, 316–344. doi: 10.1080/11356405.2021.1904657

Glass, G. (1976). Primary, secondary, and metaanalysis of research. Educ. Res. 5, 3–5. doi: 10.3102/0013189X005010003

Gratchev, I., and Jeng, D. S. (2018). Introducing a project-based assignment in a traditionally taught engineering course. Eur. J. Eng. Educ. 43, 788–799. doi: 10.1080/03043797.2018.1441264

Hamad, S., Tairab, H., Wardat, Y., Rabbani, L., AlArabi, K., Yousif, M., et al. (2022). Understanding science teachers’ implementations of integrated STEM: teacher perceptions and practice. Sustainability 14:3594. doi: 10.3390/su14063594

Hernández-Ramos, P. F., and De La Paz, S. (2009). Learning history in middle school by designing multimedia in a project-based learning experience. J. Res. Technol. Educ. 42, 151–173. doi: 10.1080/15391523.2009.10782545

Higgins, J. P., and Thompson, S. G. (2002). Quantifying heterogeneity in a meta-analysis. Stat. Med. 21, 1539–1558. doi: 10.1002/sim.1186

Hongxing, H. (2017). Project-based learning: classroom teaching activities to cultivate students’ core literacy. J. Lanzhou Univ. 06, 165–172. doi: 10.13885/j.issn.1000-2804.2017.06.021

Hugerat, M. (2016). How teaching science using project-based learning strategies affects the classroom learning environment. Learn. Environ. Res. 19, 383–395. doi: 10.1007/s10984-016-9212-y

Hung, C., Hwang, G., and Huang, I. (2012). A project-based digital storytelling approach for improving Students' learning motivation, problem-solving competence and learning achievement. J. Educ. Technol. Soc. 15, 368–379.

Jina, Du. (2022). The application of project-based learning based on problem awareness in primary school mathematics classroom . [Master’s thesis]. China: Jimei University Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202301&filename=1022632607.nh

Jingfu, L., and Zhixian, Z. (2002). Project-based learning model. Foreign Educ. Res. 11, 18–22.

Kaldi, S., Filippatou, D., and Govaris, C. (2011). Project-based learning in primary schools: effects on pupils' learning and attitudes. Education 39, 35–47. doi: 10.1080/03004270903179538

Karaçalli, S., and Korur, F. (2014). The effects of project-based learning on Students' academic achievement, attitude, and retention of knowledge: the subject of “Electricity in our Lives”. Sch. Sci. Math. 114, 224–235. doi: 10.1111/ssm.12071

Karpudewan, M., Ponniah, J., and Zain, A. N. M. (2016). Project-based learning: an approach to promote energy literacy among secondary school students. Asia Pac. Educ. Res. 25, 229–237. doi: 10.1007/s40299-015-0256-z

Keleşoğlu, A. (2011). I nvestigating the effects of project-based learning on students’ Academic Achievement and Attitudes Towards English Lesson. vol.1 The Online Journal Of New Horizons In Education.

Kelly, G.J., and Mayer, R.E. (2004). Enhancing undergraduate students’ chemistry understanding through project-based learning in an IT environment .

Kilpatrick, W. H. (1918). The Project Method: The Use of the Purposeful Act in the Education Process. Teach. Coll. Rec . 19, 319–335.

Kızkapan, O., and Bektaş, O. (2017). The effect of project based learning on seventh grade students’ academic achievement. Int. J. Instr. 10, 37–54. doi: 10.12973/iji.2017.1013a

Kolmos,, and Graaff, D. (2014). Problem-based and project-based learning in engineering education Merging models . doi: 10.1017/CBO9781139013451.012.

Lazić, B. D., Knežević, J. B., and Maričić, S. M. (2021). The influence of project-based learning on student achievement in elementary mathematics education. S. Afr. J. Educ. 41, 1–10. doi: 10.15700/saje.v41n3a1909

Lei, Zhou. (2020). The design and implementation of project-based learning for high school chemistry teaching . [Master’s thesis]. China: Yunnan Normal University Availabe at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202101&filename=1020760511.nh

Lin, K., and Lu, S. (2018). Effects of project-based activities in developing high school students’ energy literacy. J. Balt. Sci. Educ. 17, 867–877. doi: 10.33225/jbse/18.17.867

Ling, C. (2020). Design and practice of teaching activities based on project-based learning to cultivate primary school students’ computational thinking . [Master’s thesis]. China: Chongqing Normal University Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202201&filename=1020648502.nh

Linxiao, P. (2020) The application of project learning in senior high school biology classroom study .

Lu, P. (2020). Research on teaching design of junior high school information technology curriculum based on project-based learning . [Master’s thesis]. China: Beijing University of Technology. Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202101&filename=1021563235.nh

Luo, J. (2020). Research on the development of computational thinking skills based on project-based learning . [Master’s thesis]. China: Huazhong Normal University. Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202101&filename=1020119469.nh

Ma, Q. (2022) Project learning self-efficacy in elementary programming impact study .

Ma, S., and Yang, X. (2021). Cooperative reasoning learning to promote the development of higher-order thinking. Educ. Dev. Res. 24, 64–73. doi: 10.14121/j.cnki.1008-3855.2021.24.011

Mark, Y. (2022). The effectiveness of PBL classes using multimedia tools: a case study of a university liberal arts English class. Multimedia Lang. Teach. 25, 237–257.

Migdad, S. I., Joma, A., and Arvisais, O. (2021). The impact of the project-based learning strategy on leadership skills acquisition among Palestinian refugees students in Gaza. Didactique 2, 4–39. doi: 10.37571/2021.01012

Mingquan, L. (2020) Project learning in senior high school geography teaching research and practice .

Mioduser, D., and Betzer, N. (2007). The contribution of project-based-learning to high-achievers’ acquisition of technological knowledge and skills. Int. J. Technol. Des. Educ. 18, 59–77. doi: 10.1007/s10798-006-9010-4

Ozdamli, F., and Turan, B.Y. (2017). Effects of a technology supported project based learning (TS-PBL) approach on the success of a mobile application development course and the students’ opinions .

Page, M. J. (2021). PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. BMJ (Clinical research ed.) , 372:n160. doi: 10.1136/bmj.n160

Parrado-Martínez, P., and Sánchez-Andújar, S. (2020). Development of competences in postgraduate studies of finance: A project-based learning (PBL) case study. Int. Rev. Econ. Educ. 35:100192. doi: 10.1016/j.iree.2020.100192

Praba, L.T., Artini, L.P., and Ramendra, D.P. (2018). Project-based learning and writing skill in EFL: Are they related?

Rothstein, H.R, Sutton, A. J., and Borenstein, M. Publication bias in meta-analysis: Prevention, assessment, and adjustments[M] (2006). Hoboken: John Wiley & Sons: 350.

Rui, Jiao. (2020). An empirical study on the development of computational thinking skills of high school students based on project-based learning . [Master’s thesis]. China: Shaanxi Normal University. Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202201&filename=1020131664.nh

Ruiz-Rosa, I., Taño, D., and García-Rodríguez, F. J. (2021). Project-Based Learning as a tool to foster entrepreneurial competences (El Aprendizaje Basado en Proyectos como herramienta para potenciar la competencia emprendedora). Cult. Educ. 33, 1–29. doi: 10.1080/11356405.2021.1904657

Saleh, S., Muhammad, A., and Abdullah, S.M. (2020). Stem project-based approach in enhancing conceptual understanding and inventive thinking skills among secondary school students .

Santyasa, I. W., Rapi, N., and Sara, I. W. (2020). Project based learning and academic procrastination of students in learning physics. Int. J. Instr. 13, 489–508. doi: 10.29333/iji.2020.13132a

Shin, M. (2018). Effects of project-based learning on students’ motivation and self-efficacy . English Teaching . 73, 95–114.

ShiXuan, M. (2017). Research on the design of project-based learning activities based on Moodle . [Master’s thesis]. China: Nanjing Normal University. Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD201901\u0026amp;filename=1018254455.nh

Shyr, W. (2012). Teaching mechatronics: an innovative group project-based approach. Comput. Appl. Eng. Educ. 20, 93–102. doi: 10.1002/cae.20377

Sivia, A., MacMath, S., Novakowski, C., and Britton, V. (2019). Examining student engagement during a project-based unit in secondary science. Can. J. Sci. Math. Technol. Educ. 19, 254–269. doi: 10.1007/s42330-019-00053-x

Tseng, K., Chang, C., Lou, S., and Chen, W. (2013). Attitudes towards science, technology, engineering and mathematics (STEM) in a project-based learning (PjBL) environment. Int. J. Technol. Des. Educ. 23, 87–102. doi: 10.1007/s10798-011-9160-x

Vrabel, M. (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Rev. Esp. Nutr. Hum. Diet. 18:e123. doi: 10.1371/journal.pmed.1000097

Wang, J. (2021a) Project learning perspective of organic chemistry teaching design and implementation of high school .

Wang, Y. (2021b). Design and practice of open source hardware project-based learning for primary schools with problem-solving skills development . [Master’s thesis]. China: Northeast Normal University. Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202201&filename=1021631051.nh

Wang, H. (2022). Research on the design and application of a comprehensive practical activity curriculum for primary schools based on project-based learning . [Master’s thesis]. China: Mudanjiang Normal University. Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202301&filename=1022609345.nh

Wang, H., Huang, I., and Hwang, G. (2016). Comparison of the effects of project-based computer programming activities between mathematics-gifted students and average students. J. Comput. Educ. 3, 33–45. doi: 10.1007/s40692-015-0047-9

Wardat, Y., Belbase, S., and Tairab, H. (2022). Mathematics teachers’ perceptions of trends in international mathematics and science study (TIMSS)-related practices in Abu Dhabi emirate schools. Sustainability 14:5436. doi: 10.3390/su14095436

Wei, W., Yongquan, D., and Miao, Y. (2020). The impact of cooperative learning on students' learning outcomes: A meta-analysis based on 48 experimental or quasi-experimental studies. Shanghai J. Educ. Res. 07, 34–40+59. doi: 10.16194/j.cnki.31-1059/g4.2020.07.008

Weihong, L., and Yinglong, X. (2019). Promoting Students' high-level thinking development through project-based learning -- design and implementation of "baby market" exploration project. Basic Educ Curric 06, 20–23.

Wenlan, Z., and Jiao, H. (2019). Does project-based learning play a role in learning? -- meta-analysis based on 46 experimental and quasi-experimental studies. Res. Visual Educ. 02, 95–104. doi: 10.13811/j.cnki.eer.2019.02.012

Wurdinger, S., and Qureshi, M. (2015). Enhancing college students’ life skills through project based learning. Innov. High. Educ. 40, 279–286. doi: 10.1007/s10755-014-9314-3

Xiaolei, H. (2021). Research on the design and practice of high school information technology curriculum based on project-based learning . [Master’s thesis]. China: Southwest University Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202201&filename=1021768096.nh

Xu, C. (2022). A practical study of project-based learning for developing core literacy in subjects . Master’s thesis]. Southwest University. Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202201&filename=1021767951.nh

Xuezhi, Li. (2022). Research on the design and practice of project-based learning in junior high school mathematics curriculum . [Master’s thesis]. China: Ningxia University https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202301&filename=1022059895.nh

Yanan, H. (2020). An experimental study of Jigsaw-based project-based learning in elementary school IT class . [Master’s thesis]. China: Loudoun University. Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202101\u0026amp;filename=1020380160.nh

Yang, X. (2020), Practical research on teaching reform of information technology curriculum in Baochang No. 1 Middle School . [Master’s thesis]. China: Inner Mongolia Normal University. Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD201801&filename=1017093188.nh

Yating, B. (2022). Research on the design and practice of teaching elemental compounds in high school based on project-based learning . Master’s thesis]. China: Fuyang Normal University. Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202301&filename=1022640350.nh

Yexin, Li. (2019) The application of robot project learning in middle school teaching research .

Ying, Z. (2022). A study on the influence of project-based teaching on the intrinsic motivation of private university students’ English learning. J. Sci. Educ . 13, 29–31. doi: 10.16400/j.cnki.kjdk.2022.13.010

Yuan, X.-F. (2017). A Study on the Teaching Reform of Information Technology Course in Baochang No.1 Middle School - Taking “Project-based Learning” as an Example 2017. Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD201801&filename=1017093188.nh

Yun, X. (2022). Practical exploration of project-oriented deep ritual education -- take the project-oriented learning of searching for roots Xu Huiyuan in grade 5 as an example. Shanghai J. Educ. Res. 9, 64–68. doi: 10.16194/j.cnki.31-1059/g4.2022.09.006

Yuting, Tang. (2022). Practical research on project-based learning based on the development of scientific inquiry ability in secondary school biology teaching . [Master’s thesis]. China: Guizhou Normal University. Available at: https://kns.cnki.net/KCMS/detail/detail.aspx?dbname=CMFD202202\u0026amp;filename=1022573120.nh

Zhang, Y. (2022). A study on the effect of project-based teaching on the intrinsic motivation of private university students’ English learning. J. Sci. Educ. 13, 29SPi_ENDASH31. doi: 10.16400/j.cnki.kjdk.2022.13.010

Zhang, Ji-hong. (2022) Based on the junior high school students information technology subject core. Mesh type teaching mode design and application research .

Zulaeha, D., and Marpaung, D. (2020). Project-based learning approach to improve students’ writing skill. PROJECT 3:120. doi: 10.22460/project.v3i1.p120-126

Keywords: project-based learning, learning effects, 21st century skills, higher-order thinking, meta-analysis

Citation: Zhang L and Ma Y (2023) A study of the impact of project-based learning on student learning effects: a meta-analysis study. Front. Psychol . 14:1202728. doi: 10.3389/fpsyg.2023.1202728

Received: 09 April 2023; Accepted: 13 June 2023; Published: 17 July 2023.

Reviewed by:

Copyright © 2023 Zhang and Ma. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) . The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Yan Ma, [email protected]

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • View all journals
  • My Account Login
  • Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • Open access
  • Published: 08 December 2020

Project-based learning: an analysis of cooperation and evaluation as the axes of its dynamic

  • Berta de la Torre-Neches   ORCID: orcid.org/0000-0001-7305-362X 1 ,
  • Mariano Rubia-Avi 1 ,
  • Jose Luis Aparicio-Herguedas 2 &
  • Jairo Rodríguez-Medina   ORCID: orcid.org/0000-0002-6466-5525 3  

Humanities and Social Sciences Communications volume  7 , Article number:  167 ( 2020 ) Cite this article

10k Accesses

8 Citations

Metrics details

  • Development studies

Project-based learning is an active method that develops the maximum involvement and participation of students in the learning process. It requires the teacher to energize the learning scenario by promoting the cooperation of students to investigate, make decisions and respond to the challenges of the project. It also requires activating an evaluation system that promotes awareness, reflexivity and a critical spirit, facilitating deeper learning. This case study aims to understand the functioning of cooperative work established during the application of the method, as well as to know how the evaluation process progresses in the perspective of a group of teachers of secondary education that set up this methodology in their classes. The data obtained from interviews with the teachers involved in the study, teachers’ notebooks, and open-question questionnaire applied to high-school students are analyzed. Although the students were organized in small groups in order to develop their collaborative skills, intragroup frictions and conflicts were not sufficiently addressed or supervised in time by the teachers, thus resulting in an incomplete development of the synergies and collaboration necessaries to the project. From the point of view of the evaluation, the importance of the implementation of training and shared evaluation systems is well recognized, although a more traditional evaluation model, which does not sufficiently address the project development process prevails, and the value of the qualification on the final product achieved still weights.

Similar content being viewed by others

project based learning research paper

Computer programmers show distinct, expertise-dependent brain responses to violations in form and meaning when reading code

Chu-Hsuan Kuo & Chantel S. Prat

project based learning research paper

Artificial intelligence and illusions of understanding in scientific research

Lisa Messeri & M. J. Crockett

project based learning research paper

The role of artificial intelligence in achieving the Sustainable Development Goals

Ricardo Vinuesa, Hossein Azizpour, … Francesco Fuso Nerini

Introduction

As a result of the crisis scenario that began in Spain in 2007, the need to incorporate to the Secondary Education stage some subjects with economic contents, was posed in order to introduce and make students understand the socio-economic circumstances in the world. Simultaneously, teaching methods have been incorporating some learning methodologies that aim to make students able to solve, with involvement, the problems presented to them (Martín and Rodríguez, 2015 ). Some of these methods orient learning towards a competitive character such as cooperative methodologies, gamification or project-based learning (PBL) (Hernández March, 2006 ).

The PBL method is a methodological alternative that involves direct contact with the object of study and ends with the realization of a work project by the students initially proposed by the teacher (Bell, 2010 ), applying knowledge and skills and developing an attitude of commitment (Sánchez, 2018 ). In order to do this, students analyze the topic raised, think about it, organize themselves, search for information, work as a team and make decisions. It is, therefore, intended to promote knowledge of the contents as well as the management of skills and attitudes, learning to mobilize those resources said in situation and to solve problems (Perrenoud, 2008 ).

The experience carried out requires students to face real-life problem statements through activities that suit their interests (Krajcik and Blumenfeld, 2006 ), find and use tools to address them and act collaboratively to propose solutions through an action plan (Barret, 2005 ; Bender, 2012 ; Blumenfeld et al., 1991 ). Traditional training models are based in the premise that students have to know the content in order to apply it in solving a problem. The PBL reverses this order and considers that students obtain the knowledge while solving a problem (Jonassen, 2011 ), an aspect that results in a higher quality of the information they handle to solve it, since it is shared, discussed and applied in a concrete situation (Thomas, 2000 ).

Thus, through PBL, students plan, discuss, and implement projects that have real-world impact and are significant to them (Blank, 1997 ; Dickinson et al., 1998 ). They implement skills for the management of interpersonal and team relationships, the teacher acting as a guide and counselor during the learning process (Kolmos, 2012 ; Thomas, 2000 ). This allows students to think about their proposals, develop them and become aware of the process itself and everything that it implies beyond the results achieved (Brundiers and Wiek, 2013 ; García et al., 2010 ).

In this way, the acquisition of social skills, empathetic behavior, dialog and listening (Belland et al., 2006 ), the development of critical and reflective thinking (Mergendoller et al., 2006 ) is favored by activating competencies such as collaboration, decision-making, organization and group responsibility (Blank, 1997 ; Dickinson et al., 1998 ), contributing to the development of a more motivating and participatory learning climate (Lima et al., 2007 ).

This methodological aspect requires, in parallel, the review of the evaluation systems; it appears as necessary to leave behind the traditional cumulative models to introduce a new model of more formative, shared and authentic evaluation that is able to guarantee a greater involvement of the students in the development of their and their peer’s learning process (Brown and Race, 2013 ). An authentic evaluation offers the students opportunities to learn through the evaluation process planned and directed by the teacher. When the evaluation system is carefully designed to articulate with the learning results that are expected to be achieved, it is possible to obtain benefits in terms of greater participation and helps students to advance in the development of their knowledge, skills and attitudes (Brown, 2015 ).

Cooperation as the basis of project-based learning

One of the essential aspects of developing the PBL is the management of cooperation between the group participants, an aspect that must be guaranteed and supervised by offering sufficient feedback (Thomas, 2000 ). For Orlick ( 1986 ) cooperation is directly related to communication, cohesion, trust and skills development for positive social interaction.

However, Díaz-Barriga and Hernández ( 2002 ) consider that group work, which teachers frequently launch in project initiatives, does not necessarily implies true cooperation and there are many interpersonal problems that students face (Prince and Felder, 2006 ). This aspect prevents a real learning of collaboration and its application in action to address the shared phase of project management.

Burdett ( 2007 ) considers that, sometimes within the group, interpersonal relationships are strained since participation in group work involves much more than each member’s knowledge on a given subject: It involves listening, negotiating, giving in; ultimately, skills that favor the dynamics of group work. Such situations of tension and intragroup crises jeopardize the assignment to be developed and the effectiveness of group synergy, as established by Del Canto et al. ( 2009 ), Jhen and Mannix ( 2001 ), Kerr and Bruun ( 1983 ), Putnam ( 1997 ), and Velázquez ( 2013 ) and those are grouped around five critical dimensions: Differences in individual capacities to complete assignments, resulting in the stowaway effect ; imbalance in the functions to be performed; early abandonment in completing assignments due to unresolved discrepancies; struggle to make one’s own ideas prevail and lack of communicative skills.

Also for Kerr and Bruun ( 1983 ) and Slavin ( 2014 ) tensions arise from the lack of a follow-up by the teacher in the group work process entrusted to their students, not monitoring the performance and contribution of each member by thriving the aforementioned stowaway effect, imbalances in workloads borne by each member and unresolved crises in interpersonal relationships, not benefiting the task management, the project development and its fair evaluation.

Intragroup conflicts often cause widespread student complaints, lack of motivation, frustration, and occasionally, a preference for individual work that does seem to guarantee the fair evaluation of the assignment (Gámez and Torres, 2012 ; McConnell, 2005 ).

That is why establishing initial cooperative learning dynamics to learn how to collaborate, assume new responsibilities, communicate and assertively express ideas (Velázquez, 2013 ), is essential to get started in the PBL methodology. Johnson et al. ( 1999a ) define cooperative learning as a work-based methodology in small, usually heterogeneous groups in which students work together to improve their own and other member’s learning.

Several authors understand cooperative learning as an active methodology that favors the reflection of students while completing the assignment; not only des it allow to achieve academic goals, but also social objectives, it stimulates interaction through the proposal of small groups and guides the realization of a type of group work, structured and monitored, to favor the learning of all the members of the group without exception (Dyson, 2002 ; Johnson et al., 1999b ; Kagan, 2000 ; Pujolàs, 2009 ).

According to Johnson and Johnson ( 1999 ) the management of cooperative learning by teachers requires, for its effectiveness, guarantees in the management of positive interdependence, making the students understand that work benefits colleagues by prioritizing “us” over “I”, proactive interaction, individual responsibility, interpersonal skills, and group processing at the end of the work sessions performed.

The teacher establishes a structured process of true cooperation easing the development of academic objectives, but also other competitive objectives: cooperation, communication, social skills (Walberg and Paik, 2002 ).

It is important to note in this regard the role of the evaluation on the projects implemented, developed and presented. Pérez-Pueyo and López-Pastor ( 2017 ) propose a model of formative evaluation through the use of cooperative projects, in which a further step is taken in the autonomy of the students by fully involving them in the teaching process through shared tutoring, especially when the realization of projects that require a lot of involvement or levels of complexity in their realization is encouraged. In addition, the use of tools such as auto evaluations and group co-evaluations (Hamodi et al., 2015 ), allow the teacher to give more effective feedback during the process, based on the information provided by the students.

Based on the contributions of the various authors cited above, who understand cooperative learning as an active methodology that allows students to achieve not only academic goals but also social objectives, thus promoting the learning for all the students without exceptions, the present study aims to achieve the following objectives: Understanding the functioning of cooperative work present in the development of the operational dynamics of the PBL launched.

Knowing how the formative evaluation process develops in the operational dynamics of the PBL.

Participants and context

The study included 16 students on their fourth year of Secondary Education (with an average of 15 years old, 8 females and 8 males) attending Cristo Rey Polytechnic Institute in the city of Valladolid, and taking the elective subject of Economics. Also three male teachers and two female teachers (ages [35–57]) who teach at the same center and stage, in which they apply PBL as an active methodology. All procedures were in accordance with the ethical standards of the institutional and national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

During the development of the research, the ability of students to work through PBL was tested, applying the academic project entitled My Business Plan , throughout the subject of Economics in the compulsory secondary education stage. The students were arranged in groups of 4 to 5 members with different capacities and potentialities.

These heterogeneous groups allowed the development of various skills by the students, with the intention of improving them together with intragroup interpersonal relationships.

Data collection and information analysis tools

An in-depth interview was designed for teachers who were to some extent incorporating PBL as an active methodology in the development of their subjects. They thus form a representation of the faculty imparting subjects such as Economics, Geography and History, Biology and Geology, Physics and Chemistry and Philosophy. At the same time, an open-question questionnaire was designed for students. Finally, a reflexive diary was drafted in which observations were recorded from the experiences carried out in class.

In relation to the analysis of the information obtained, the ATLAS.ti software has been used, confectioning a work of textual analysis of the transcripts of teachers’ interviews, the answers on the open questions of the questionnaire answered by the students, alongside with the teacher’s own reflexive diary.

On the three primary documents, a coding process is carried out inductively and deductively through two cycles (Miles et al., 2014 ). Thus, during the process, a constant circular relationship between the codes already obtained and the new ones I created, refining the concepts, grouping them, to infer in higher-level constructs as groups of explanatory codes (Kalpokaite and Radivojevic, 2019 ).

The codes obtained during the first coding cycle were analyzed critically and independently by the four researchers participating in the study establishing a thoughtful debate. Continuous feedback between researchers and their ongoing participation in the regeneration and refinement of codes and groups of codes supported the credibility, reliability and transparency of the research (Neal et al., 2015 ).

It was considered that saturation had been reached at the time where comparisons between the data ceased to show new relationships and properties between them, depleting that representative wealth of a circular analytical process (Flick, 2007 ).

In order to address the credibility aspects of the research in relation to the interpretative difficulties of the phenomenon studied (Lincoln and Guba, 1985 ), a structure of prolonged over time experimentation was developed, with the presence of the researcher at the location, maintaining the same methodological order, establishing her figure as an observer teacher during the time of research; in the analysis of the data, a process of triangulation was developed from the three aforementioned sources of documentary data, this allowing the contrast of the discoveries.

Forty-one explanatory codes of the phenomenon under investigation were established and grouped around four categories: Learning, interaction-collaboration, motivation, organization.

The use of the ATLAS.ti software as a code co-coordinate tool was convenient, allowing to observe how four codes of the categories Learning and Interaction-Collaboration related to each other: cooperation, conflicts, evaluation and project. Their relational study allows to reflect critically on the several handicaps found and whose consideration is essential for the applicability of the practice.

Thus, to address the first objective of the study—knowing the functioning of cooperative work in the development of the operational dynamics of the PBL launched—taking as a starting point the perceptions of the teachers interviewed and the relationships they establish between PBL and cooperation, they show a formula of practical application using cooperative structures in the form of small groups, which they consider makes it easier for students to encourage communication, to develop skills for interpersonal relationships, as well as individual and group responsibility in the fulfillment of the assignments proposed.

(…) I mix it at first with cooperative work, with small groups, with cooperative structures because being such dense subjects (…) and at the end of the school year, the last quarter, we already work on the project (Male Teaching Interview. 4:69).
In the groups, the smaller the better they work, (I would recommend) four tops, like last year (…) this allows everyone to work, if they are too many, the tasks get diluted and if there are very few, and it also happens sometimes, if one is sick or misses class for some reason for too many days, the groups gets resented… then it rally allows to work on relationships and influences the quality of learning very clearly by what I say… one is good at one thing, the other is good at some other thing, and they end up learning from each other (Male Teaching Interview. 4:358).

The same teacher considers, in the application of the methodology, the creation of small working groups, defending this formula as very valuable to develop the communicative and negotiation abilities to reach agreements and coordinate with others, the students winning from an experiential point of view, in socialization and interaction resources.

I divided the class into 4 groups of 4 students each (…), they had ten minutes to explain in front of the rest of the classmates what their business model was by answering various questions. (…) the idea of the project is that they are the ones who work on this concept throughout the course and thus gradually become familiar with that environment and its vocabulary (Reflexive Diary. 3:394).
Through the PBL they work together, they talk more, they must agree on different aspects, and it requires coordination, that is, an effort of all of them, not depending so much on their individual abilities; this approach is very different from the master class, and I do believe that, from a social point of view, socialization develops more and better this way (Reflexive Diary. 4:412).

However, the same teachers interviewed acknowledge that, during the development of the methodology, applying group work strategies for cooperation, numerous frictions and interpersonal conflicts are often triggered within the working groups. A closer attention is put on those students who does not follow the intended pattern of behavior and unleash conflict because they do not assume or carry out their workload.

The most negative aspect are those students who do not want to participate, or find it difficult to participate, or do not get involved and seriously harm the group, and sometimes problems such as friction and conflicts can appear among them for this reason; working individually, logically, there is no such problem (Female Teacher Interview. 4:150).
That student who is a little lazier, they can take advantage of the group work situation so that others work a little for them (Male teacher interview. 4:343).

This aspect is also observed and recorded by the teacher in her reflexive diary, acknowledging incidents that are likely to occur in the groups, generating some interpersonal conflict and influence on group performance to carry out the tasks of the project.

There is a group of four boys who you have to tell off and who I do not intend to bring together in the future for the groups of the project (Reflexive Diary. 3:296).
Z (…) during group work he plays with the table, gets distracted by what other teammates do (…). I think he’s a boy who is too easily distracted and annoys his peers (Reflexive Diary. 3:160).

The students themselves consider that the project suffers when situations in which not all members of the group work in tune occur, creating imbalances in the effort made and in the management of the workloads and involvement assumed, which have an impact not only on the realization of the tasks and assignments and their final evaluation, but also on the intragroup climate.

I don’t like it when there’s someone in my group who doesn’t work and gets the same grade as me or we fail the project all because of him, because we don’t all work equally; sometimes I felt that if I didn’t tell them to do something, they wouldn’t do it (Student Questionnaire. 5:242)
There are groups where only one or two people work and it’s not fair. The rest of them get too comfortable and their work is minimal. I would try watching those who do not work, or not giving them the same grade (Student Questionnaire. 5:123)
When the members of the group do not work, the project can be a disaster; and if a person does not want to do their job then discussions arise; for me the experience is negative because I did work and I did it all by myself (Student Questionnaire. 6:134)

With regard to the second objective of the study, knowing how the formative evaluation process develops in the operational dynamics of the PBL, taking into account the teachers involved in the inclusion of PBL in their teaching practice, it seems to show a difficult development, recognizing the constant presence of tests and evaluations as a generalized tool of measurement of the acquired knowledge. However, it recognizes the value of other competence aspects that must necessarily be considered by applying tools that make it easier for students to raise awareness of the developed learnings, as well as the value of the teacher as a guide who oversees the learning process and controls and leads it.

Evaluation is a complex topic because if you base your work on projects and in the end you give them an exam you are giving more value to the contents and not so much to everything else; that is why for the final evaluation we are already working on taking into consideration the valuable opinions of each one, that of the classmates, the ones shared among students and teachers through auto evaluation practices, co-evaluation and heteroevaluation. In this way they develop their critical ability, their capability to value themselves and others (Male Teacher Interview. 4:323).
I like as a teacher to supervise how they perform the practice of PBL, if everyone works and contributes; then I believe that this work is done in front of them (Male teacher interview. 4:442).
When one works in a group within the classroom the relationship between the students and the teacher is reinforced because they are no longer seen as a figure of authority or a superior, but as a guide who knows, who helps, who collaborates with them and listens to them (Female Teacher Interview. 4:388).

The same teacher in her reflexive diary mentions the use of evaluation practices such as co-evaluation allowing the students to express themselves in order to participate and getting them involved through paper presentations and consequent evaluation between classmates; she also references the heteroevaluation allowing the time for student-teacher dialog based on the assignments and a proposal to solve the project addressed.

What I want is for them to work a little bit and, to make sure of that, as they develop the eight sections on their project, they must make a presentation in front of the rest of their classmates that will be evaluated by themselves and commented by the rest of us (Reflexive Diary. 3:701).
Once the presentations were completed, I gave each group a questionnaire to conduct a co-evaluation on the project addressed; for this evaluation, each group would evaluate the work presented by the other groups, grading representatively each of the sections of the project, so that we could have several grades to be used for the final evaluation of the project (Reflexive Diary. 3:335).

To conclude, the students recognize certain limitations in the evaluation of their work, mainly in a key of a non-follow-up of the process established in the classroom to address the project and the assignments required. They propose solutions to develop a greater control on those people in the group who do not contribute in the realization of the aforementioned assignments, as well as a better management of the final grade that, being the same for the whole group, is detrimental, in their perception, to the formation of a fair value in relation to the unequal effort made. Sometimes the proposed solutions are oriented in an opposite direction to the cooperative spirit that the PBL promotes.

The way I would solve the problem of those colleagues who take advantage of the work of others when working as a group is to set them alone to work; to do their own project; that way, at least they would control those who do not work (Student Questionnaire. 5:168).
As a positive experience, I find working with projects more enjoyable and entertaining; the most negative thing is that it is almost never worked equally, and approximately the same grade is received. It is better to grade individually instead of having a final group grade (Student Questionnaire. 3:356).
The problem with those classmates who take advantage of other’s work when working in a group I would solve by telling the teacher, and giving an individual grade on each assignment done by each group member, specifying who did what (Student Questionnaire. 5:206).

When teaching methods such as PBL are used, in which the teacher poses a question, a challenge or a specific problem connected with the reality that students have to solve (Bell, 2010 ), the degree of involvement of these students seems to increase. In the teaching-learning process, they become the protagonists when they are invited to seek, assess, interpret and share information with the rest of the group members, and they apply a more critical way of thinking, since they are constantly and mutually questioned about why and what are they studying for.

In this sense, the students participate collaboratively in all the proposed assignments: understanding and interpretation of data, collection of information, preparation of partial deliveries, writing of the final report, and oral presentation before others, assessing the problem or challenge proposed with the intention of being able to draw their own conclusions.

In the implementation of these formative dynamics as an alternative to more traditional methodological models, a new way of generating and developing learning is consequently activated, applying a cooperative work model, being the management of group activity to face the project a vital aspect.

In relation to the cooperative dynamics of operation of the PBL experiences developed, the implementation of a methodological model is observed; this model is based, as a starting point, on cooperative structures by which the students are intended to address the project. Such structures materialize in the form of small and heterogeneous groups that seek to guarantee communication between their members (Johnson et al., 1999a ), unleashing a strongly competency learning model (Perrenoud, 2008 ) in which students have to combine the knowledge, skills and attitudes that they learn, in a shared way with their classmates, to face the assignments and carry out the project proposed and presented by the teacher (Bell, 2010 ; Thomas, 2000 ).

In the same way, intentionally, the dynamics proposed by teachers through this methodology intend to trigger learning situations in which negotiation, compromise, listening, agreement-reaching and coordination to make decisions and solve problems are aspects of interaction and socialization necessarily to be encouraged, as established by Belland et al. ( 2006 ) and Bender ( 2012 ).

However, there is a general concern about the management in the classroom of the cooperative structures placed in order to develop the project. Friction, conflicts inherent in group life and the consequence of the cooperation dynamics applied to establish in a shared way the action plan to address the entrusted project are recognized. They identify in certain students a lack of willingness for cooperation and commitment, aspects that generate intragroup tension that for Slavin ( 2014 ) is necessary to keep track of by the teacher during the learning process, for example, paying special attention to those situations in which the stowaway effect occurs (Kerr and Bruun, 1983 ; Slavin, 2014 ).

In this matter, the students themselves describe occasional imbalances in the efforts made to carry out the assignments, the weight of the workloads assumed and, ultimately, a certain lack of harmony when relating to each other when it comes to getting involved in the project. For Del Canto et al. ( 2009 ), Jhen and Mannix ( 2001 ), Putnam ( 1997 ), and Velázquez ( 2013 ) cooperation requires attention on these critical aspects during its development, benefiting the group climate itself and thus, the performance on the assignments. For Gámez and Torres ( 2012 ) and McConnell ( 2005 ), intragroup conflict provokes generalized complaints, loss of enthusiasm and motivation for group members, a source of arguments and frustration, an aspect present in the study in the voice of the students involved.

At the same time, the teaching staff, in relation to the evaluation of the formative dynamics based on the PBL put in place, recognize the importance of paying attention to various competency aspects inherent to the cooperative learning process obtained.

This aspect, in line with what is suggested by Blank ( 1997 ), Dickinson et al. ( 1998 ), Mergendoller et al. ( 2006 ) and Belland et al. ( 2006 ), materializes in the attention to capacities such as empathy, listening, critical thinking, collaboration, decision-making, group responsibility, the teacher assuming a role of leader and guide of all these during the process of learning, as considered by Thomas ( 2000 ), Walberg and Paik ( 2002 ) and Kokotsaki et al. ( 2016 ), supporting the maintenance of a more motivating, participatory and facilitating group work climate (Lima et al., 2007 ).

Despite the use of traditional evaluation dynamics presenting a more finalist nature, such as the test or exam, the teaching staff recognize the value of formative and shared evaluation tools, such as self-evaluation, co-evaluation and heteroevaluation. In this sense, it is observed in the group, not without difficulties (Ertmer and Simons, 2005 ) a certain appreciation for the involvement of the students in the evaluation process, giving them a voice to express their own perception through dynamics such as the presentation of resulting works and shared evaluation in this regard. Paradoxically, the students involved consider a certain lack of follow-up by the teachers on the assignments they carry out and that are a part of the project, in correlation with a conflictive management of the grade in this regard. For Pérez-Pueyo and López-Pastor ( 2017 ) it is necessary to take further steps in the autonomy and personal initiative of the students and their involvement in the evaluation process, the teacher being able to apply techniques such as auto-evaluation, peer evaluation, shared evaluation, self-grading and dialogued grading. The same authors, for example, advocate for intervening in a Secondary Education classroom by applying cooperative projects and final presentations of group papers or events preparation, tutoring in a shared way with their students and involving them in their—and other’s—learning process; The teacher can also complete the methodological initiative by developing group auto-evaluations and co-evaluations, the students evaluating the process of effecting the group assignments or the actual completion of the final presentations. Some recommended instruments to lead the aforementioned evaluation techniques are the group class diary, the auto-evaluation reports and the evaluation scales (Hamodi et al., 2015 ; Hernando et al., 2017 ).

In short, the PBL experience carried out contains all the technical elements to facilitate a learning model of the competence type, which addresses both knowledge and skills to carry out the assignments and to offer solutions to the problems inherent to the given project, as well as the abilities to do so jointly and cooperatively. However, it shows that the methodological practice proposed still suffers from a real follow-up on the group process set, establishing feedback means in the action itself, neglecting the potential conflicts that arise and the smooth completion of the assignments.

In relation to evaluation, the importance of a more formative evaluation model is recognized among the teachers involved, appreciating practices that activate the participation and involvement of students, although the weight of the final products continues to be relevant to the process itself.

Data availability

All data generated or analyzed during this study are included in this published article.

Barret T (2005) What is problem-based learning. In: O´Neill G, Moore S, McMullin B (eds) Emerging issues in the practice of university learning and teaching. AISHE, Dublin, pp. 55–66

Google Scholar  

Bell S (2010) Project-based learning for the 21st century: skills for the future. Clear House 83:39–43. https://doi.org/10.1080/00098650903505415

Article   Google Scholar  

Belland BR, Ertmer PA, Simons KD (2006) Perceptions of the value of problem-based learning among student with special needs and their teachers. Int J Problem-based Learn 1(2):1–18. https://doi.org/10.7771/1541-5015.1024

Bender W (2012) Project-based learning: differentiating instruction for the 21st Century. Corwin, California

Blank W (1997) Authentic instruction. In: Blank WE, Harwell S (eds.) Promising practices for connecting high school to the real World. University of South Florida, Tampa, pp. 15–21

Blumenfeld PC, Soloway E, Marx R (1991) Motivating Project-based learning: sustaining the doing, supporting the learning. Educ Psychol 26:369–398. https://doi.org/10.1080/00461520.1991.9653139

Brown S (2015) Authentic assessment: using assessment to help students learn. Electr J Educ Res Assess Eval 21(2):1–8. https://doi.org/10.7203/relieve.21.2.7674

Brown S, Race P (2013) Using effective assessment to promote learning. In: Hunt L, Chalmers D (eds.) University teaching in focus. A learning-centred approach. Routledge, London, pp. 74–91

Brundiers K, Wiek A (2013) Do we teach what we preach? An international comparative appraisal of problem- and project-based learning courses in sustainability. Sustainability 5(4):1725–1746. https://doi.org/10.3390/su5041725

Burdett J (2007) Degrees of separation balancing intervention and independence in group work assignments. Aust Educ Res 34(1):55–71. https://doi.org/10.1007/BF03216850

Del Canto P, Gallego I, López JM, Mora J, Reyes A, Rodríguez E, Valero M (2009) Conflictos en el trabajo en grupo: cuatro casos habituales. Revista de Formación e Innovación Educativa Universitaria 2(4):344–359

Díaz-Barriga F, Hernández R (2002) Estrategias docentes para un aprendizaje significativo. McGraw-Hill, Barcelona

Dickinson KP, Soukamneuth S, Yu HC, Kimball M, D’Amico R, Perry R, Kingsley C, Curan SP (1998) Providing educational services in the Summer Youth Employment and Training Program [Technical assistance guide]. U.S. Department of Labor, Office of Policy and Research, Washington

Dyson B (2002) The implementation of cooperative learning in an elementary school physical education program. J Teach Phys Educ 22(1):69–85

Ertmer PA, Simons KD (2005) Scaffolding teachers’ efforts to implement problem based learning. Int J Learn 12(4):319–328. https://doi.org/10.18848/1447-9494/CGP/v12i04/46447

Flick U (2007) El diseño de investigación cualitativa. Morata, Madrid

Gámez MJ, Torres C (2012) Las técnicas de grupo como estrategia metodológica en la adquisición de la competencia de trabajo en equipo de los alumnos universitarios. J Educ Teach Train 4:14–25

García I, Gros B, Noguera I (2010) La relación entre las prestaciones tecnológicas y el diseño de las actividades de aprendizaje para la construcción colaborativa del conocimiento. Cultura y Educación 22(4):395–418. https://doi.org/10.1174/113564010793351867

Hamodi C, López-Pastor V, López-Pastor AT (2015) Medios, técnicas e instrumentos de evaluación formativa y compartida del aprendizaje en educación superior. Perfiles Educativos 37(147):146–161

Hernández March A (2006) Metodologías activas para la formación de competencias. Educatio Siglo XXI 24:35–56

Hernando A, Hortigüela D, Pérez-Pueyo A (2017) El proceso de evaluación formativa en la realización de un video tutorial de estiramientos en inglés en un centro bilingüe. In: López-Pastor V, Pérez-Pueyo A (eds) Buenas prácticas docentes: Evaluación formativa y compartida en educación: experiencias de éxito en todas las etapas educativas. Universidad de León, León, pp. 260–271

Jhen KA, Mannix EA (2001) The dynamic nature of conflict: a longitudinal study of intragroup conflict and group performance. Acad Manag J 44(2):238–251. https://www.jstor.org/stable/3069453

Johnson D, Johnson R (1999) Aprender juntos y solos. Aprendizaje cooperative, competitivo e individualista. Aique, Buenos Aires

Johnson D, Johnson R, Holubec E (1999a) El aprendizaje cooperativo en el aula. Paidós, Buenos Aires

Johnson D, Johnson R, Holubec E (1999b) Los círculos del aprendizaje. La cooperación en el aula y la escuela. Aique, Buenos Aires

Jonassen D (2011) Supporting problem solving in PBL. Interdiscip J Problem-Based Learn 5(2):95–119. https://doi.org/10.7771/1541-5015.1256

Kagan S (2000) L´apprendimento cooperativo: L´approccio strutturale. Edizioni Lavoro, Roma

Kalpokaite N, Radivojevic I (2019) Demystifying qualitative data analysis for novice qualitative researchers. Qual Rep 24(13):44–57

Kerr NL, Bruun SE (1983) Dispensability of member effort and group motivation losses: free-rider effects. J Pers Soc Psychol 44(1):78–94. https://doi.org/10.1037/0022-3514.44.1.78

Kokotsaki D, Menzies V, Wiggins A (2016) Project-based learning: a review of the literature. Improving Schools 19(3):267–277. https://doi.org/10.1177/1365480216659733

Kolmos A (2012) Changing the curriculum to problem based and project-based learning. In: Yusof KM, Azli NA, Kosnin AM, Syed Yusof SK, Yusof YM (eds) Outcome-based science, technology, engineering, and mathematics education: innovative practices. IGI Global, pp. 50–61

Krajcik JS, Blumenfeld PC (2006) Project-based learning. In: Sawyer K (ed) Cambridge handbook of the learning sciences. Cambridge University Press, pp. 317–334

Lima RM, Carvalho D, Flores M, Van Hattum-Janssen N (2007) A case study on project led education in engineering: student´s and teacher´s perceptions. Eur J Eng Educ 32(3):337–347

Lincoln YS, Guba EG (1985) Naturalistic inquiry. Sage, Beverly Hills

Book   Google Scholar  

Martín A, Rodríguez S (2015) Motivación en alumnos de Primaria en aulas con metodologías basadas en proyectos. Revista de Estudios e Investigación en Psicología y Educación Extr 1:58–62. https://doi.org/10.17979/reipe.2015.0.01.314

McConnell D (2005) Networked e-learning groups. Stud High Educ 30(1):25–42. https://doi.org/10.1080/0307507052000307777

Mergendoller JR, Maxwell NL, Bellisimo Y (2006) The effectiveness of problem-based instruction: a comparative study of instructional methods and student characteristics. Interdiscip J Problem-Based Learn 1(2):49–69. https://doi.org/10.7771/1541-5015.1026

Miles MB, Huberman AM, Saldaña J (2014) Qualitative data analysis. A methods sourcebook. Sage, London

Neal JW, Neal ZP, VanDyke E, Kornbluh M (2015) Expediting the analysis of qualitativedata in evaluation: a procedure for the rapid identification of themes fromaudio recordings (RITA). Am J Eval 36(1):118–132. https://doi.org/10.1177/1098214014536601

Orlick T (1986) Juegos y deportes cooperativos. Editorial Popular, Madrid

Pérez-Pueyo A, López-Pastor V (2017) El estilo actitudinal como propuesta metodológica vinculada a la evaluación formativa. In: López-Pastor V, Pérez- Pueyo A (eds) Evaluación formativa y compartida en educación: experiencias de éxito en todas las etapas educativas. Universidad de León, Secretariado de Publicaciones, León, pp. 240–259

Perrenoud P (2008) Construir las competencias, ¿es darle la espalda a los saberes? Revista de Docencia Universitaria 6(11):1–8

Prince MJ, Felder M (2006) Inductive teaching and learning methods: definitions, comparisons and research bases. J Eng Educ 95(2):123–138. https://doi.org/10.1002/j.2168-9830.2006.tb00884.x

Pujolàs P (2009) La calidad en los equipos de aprendizaje cooperativo. Algunas consideraciones para el cálculo del grado de cooperatividad. Revista de Educación 349:225–239

Putnam J (1997) Cooperative learning in diverse classrooms. Prentice-Hall, Upper Saddle River, NJ

Sánchez N (2018) Clase invertida y aprendizaje basado en proyectos en el aula de biología. Un proyecto de innovación para 1° de la ESO. Valoración de la experiencia. Enseñanza Teaching 36(1):81–11. https://doi.org/10.14201/et21836181110

Slavin RE (2014) Cooperative learning and academic achievement: why does groupwork work? Anales de Psicología 30(3):785–791. https://doi.org/10.6018/analesps.30.3.201201

Thomas JW (2000) A review of research in project-based learning. Autodesk Foundation, San Rafael, CA

Velázquez C (2013) La pedagogía de la cooperación en educación física. Kínesis, Armenia

Walberg H, Paik S (2002) Prácticas eficaces. Magisterio, Bogotá

Download references

Acknowledgements

We gratefully acknowledge the support of the teachers, school managers and the children that participated for their collaboration.

Author information

Authors and affiliations.

Department of Pedagogy, Faculty of Education and Social Work, University of Valladolid, Paseo de Belén, 1, 47011, Valladolid, Spain

Berta de la Torre-Neches & Mariano Rubia-Avi

Deparment of Physical Education, Faculty of Education, University of Valladolid, Plaza de la Universidad, 1, 40005, Segovia, Spain

Jose Luis Aparicio-Herguedas

Department of Methods of Research and Diagnosis in Education I, National Distance Education University, Juan del Rosal, 14, 28040, Madrid, Spain

Jairo Rodríguez-Medina

You can also search for this author in PubMed   Google Scholar

Contributions

The authors contributed equally to this work.

Corresponding author

Correspondence to Berta de la Torre-Neches .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

de la Torre-Neches, B., Rubia-Avi, M., Aparicio-Herguedas, J.L. et al. Project-based learning: an analysis of cooperation and evaluation as the axes of its dynamic. Humanit Soc Sci Commun 7 , 167 (2020). https://doi.org/10.1057/s41599-020-00663-z

Download citation

Received : 22 September 2020

Accepted : 05 November 2020

Published : 08 December 2020

DOI : https://doi.org/10.1057/s41599-020-00663-z

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Quick links

  • Explore articles by subject
  • Guide to authors
  • Editorial policies

project based learning research paper

  • Position paper
  • Open access
  • Published: 28 November 2019

Promoting deep learning through project-based learning: a design problem

  • Emily C. Miller 1 &
  • Joseph S. Krajcik   ORCID: orcid.org/0000-0002-5413-507X 2  

Disciplinary and Interdisciplinary Science Education Research volume  1 , Article number:  7 ( 2019 ) Cite this article

25k Accesses

54 Citations

1 Altmetric

Metrics details

In this paper, we present a design solution that involves the bringing together of Project-based Learning (PBL) with the theory of usable knowledge (Pellegrino & Hilton, Developing transferable knowledge and skills in the 21st century, 2012). Usable knowledge is the ability to use ideas to solve problems and explain phenomena, an approach to science learning put forth by the Framework for K-12 Science Education (National Research Council (NRC), A framework for K–12 science education: Practices, crosscutting concepts, and core ideas, 2012) to optimize science learning environments. We offer a process for designing a curricular system that enhances how students learn science as a progression toward sophisticated practice of usable knowledge by focusing on coherence, depth, and motivation. We saw the potential of these distinct approaches for informing one another, and we extrapolate on 4 years of research that involves the process of iterating on our curricular design to best integrate the two approaches to support student learning.

The work discussed in this manuscript was funded by the George Lucas Educational Foundation. The George Lucas Educational Foundation did not contribute to the design of the study and collection, analysis, and interpretation of data and in writing the manuscript. All ideas, findings and perspectives are those of the authors and not of the George Lucas Educational Foundation.

Our global community faces challenges of food security, access to potable water and threats such as climate change and habitat loss. Communities require scientifically literate citizens to make evidence-based decisions. All learners throughout the globe need to experience science education in which they develop the ability to use and apply scientific ideas and practices toward making decisions in science. The field calls for science learning environments that develop students’ ability to explain natural events, and design solutions to challenges using science ideas and practices.

The capacity to enact knowledge to solve a problem requires a deeper level of science understanding than memorizing information or procedures. Knowledge-in-use is the capacity that learners need to apply knowledge to make decisions and solve problems, and to evaluate when and how to get more information when necessary (Pellegrino & Hilton, 2012 ). The knowledge-in-use perspective presents a significant shift from traditional understandings of science knowledge as memorized facts and procedures and subsequently, to the teaching and learning of science. It is only through exposure to authentic disciplinary experiences with questions and problems with open-ended, and unresolved solutions, that students develop deeper, more connected level of knowledge (Schneider et al., 2016 ). In this way, students are tasked to leverage scientific and engineering practices for authentic purpose, the scientific ideas become tools, which are then harnessed toward arriving at the solution, rather than goals. The knowledge-in-use approach is similar to how the STEM world approaches science ideas in order to solve local and global issues. Knowledge-in-use perspective has gained prominence in the United States through the Framework for K-12 Science Education (National Research Council (NRC), 2012 ). Reform documents in Finland, (Finnish National Board of Education (FNBE), 2015 ; Germany (Kulgemeyer & Schecker, 2014 ) and PISA (OECD, 2016 ) emphasize similar knowledge-in-use theories of science learning in national standards. The emphasis on knowledge-in-use reflects an increased awareness by educators, learning scientists, policymakers, and the public of the facilities required by global citizens in the twenty-first Century.

We ask, “How do we design learning environments to support learners in developing knowledge-in-use to promote the deeper application of learning called for by international reform standards documents?

Third grade students are often tasked to write a report about an animal and describe how that animal survives in its habitat (e.g., Gillam, 2018 ; Leveen, 2007 ). Third graders will read nonfictions texts, take notes, and then record the same information in descriptive passages. In this case, science knowledge is considered as discreet information, and the basis for the final grade is the correctness and thoroughness of the information presented. Knowledge-in-use describes science knowledge as the application of big ideas of biology and habitat. Knowledge-in-use is related to the student conceptualizing the problem, and then subsequent collection and synthesis of data, and culminating in developing and defending their solution. Knowledge-in-use must revolve around an authentic problem, where there is more than one answer, such as engineering habitat to protect a species of butterfly.

Research from learning sciences (National Academies of Sciences, Engineering, and Medicine, 2019 ; NRC, 2007) supports the design of learning environments that engage students in authentic contexts where they make sense of natural phenomena by using disciplinary ideas and scientific and engineering practices. We propose that project-based learning (PBL) is one platform to promote the deeper learning of knowledge-in-use, which encompasses the vision of international reform documents.

In this paper, we elaborate on our four-year design process for developing PBL environments that promote a progression toward deep knowledge-in-use. As more and more national standards include similar approaches to learning, we realize that researchers from different countries are grappling with how to promote knowledge-in-use and could use use our process to inform their work. We developed a process that brings together the rigorous knowledge-in-use-based standards in the United States (National Academies of Sciences, Engineering, and Medicine, 2019 ; National Research Council (NRC), 2012 ; NRC, 2007), with the motivating, creative, and individualized advantages of PBL (Brown, Collins, & Duguid, 1989 ). Through a reflective, iterative design and redesign process we envision an alliance between rigor and motivation. We aim to iterate a design that maximizes deeper learning of performance standards through highlighting affordances, and mitigating the drawbacks, of these two approaches to science knowledge and to learning environments. We present one solution designed to sustain student interest across time, and that simultaneously builds important learning goals anchored in national standards.

We encourage countries to modify the design principles we put forth to fit their environment and standards. In the spirit of collaboration, we are excited to find out how the design principles we offer here may contribute to the solutions being put forth in other countries.

Example of standards that emphasize knowledge-in-use

The Framework for K- 12 Science Education (National Research Council (NRC), 2012 ) and Science and Engineering for Grades 6–12: Investigation and Design at the Center (National Academies of Sciences, Engineering, and Medicine, 2019 ) build on learning theory (e.g., constructivism (Piaget, 1964 ) and situated cognition (Brown et al., 1989 ) to present a vision for science teaching and learning that moves classroom learning away from the acquisition of disconnected science concepts and memorized procedures to learning environments where students simultaneously develop disciplinary core ideas (DCIs), science and engineering practices, and crosscutting concepts -- to make sense of real-world phenomena or design solutions to problems. Disciplinary core ideas (DCIs) are central to the disciplines of science as they represent a few of the most key ideas of earth and space sciences, physical science, life science and engineering. Disciplinary core ideas are powerful intellectual tools as they allow individuals to explain and predict a host of phenomena, serve as tools for investigating and exploring more complex ideas and solving problems, and are the building blocks for learning within a discipline (Duncan, Krajcik, & Rivet, 2016 ). Each DCI is useful in explaining a comprehensive range of natural phenomena and engineering problems. For example, ESS2.C: The Roles of Water in Earth’s Surface Processes is a component idea of the larger DCI Earth’s systems. Footnote 2 Crosscutting concepts (CCCs), such as cause and effect and structure and function are ideas that occur within and across disciplinary boundaries and are applied as lenses to ask questions of any phenomena. Scientific and engineering practices are the ways of knowing and doing which scientists and engineers employ to study and explore the natural and designed worlds. Although each of the dimensions is important on its own, to make sense of phenomena or solve problems, the dimensions work together to support students in the process. This integration of the three dimensions is referred to as three-dimensional learning (3D-learning).

The Next Generation Science Standards (NGSS; NGSS Lead State Partners, 2013 ) follow the vision of the Framework to present standards that incorporate all three dimensions: DCIs, SEPs and CCCs. Because each performance standard joins a practice with an idea and a crosscutting concept, they require students to use knowledge to explore or achieve something.

The 3D-learning of the NGSS is not intuitive and it is difficult for teachers to operationalize (Penuel, Harris, & DeBarger, 2015 ). Teachers must change their teaching practice and understand learning as trajectory toward generative ideas while supporting practices that involve critical thinking about natural events. PBL presents a potentially accommodating platform for operationalizing this knowledge-in-use perspective. In PBL environments, the development of concrete artifacts to solve a meaningful problem is aligned with learning goals. In the same way that ideas are tools for making sense of a natural event, they can be employed for developing artifacts. The artifacts in PBL can motivate students to sustain in their cognitive work and stick with challenging ideas.

  • Project-based learning

PBL is grounded in major theoretical ideas: (1) active construction, (2) situated learning, (3) social interactions, and (4) cognitive tools (Bransford, Brown, & Cocking, 2000 ). There are different versions of PBL (Barron et al., 1998 ; Krajcik et al., 1998 ), but all have in common the following: PBL uses a driving question that is meaningful to learners. This question drives student exploration and sustains motivation across time. Projects result in artifacts that are concrete and answers the driving question and culminates a learning sequence. Last, in PBL, the question and the artifact have an authentic connection to the community (Helle, Tynjälä, & Olkinuora, 2006 ). Project-based learning can be a platform for social studies, science, technology, and increasingly for language literacy and mathematics contexts.

Research across these disciplines have refined PBL for meeting specific practices associated with those disciplines (Bell, 2010 ; Boaler, 2002 ; Krajcik & Mun, 2014 ). In addition, discussions that bring together PBL approaches across disciplines is beginning. Project-based learning structures science learning environments around questions that engage students in collaborative sense-making of phenomena. Because PBL focuses on students and their interests, it tailors to the intellectual resources and experiences of diverse students and is responsive to culture, race, SES, and gender (Boaler, 2002 ; Geier et al., 2008 ; Krajcik, Blumenfeld, Marx, & Soloway, 1994 ).

Project-based learning has acceptance by teachers and communities as an invigorating approach that motivates students to learn (Beneke & Ostrosky, 2009 ; Chu, Tse, & Chow, 2011 ). Teacher take-up of PBL is documented and when well supported by administration, there is success in the approach. Students will sustain in problem spaces, and their learning endeavors are fueled by construction, social contexts, and creative problem solving and community connection (Krajcik et al., 1994 ). PBL succeeds when teachers have autonomy, wherewithal, and flexibility to modify the pace of instruction, scaffold learning, and create differentiation (Barron et al., 1998 ). Teachers must rely on their own expertise to scaffold productive and equitable interactions among students from different demographic groups. To this end, researchers emphasize the need for principal support of teachers as experts who can leverage individualized understanding of their students (Lam, Cheng, & Choy, 2010 ).

Current programs that feature school-wide models for PBL can be found across the United States as well in many other countries such as Finland, Germany, Israel, and Denmark (Schneider et al., 2016 ; Tal & Miedijensky, 2005 ; Thomas, 2000 ). However, PBL models have not resolved questions of scale and sustainability, especially for less well-funded public schools (Coburn, 2003 ). They are often funded privately or featured in charter schools in the US, such as High Tech High, Think Global School, Envision Schools, My Tech High, Da Vinci Schools and schools associated with the Buck Institute for Education (Larmer, Ross, & Mergendoller, 2009 ).

Challenges with scale, sustainability and PBL persist for the field, especially integrating PBL with reform-based standards or top-down initiatives (Coburn, 2003 ; Halvorsen et al., 2012 ). This may be due to the emphasis of PBL in individualism and creativity. Projects that are student-driven can become off track and result in lost teaching time in which academic standards are not met, and unproductive engagement (Blumenfeld et al., 1991 ). Barron et al. ( 1998 ) suggest one avenue to address curriculum standards through PBL. They included a design step in a PBL in which 5th grade students are to make a proposal for their design to a solution to rocket investigation. They compared two projects that engaged students in physics concepts, but one project included the step of submitting a rocket design according to specification from the National Aeronautics and Space Administration. The specification of the proposal guided students toward meeting content learning goals. Blumenfeld et al. ( 1991 ) also suggest that standards can be addressed in PBL. They call for research to designate lesson elements that are both fixed for the purpose of meeting standards, as well as elements that have flexibility and allow for student choice to remain true to PBL intent.

Despite the wide acceptance that PBL enjoys as curricular approach for students, PBL remains under researched (Halvorsen et al., 2012 ), especially in elementary education. Studies support PBL as motivating for students, and preliminary evidence indicates that PBL enhances student learning of challenging content and other skills such as problem solving and confidence (Kokotsaki, Menzies, & Wiggins, 2016 ). A major call for the field has been to gather evidence that PBL environments correlate with student learning of knowledge-in-use standards in rigorous gold standard randomized control trials (Kokotsaki et al., 2016 ).

This bringing together of the PBL approach with the rigorous knowledge-in-use standards for designing student learning environments has been our team’s ongoing work (Krajcik, Palincsar, & Miller, 2015 ; Miller, Codere, Severance, & Krajcik, 2019 ). We interrogate the process for capitalizing on two distinct approaches, one of student learning and another of learning environment design and pedagogies. Our effort is to develop a process for curricular systems (e.g., assessment, written curriculum and professional learning) that brings together the rigorous performances of the NGSS with the motivating, student centered approach of PBL. In this way, we hope to solve the challenges related to PBL: 1) tension in meeting standards, 2) scale and sustainability in multiple contexts, and 3) strong research support for the use of PBL in multiple contexts.

  • Design-based research

We use a design-based research method (Barab & Squire, 2004 ) where we conjecture, build and test the theory of educational curricular system materials (Sandoval, 2014 ). The DBR method enables us to evaluate and refine innovations around persistent educational problems, impact classrooms, and simultaneously make substantial contributions to the research literature. The team has completed three distinct cycles of redesigning parts of the system of curriculum. Each cycle includes focus on problem and data analysis, and design or revision of theoretical framings and materials, implementation, and evaluation.

Our work is based on the Multiple-Literacies in Project-based Learning (ML-PBL) project that endeavors to design engaging learning environments for 3rd – 5th grades (upper elementary school) to improve science achievement, engagement, and social and emotional learning. ML-PBL is a designed-based learning environments that capitalize on PBL and the NGSS to:

Engage all students in sense-making

Use language literacy and mathematical tools to develop science understanding

Design, develop and test a system for advancing science teaching and learning that builds a vision for enacting project-based learning and meeting NGSS for 3rd - 5th grades.

The system includes:

○ Highly developed and specified educative teacher materials (i.e., how to promote discourse, use of the driving questions; scaffolded sequence of lessons)

○ Highly developed and specified student materials (i.e., first-hand experiences, readings, writing experiences, model construction)

○ Professional learning supports (i.e., face-to-face meeting, video conferences, educative supports)

○ 3-dimensional formative and end-of-unit assessments

Support students to solve problems, think critically, develop creativity and think innovatively.

Develop curriculum materials with both fixed and flexible elements so they can be translated across various school contexts to enable scalability. PBL curriculum design should be able to inform what components of principles need to fixed – or, in other words, “best practice” regardless of context –and which design principles should be responsive and adaptive to different contexts.

To design, test and revise our materials, the ML-PBL group went through the following cycles of development, testing and revision. The first year of ML-PBL we conducted teaching experiments for the 3rd grade materials with just a few teachers to explore if the questions and phenomena we selected were compelling to learners. In the second year, we focused on pilot studies of the 3rd grade materials and teaching experiments of the 4th grade materials. Our pilot studies reached a greater number of teachers but still allowed us as researchers to watch closely what occurred in the classrooms. In the 3rd year, a field study with comparison teachers was conduct on the 3rd grade materials and pilot study of the 4th grade materials. Now in the 4th year, the Multiple Literacies Team has focused on an efficacy study with matched randomized controls of the Grade 3 units; revising and field-testing Grade 4 units; and teaching experiments of Grade 5 units.

In each cycle, we have focus classrooms in each grade where we collect rich ethnographic data, the primary source for evaluation and redesign of theory of integrated pedagogy materials for PBL and the NGSS. The thick data collection in these contexts responds to open ended research questions involving teacher and student discursive and collaborative practices, shifts in community, and science teaching and learning as ML-PBL is enacted.

This paper presents the theoretical alignment and material development of PBL and the knowledge-in-use of the NGSS (ML-PBL). And we present our approach to motivating sustainability and scale, and coherence with fixed and flexible aspects of implementation for the current cycle, as we are currently engaged in the efficacy study. The findings of our work result in emerging theory for design features of project-based learning and the ongoing development of ML-PBL.

PBL design to offer sustained focus in coherent material

Standards based on a knowledge-in-use approach describe progressions in which the student demonstrates scientific understanding of ideas and practices with increasing sophistication over time. Development of such knowledge requires a coherent design of curriculum materials. Coherence is the careful design that builds the ability to apply knowledge over time, where not only the ideas are developing, but the scientific practices and problem solving capacity are mutually reinforced. In the PBL curriculum, application of knowledge must be supported over the span of the project as the final project is developed, revised and presented to the community.

Coherence involves the system of activity that develops over time, and is guided by common goal expectations and norms of the discipline (Ford & Forman, 2006 ; Reiser, 2014 ). This practice builds by students collaboratively and incrementally developing and refining knowledge (Gouvea, Jamshidi, & Passmore, 2014 ). Each time learners figure out additional, succeeding piece of knowledge, they add to the developing explanation, model, or designed solution. The activities shape a narrative that provides an intentional path toward building understanding, anchored in students’ meaningful knowledge building experiences. In a coherent design, students have a reason for learning what they are learning (Edelson, 2001 ; Reiser, 2014 ), and are tasked to apply previous steps for accomplishing subsequent steps. Project-based learning can be designed for the coherence and to inform the requisite perseverance for students to build robust scientific understandings over time.

An example of coherence is a description of a series of lessons involving protected birds in the area. Students are tasked to design a bird feeder for the protected bird. This project demonstrates coherence by engaging students in lessons to develop the following ideas sequentially:

Not all birds look the same and birds have different traits. This idea is developed through field research and data comparison.

Traits correspond to the environment that birds can survive in, and the resources that are available for the bird to access. This idea is developed through data analysis and argumentation about which body shape, feet and beaks are most suited to certain environments, and a resource inventory near the school.

Environments change throughout the year, changing the resources that are available, and some birds must adapt to these changes by migrating. This idea is developing through student creating models of phenology and mathematical thinking involving maps and migration patterns.

Students have three critical ideas necessary for designing a bird feeder, and none of the ideas could be deeply understood without the preceding focused engagement in the phenomenon.

Bringing together project-based learning with knowledge-in-use

The task in designing, developing and testing PBL instructional units is to create learning environments that will peak students’ interests and drive them to learn and meet national standards (Schneider et al., 2016 ), designers need to pick complex and compelling phenomena and corresponding driving questions that will drive and sustain student learning and is thus an essential aspect of our work.

Establishing the driving question sets the stage for meeting all of the other key features of PBL and supporting learners in developing knowledge-in-use. The driving question focuses students’ planning and carrying out collaborative investigations and guides the development of artifacts, which are concrete representations of the results of students’ investigations. Throughout PBL, students collaborate and use cognitive tools in their investigations and in building artifacts that represent their emerging understandings. As such, the PBL classroom is a sense-making and knowledge-generating environment. Our design approach focuses on designing project-based learning environments that engage learners in pursuing questions about the natural world, design-based problems and natural events in which they live and meeting national standards, in our case the NGSS.

PBL and the NGSS integrated design

The integration of the PBL and the NGSS results in key generalizable approach for knowledge-in-use and curriculum and related instructional approached. In particular, we emphasize the usefulness of driving questions related to phenomenon and engineering solutions and the use of student ideas as cognitive tools that support knowledge building, driven by the discourse of sensemaking. Our design principles incorporate the PBL features and the learning goals of three-dimensional learning. We focused on picking phenomena and problems that meet standards, but at the same time compelling to the learner. The bold print represents the additions to the PBL features through integration with the NGSS and three-dimensional learning.

Lessons start with a driving question about a phenomenon and engineering problem , a problem to be solved or experience to be explained that promote wonderment about the world.

Lessons focus on Three-Dimensional learning goals (NGSS) that students are required to demonstrate mastery on key science standards and assessments.

Students participate in the Framework and the NGSS scientific practices – processes of investigating events and problem solving that are central to expert performance in the discipline.

Students explore the driving question by engaging in collaborative sensemaking activities to engage in shared knowledge building -- the solutions to the driving question.

While engaged in the practices of science, learning is scaffolded with discourse tools that help students participate in activities normally beyond their ability.

Overtime students iteratively and cohesively create a set of tangible products that scientifically address the driving question with increasing sophistication. These are shared artifacts, publicly accessible external representations of the class’s learning with local impact.

The phenomena and problems in PBL that students make sense of are the drivers of an increasingly complex demand for figuring out the driving question that the students investigate throughout the unit (Krajcik & Czerniak, 2018 ). Each new phenomenon or problem builds off the last and offers new insight toward the driving question. This careful and purposeful building meaning of phenomena through 3-D learning to acquire “usable” knowledge, builds coherence across the unit, and is what our team refined and iterated over time as a key solution to sustaining student engagement to develop knowledge-in-use. The artifact in ML-PBL is authentically connected to the community and solves a problem or explains a phenomenon in the design or natural world. The artifact leverages the engineering design solution and associated standards in the NGSS. Students must employ science ideas to collect information about a local science problem, develop a solution, test their solution and communicate their results to others.

We developed learning sets, or weekly coherent sets of lessons to help our teachers track the coherence of the lesson and across lessons that comprised the developing project. We included in learning sets driving questions of smaller grain-size toward the overarching driving question, usually comprising 5 lessons each. Each learning set, approximately 6 per unit, is responsive to the driving question, has its own tethered driving question and evidence statements. Evidence statements describe the learning that takes place in the lesson, and explicitly meet the goals of the lesson. As each learning set progresses, the understanding of the phenomenon is deepened, and the explanation becomes more sophisticated.

Each new learning set demands students deepen scientific understandings, referred to as conceptual tools (Blumenfeld et al., 1991 ), which they must use to make sense of the phenomenon (see Fig.  1 ) or solve the engineering problem (see Fig.  2 ). Footnote 3 In the phenomenon driven units (see Fig. 1 ), the demand to make sense of the phenomenon has direct implications for the development of the artifact. In some instances, to motivate learning and sustain engagement over time, our units focus on a driving question that is problem driven (see Fig. 2 ). In the problem driven unit, the impetus to solve a problem motivates the need to explore and explain the phenomenon.

figure 1

How application of ideas as conceptual tools is developed and used over time to engage with a phenomenon

figure 2

How application of ideas as conceptual tools is developed and used over time to engage with a solution to a problem

One third grade unit in ML-PBL engages learners in the driving question, “Why do I see so many squirrels but no stegosauruses?” This unit provides an authentic phenomenon for the students to explain (see Fig. 1 ). The students engage in a variety of investigations and modeling activities that include observing the squirrel outside, analyzing the structure of squirrels, making claims about how the needs of the squirrel relate to meeting its needs in the environments, and organizing and comparing information about squirrels and stegosauruses. The final artifact is a model that explains the stegosaurus’s extinction event and the eutherian mammal survival story of the same time period. Students integrate all they have figured out about adaptations, traits, and interactions with the environment as well as the re-creation of the ancient prehistoric environments using fossils, to make an argument that changes in the environment might have caused the extinction of one animal and not the other. Another unit, entitled, “How can I help the birds in my community grow up and thrive”, provides an authentic problem for the students to solve (see Fig. 2 ). The students engage in a variety of investigations and modeling activities that include bird observations and data collection, collecting information about birds – including traits, social behavior, life cycle, and ecology – modeling a chosen birds’ response to change in weather and in climate, and designing a bird feeder for that bird. Thus, the students are motivated to sustain effort in deep science learning, propelled by their problem and through this engagement learning scientific ideas and practices key to the NGSS.

The original storyline (Krajcik & Shin, 2013 ; Nordine, Krajcik, Fortus, & Neumann, 2019 ) included the overarching driving question and lessons that built in sophistication as learners investigated the driving question. It also included the 3-D learning goals and the expectation that students would figure out phenomenon or solving problems that linked to the driving question. We adapted design components to become more responsive to the elementary setting and raised new questions about fixed and flexible design principles. Our efforts to embed creativity through multiple possible solutions of each driving question enrich the conversation about utility in broad and more specific contexts.

Design for coherence to promote deeper, sustained learning

For students to develop capacity for application of more sophisticated ideas, scientific practices and crosscutting concepts called for by the NGSS, they must leverage the motivating PBL practices to sustain attention and iterate on these applications. They need to learn to tolerate mistakes and recalibrate their use of ideas and modify representations to match the evidence. This is challenging for students and their teachers who support the learning. As such we need stronger evidence if PBL serves as an platform to design for the coherence and the requisite perseverance for students to build knowledge-in-use and thus robust understandings over time.

In our work, we revise the storyline approach by interrogating what is meant by coherence within units, across units, and across grade levels. Our research integrates learning of challenging science ideas aligned to the NGSS with students’ engagement in science practices, language development, math, and technology. In addition, upper elementary is a context where students and teachers are steeped in community-building and attention to equity. Last, we found that our upper elementary teachers were less familiar with science ideas, and less comfortable with teaching science, which impacted our educative supports and grain size of coherence. With this in mind, we designed the units to achieve across unit coherence and within unit coherence, which was divided into learning set coherences. In these ways, we found that the new context pushed our design process to be re-shaped specific to elementary school context. We have become increasingly and reflexively:

intentional about the coherence, within a unit and across units;

purposeful in designing coherence in the enactment and artifacts -- building and using evidence statements in each lesson that adhere to the storyline and driving question;

attentive to coherence with respect to integrations of science with language development and math ideas and practices, discourse supports, SEL, and cultural competencies (Ladson-Billings, 1995 ) thereby describing shared language and community being built over time;

more attentive in creating community and responsive learning environments over time;

more attention to smaller grain size coherence levels of within and across learning sets within the larger storyline. Grain size coherence characterizes consideration to lesson level, rather than learning set level, development of ideas.

PBL curriculum design using ML-PBL design features enhance and provides directions on developing PBL materials– or, in other words, best practice regardless of context to meet the three dimensions of learning contained in the NGSS--with design principles that are responsive and adaptive to different contexts, part of the student centered approach in PBL. With a focus on coherence, and aligning PBL with the NGSS, we have designed, enacted, researched, and revised units that promote rigorous knowledge that teachers can operationalize. Our design reshaped the PBL principles for utility in broad and more specific contexts (Miller et al., 2019 ).

Consistent with the call to lessen inequality and increase educational opportunities for all children (NRC, 2012 ; OECD, 2016 ), PBL can reshape science education by engaging all learners in meaningful and robust knowledge building experiences. As a paucity of robust research on PBL exists, the design prepared to advance the understanding of how to develop and design PBL environments and support all learners in developing deeper and more useable science knowledge. While we recognize PBL is not the only approach that can promote knowledge-in-use, PBL does show promise – still there are important questions for the field to answer. In particular, we need more rigorous evidence to support the use of PBL as promoting knowledge-in-use and scalable across contexts.

Multiple Literacies in Project-Based Learning (ML-PBL) resources employ features of PBL to design, develop and test NGSS aligned elementary learning environments with a coherent design that promotes student learning of the big ideas of science and social and emotional learning, with artifacts that connect to authentic community-based contexts. We have crafted teacher and student materials integrated with long-term professional learning. ML-PBL is unique in that it integrates multiple literacies (i.e., communicating with community, arguing data, modeling phenomena, design problems, and presentation of solution to older students and staff members and stakeholders) along with new ambitious standards in science (NGSS, Lead States, 2013 ) to support children in developing application or useable science knowledge (Pellegrino & Hilton, 2012 ). A key feature of our work is the focus on students making sense of compelling and complex phenomena or designing solutions to problems. Everyday, place-based phenomena and problems are compelling to learning because they can spark and sustain interest. The coherent design with fixed and flexible features support learners in building usable knowledge of DCIs, CCCs and SEPs. Learners engage in collaboration and discourse to make sense of phenomena or problem in creative ways. We continue to review enactment to understand what features of the curriculum are associated with shifts in teacher practices, and which features correlate with deeper learning. While our design principles emerged from work in elementary classrooms, many of the principles our applicable to PBL environments at other grade levels (Schneider et al., 2016 ).

We add to the conversation in the field the tenacious or sticky problem of implementing theory in classrooms and recognizing the pull for dilution. Our ML-PBL design approach invigorates the learning through a coherent design that recognizes the need to purposeful and strategic introduction of related phenomenon and continued iteration of the artifact with new questions that supports students in developing useable knowledge. In addition, we propose that the NGSS and three-dimensional learning benefit the PBL approach because the goal of deeper learning and artifact development coincide and mutually reinforce one another. We continue to seek models of teacher sense-making and community building in professional learning around productive struggle of implementation, and flexibility in practice for differentiation and context that enables creativity and responsiveness.

We continue to perfect the design --the tension between fixed and flexible elements in the flow of learning called for multiple trials. We continue to seek models of teacher sensemaking and community building in professional learning around productive struggle of implementation, and flexibility in practice for differentiation and context that enables creativity and responsiveness.

In the global community collaboration is a capacity we are all working to advance and strengthen. It’s important for nations to come together and take on similar challenges of bringing together knowledge-in-use and designs that work to improve learning environments. We offer this design process for developing PBL and hope other countries use their own efforts to build toward this effort.

Availability of data and materials

All ML-PBL materials are Creative Commons Open Sources and are freely available for public use. The materials have the designation of Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0). Interested individuals can access the materials at https://open.mlpbl.com/#/. Individuals interested in the data and supporting documents can contact the corresponding author.

ESS stands for Earth and Space Science, which is the Science Discipline; The 2 is related to the Disciplinary Core Idea Earth’s Systems; And the C denotes Component idea, Weather and Climate in The Framework for K-12 Science Education, pp. 171. (National Research Council (NRC), 2012 )

The figures use the abbreviation LS, which refers to Learning Set, the short series of lessons that address one or two specified performance expectations.

Abbreviations

Three-dimensional learning

Crosscutting Concepts

Disciplinary Core Ideas

Multiple Literacies in Project-based Learning

National Academy of Science

Next Generation of Science Standards

National Research Council

Project-Based Learning

Scientific and Engineering Practices

Barab, S., & Squire, K. (2004). Design-based research: Putting a stake in the ground. The Journal of the Learning Sciences , 13 (1), 1–14.

Article   Google Scholar  

Barron, B. J., Schwartz, D. L., Vye, N. J., Moore, A., Petrosino, A., Zech, L., & Bransford, J. D. (1998). Doing with understanding: Lessons from research on problem-and project-based learning. Journal of the Learning Sciences , 7 (3–4), 271–311.

Google Scholar  

Bell, S. (2010). Project-based learning for the 21st century: Skills for the future. The Clearing House , 83 (2), 39–43.

Beneke, S., & Ostrosky, M. M. (2009). Teachers’ views of the efficacy of incorporating the project approach into classroom practice with diverse learners. Early Childhood Research & Practice , 11 (1), n1.

Blumenfeld, P. C., Soloway, E., Marx, R. W., Krajcik, J. S., Guzdial, M., & Palincsar, A. (1991). Motivating project-based learning: Sustaining the doing, supporting the learning. Educational Psychologist , 26 (3–4), 369–398.

Boaler, J. (2002). Learning from teaching: Exploring the relationship between reform curriculum and equity. Journal for Research in Mathematics Education , 239–258.

Bransford, J. D., Brown, A. L., & Cocking, R. R. (2000). How people learn , (vol. 11). Washington, DC: National academy press.

Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher , 18 (1), 32–42.

Chu, S. K. W., Tse, S. K., & Chow, K. (2011). Using collaborative teaching and inquiry project-based learning to help primary school students develop information literacy and information skills. Library & Information Science Research , 33 (2), 132–143.

Coburn, C. E. (2003). Rethinking scale: Moving beyond numbers to deep and lasting change. Educational Researcher , 32 (6), 3–12.

Duncan, R., Krajcik, J., & Rivet, A. (Eds.) (2016). Disciplinary core ideas: Reshaping teaching and learning . Arlington: National Science Teachers Association Press.

Edelson, D. C. (2001). Learning-for-use: A framework for the design of technology-supported inquiry activities. Journal of Research in Science Teaching , 38 (3), 355–385.

Finnish National Board of Education (FNBE) (2015). National core curriculum for general upper secondary schools 2015 . Helsinki: Finnish National Board of Education (FNBE) Retrieved from http://www.oph.fi/saadokset_ja_ohjeet/opetussuunnitelmien_ja_tutkintojen_perusteet/lukiokoulutus/lops2016/103/0/lukion_opetussuunnitelman_perusteet_2015 .

Ford, M. J., & Forman, E. A. (2006). Redefining disciplinary learning in classroom contexts. Review of Research in Education , 30 (1), 1–32.

Geier, R., Blumenfeld, P. C., Marx, R. W., Krajcik, J. S., Fishman, B., Soloway, E., & Clay-Chambers, J. (2008). Standardized test outcomes for students engaged in inquiry-based science curricula in the context of urban reform. Journal of Research in Science Teaching: The Official Journal of the National Association for Research in Science Teaching , 45 (8), 922–939.

Gillam, D. (2018). How do monarch butterflies find their way home? Science and Children , 55 (6), 96–97.

Gouvea, J. S., Jamshidi, A., & Passmore, C. (2014). Model-based reasoning: A framework for coordinating authentic scientific practice with science learning . Boulder: International Society of the Learning Sciences.

Halvorsen, A. L., Duke, N. K., Brugar, K. A., Block, M. K., Strachan, S. L., Berka, M. B., & Brown, J. M. (2012). Narrowing the achievement gap in second-grade social studies and content area literacy: The promise of a project-based approach. Theory & Research in Social Education , 40 (3), 198–229.

Helle, L., Tynjälä, P., & Olkinuora, E. (2006). Project-based learning in post-secondary education–theory, practice and rubber sling shots. Higher Education , 51 (2), 287–314.

Kokotsaki, D., Menzies, V., & Wiggins, A. (2016). Project-based learning: A review of the literature. Improving Schools , 19 (3), 267–277.

Krajcik, J., Blumenfeld, P. C., Marx, R. W., Bass, K. M., Fredricks, J., & Soloway, E. (1998). Inquiry in project-based science classrooms: Initial attempts by middle school students. Journal of the Learning Sciences , 7 (3–4), 313–350.

Krajcik, J. S., Blumenfeld, P. C., Marx, R. W., & Soloway, E. (1994). A collaborative model for helping middle grade science teachers learn project-based instruction. The Elementary School Journal , 94 (5), 483–497.

Krajcik, J. S., & Czerniak, C. (2018). Teaching science in elementary and middle school classrooms: A project-based learning approach , (5th ed., ). New York & London: Routledge, Taylor and Francis Group.

Book   Google Scholar  

Krajcik, J. S., & Mun, K. (2014). Promises and challenges of using learning technologies to promote student learning of science. Handbook of Research on Science Education , 2 , 337–360.

Krajcik, J. S., Palincsar, A., Miller, E. (2015). Multiple literacy in project-based learning. Michigan State University, East Lansing MI; Lucas education research, a division of the George Lucas Educational Foundation, San Rafael, CA

Krajcik, J. S., & Shin, N. (2013). Project-based learning. In R. K. Sawyer (Ed.), The Cambridge handbook of learning sciences , (2nd ed., ). New York: Cambridge.

Kulgemeyer, C., & Schecker, H. (2014). Research on educational standards in German science education—Towards a model of student competences EURASIA. Journal of Mathematics, Science & Technology Education , 10 (4), 257–269.

Ladson-Billings, G. (1995). Toward a theory of culturally relevant pedagogy. American Educational Research Journal , 32 (3), 465–491.

Lam, S. F., Cheng, R. W. Y., & Choy, H. C. (2010). School support and teacher motivation to implement project-based learning. Learning and Instruction , 20 (6), 487–497.

Larmer, J., Ross, D., & Mergendoller, J. (2009). Project based learning (PBL) starter kit: To-the-point advice, tools and tips for your first project in middle or high school . Novato: Buck Institute for Education.

Leveen, L. (2007). Exploring animals, Glossopedia style. Science and Children , 45 (1), 48–51.

Miller, E., Codere, S., Severance, S., & Krajcik, J. (2019). Aligning PBL with the NGSS: What do the NGSS offer PBL. Paper presented in Krajcik, J. In Promoting and Measuring Student Learning and Engagement Through Project-Based Learning: Leveraging Coherence . Toronto: AERA.

National Academies of Sciences, Engineering, and Medicine (2019). Science and engineering for grades 6–12: Investigation and design at the center . Washington, DC: National Academies Press.

National Research Council (NRC) (2012). A framework for K–12 science education: Practices, crosscutting concepts, and core ideas . Washington, DC: National Academies Press.

NGSS Lead State Partners (2013). Next generation science standards: For states, by states . Washington, DC: The National Academies Press.

Nordine, J., Krajcik, J., Fortus, D., & Neumann, K. (2019). Using storylines to support three-dimensional learning in project-based science. Science Scope , 42 (6), 85–91.

OECD (2016). PISA 2015. In Assessment and analytical framework: Science, reading, mathematic and financial literacy . Paris: OECD Publishing.

Pellegrino, J. W., & Hilton, M. L. (2012). Developing transferable knowledge and skills in the 21st century . Washington, DC: National Research Council.

Penuel, W. R., Harris, C. J., & DeBarger, A. H. (2015). Implementing the next generation science standards. Phi Delta Kappan , 96 (6), 45–49.

Piaget, J. (1964). Part I: Cognitive development in children: Piaget development and learning. Journal of Research in Science Teaching , 2 (3), 176–186.

Reiser, B. J. (2014). Designing coherent storylines aligned with NGSS for the K-12 classroom . Boston: National Science Education Leadership Association http://bit.ly/1TZeSaG .

Sandoval, W. (2014). Conjecture mapping: An approach to systematic educational design research. Journal of the Learning Sciences , 23 (1), 18–36.

Schneider, B., Krajcik, J., Lavonen, J., Salmela-Aro, K., Broda, M., Spicer, J., … Viljaranta, J. (2016). Investigating optimal learning moments in US and Finnish science classes. Journal of Research in Science Teaching , 53 (3), 400–421.

Tal, R. T., & Miedijensky, S. (2005). A model of alternative embedded assessment in a pull-out enrichment program for the gifted. Gifted Education International , 20 (2), 166–186.

Thomas, J. W. (2000). A review of research on project-based learning .

Download references

Acknowledgements

Not applicable.

Author information

Authors and affiliations.

University of Wisconsin-Madison, Madison, WI, USA

Emily C. Miller

CREATE for STEM, Michigan State University, East Lansing, MI, USA

Joseph S. Krajcik

You can also search for this author in PubMed   Google Scholar

Contributions

Both authors read and approved the final manuscript.

Emily Miller is a Senior Researcher Consultant at Create for STEM, co-Principal Investigator on Multiple Literacies for Project-based Learning and ABD candidate in UW Madison.

Joe Krajcik is the Principal Investigator on Multiple Literacies for Project-based Learning, the Lappan-Philips Professor of Science Education and Director of CREATE 4 STEM at Michigan State University.

Corresponding author

Correspondence to Joseph S. Krajcik .

Ethics declarations

Competing interests.

The authors declare that they have no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License ( http://creativecommons.org/licenses/by/4.0/ ), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Cite this article.

Miller, E.C., Krajcik, J.S. Promoting deep learning through project-based learning: a design problem. Discip Interdscip Sci Educ Res 1 , 7 (2019). https://doi.org/10.1186/s43031-019-0009-6

Download citation

Received : 03 May 2019

Accepted : 24 September 2019

Published : 28 November 2019

DOI : https://doi.org/10.1186/s43031-019-0009-6

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Elementary science education
  • Environmental learning design
  • Deeper learning

project based learning research paper

project based learning research paper

Academia.edu no longer supports Internet Explorer.

To browse Academia.edu and the wider internet faster and more securely, please take a few seconds to  upgrade your browser .

  •  We're Hiring!
  •  Help Center

Project-Based Learning

  • Most Cited Papers
  • Most Downloaded Papers
  • Newest Papers
  • Save to Library
  • Last »
  • Edy Chandra Follow Following
  • Problem Based Learning Follow Following
  • Project Based Learning (PBL) Follow Following
  • Sains dan Teknologi Follow Following
  • Authentic Writing Follow Following
  • Problem-Based Learning Follow Following
  • Conservation Biology Follow Following
  • Ecology Follow Following
  • Co Operative Learning Follow Following
  • Teacher Education Follow Following

Enter the email address you signed up with and we'll email you a reset link.

  • Academia.edu Publishing
  •   We're Hiring!
  •   Help Center
  • Find new research papers in:
  • Health Sciences
  • Earth Sciences
  • Cognitive Science
  • Mathematics
  • Computer Science
  • Academia ©2024
  • Our Mission

Project-Based Learning and the Research Paper

Students take responsibility for their learning and develop solutions for complex problems when their research paper becomes a PBL unit.

A class of students works in groups together in the library

In 11th grade, students in my county are expected to generate a research paper or product. In the past, I stuck to the traditional paper, mostly because doing so was comfortable for me as an English teacher. I can do papers. I can do essays. I can provide feedback and teach revision.

However, last year I took a risk—instead of the traditional paper, I told my students we would be embarking on a project-based learning (PBL) journey. They seemed excited, mostly because they thought they wouldn’t have to write a paper. In the end, they did so much more than that.

Project-Based Learning in High School English

I had my students form groups and then gave each group the task of choosing an issue they were interested in. The project would involve coming up with a viable solution. As a class we brainstormed all kinds of big issues, including school shootings, poverty, LGBT rights, bullying, and homelessness, as well as local issues like the need for more options in school lunches, such as vegan and gluten- and diary-free options.

Next they had to brainstorm possible resources and questions they needed to answer. Therein lies the beauty of PBL: Since I couldn’t anticipate their every need, they had to take responsibility for their own learning, and solve problems as they encountered them.

Mini-Lessons and Formative Assessments

Their first formative assessment developed organically as they realized they would need to email professionals who could answer questions to guide their research. These adults included our school principal and our security team, as well as local government officials. Students reached out to their local delegates and other elected representatives, including the congresswoman for our district.

I gave a mini-lesson on how to write a formal email, and then the students composed their emails. Before they sent the messages, I previewed them, offering feedback and constructive criticism (formative assessment), and students made revisions.

By the next class period, my students had one of two versions of the same problem: Their recipients had responded or they hadn’t, but either way my students didn’t know what to do.

I gave a mini-lesson on how to send a follow-up email when someone doesn’t respond and on how to move forward when they do. They wrote follow-up emails, and again I previewed these. As we awaited responses, several groups asked if they could poll the staff or their peers about school lunch choices, improving school security, and expanding the school parking lot. This exercise could benefit all groups, so we decided to make it the next task.

I showed them how to create an online survey using Office 365. Their surveys had to contain at least two graphics and 10 good questions (open ended, multiple choice, or order of importance).

Meanwhile, students continued getting responses from their email recipients and needed to set up interviews with those people. How to write good interview questions became the next mini-lesson. My students were largely unaware of how to interview someone and didn’t realize that the questions they prepared were critical in gaining the evidence they needed to support their proposals.

For example, a group who wanted to expand the school parking lot went from asking broad questions like, “Do you think we need a larger parking lot?” to very specific ones like, “How many accidents have occurred in the parking lot since the school opened?” Most of the interviews were conducted over the phone, but some were in person—one group, with permission from their parents, interviewed members of a local homeless camp.

Students also had to find at least three solid sources and take notes to be embedded in their final product, with correct citations. They found statistics and data to support their proposals, and made sure to address counterarguments.

The Final Products

I gave my students options for their final products. All of them had to contain their survey results, research, and emails and interviews in one form or another. They came up with ideas like a public service announcement, a formal proposal, a bill, a documentary, a photo essay, or a piece of music or art.

I created rubrics and exemplars so students would know what I was expecting. I didn’t want to be too controlling, but I wanted high-quality products. They shared their final products with a variety of authentic audiences, including their congresswoman, our principal, a county supervisor, and our security team.

I gave each group one summative grade, but in the future I plan to split the grade: 70 percent of each student’s grade will be for their group’s work, and 30 percent will be an individual grade based on my observations, students’ self-reflections, and peer reflections.

As students shared their projects and we reflected on the process together, a few things became clear to me. First, I’ll never teach the research paper any other way because the PBL model we used helped develop real-world problem solvers, thinkers, and doers instead of rule followers. I learned that to encourage students to step out of their comfort zones, I too had to step out of mine, but beautiful, authentic learning happens when we create the right conditions for it.

An Experiment- and Project-based Learning Approach to Increase Interest of High School Students for STEM and Enhance Soft Skills of STEM Students

Ieee account.

  • Change Username/Password
  • Update Address

Purchase Details

  • Payment Options
  • Order History
  • View Purchased Documents

Profile Information

  • Communications Preferences
  • Profession and Education
  • Technical Interests
  • US & Canada: +1 800 678 4333
  • Worldwide: +1 732 981 0060
  • Contact & Support
  • About IEEE Xplore
  • Accessibility
  • Terms of Use
  • Nondiscrimination Policy
  • Privacy & Opting Out of Cookies

A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity. © Copyright 2024 IEEE - All rights reserved. Use of this web site signifies your agreement to the terms and conditions.

Help | Advanced Search

Computer Science > Computer Vision and Pattern Recognition

Title: navcot: boosting llm-based vision-and-language navigation via learning disentangled reasoning.

Abstract: Vision-and-Language Navigation (VLN), as a crucial research problem of Embodied AI, requires an embodied agent to navigate through complex 3D environments following natural language instructions. Recent research has highlighted the promising capacity of large language models (LLMs) in VLN by improving navigational reasoning accuracy and interpretability. However, their predominant use in an offline manner usually suffers from substantial domain gap between the VLN task and the LLM training corpus. This paper introduces a novel strategy called Navigational Chain-of-Thought (NavCoT), where we fulfill parameter-efficient in-domain training to enable self-guided navigational decision, leading to a significant mitigation of the domain gap in a cost-effective manner. Specifically, at each timestep, the LLM is prompted to forecast the navigational chain-of-thought by: 1) acting as a world model to imagine the next observation according to the instruction, 2) selecting the candidate observation that best aligns with the imagination, and 3) determining the action based on the reasoning from the prior steps. Through constructing formalized labels for training, the LLM can learn to generate desired and reasonable chain-of-thought outputs for improving the action decision. Experimental results across various training settings and popular VLN benchmarks (e.g., Room-to-Room (R2R), Room-across-Room (RxR), Room-for-Room (R4R)) show the significant superiority of NavCoT over the direct action prediction variants. Through simple parameter-efficient finetuning, our NavCoT outperforms a recent GPT4-based approach with ~7% relative improvement on the R2R dataset. We believe that NavCoT will help unlock more task-adaptive and scalable LLM-based embodied agents, which are helpful for developing real-world robotics applications. Code is available at this https URL .

Submission history

Access paper:.

  • Download PDF
  • HTML (experimental)
  • Other Formats

References & Citations

  • Google Scholar
  • Semantic Scholar

BibTeX formatted citation

BibSonomy logo

Bibliographic and Citation Tools

Code, data and media associated with this article, recommenders and search tools.

  • Institution

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .

IMAGES

  1. (PDF) Using Project-based Learning in Writing an Educational Article

    project based learning research paper

  2. (PDF) Review Project Based Learning

    project based learning research paper

  3. Project-Based Learning Research Review

    project based learning research paper

  4. (PDF) Project-Based Learning

    project based learning research paper

  5. (PDF) The project-based learning approach in a science lesson: a sample

    project based learning research paper

  6. Project-Based Learning and the Research Paper

    project based learning research paper

VIDEO

  1. Research Paper Writing online Workshop

  2. Bachelor of Project Management

  3. Research Methodology Paper Presentation

  4. Workshop on "Research Methodology & Project Writing"

  5. Research paper discussion

  6. What is Project Based Learning PBL?

COMMENTS

  1. The Effectiveness of the Project-Based Learning (PBL) Approach as a Way

    The PBL concept implies collaboration of two or more teachers at a specific level when planning, implementing, and/or evaluating a course (Carpenter et al., 2007), which mainly involves the exchange of training expertise and reflective conversation (Chang & Lee, 2010).It has been shown that the PBL approach provides inexperienced teachers with varied and valuable learning experiences and ...

  2. Project-based learning: A review of the literature

    According to the basic theory of Kirkpatrick's design pedagogy [8] and combined with the continuous optimization of practical teaching, the process of project-based learning is divided into five ...

  3. Project-based learning: A review of the literature

    Project-based learning (PBL) ... A review of research on project-based learning. California: The Autodesk Foundation. Google Scholar. Wrigley T. (2007). Projects, stories and challenges: More open architectures for school learning. ... Project-based learning oriented STEAM: the case of micro-bit paper-cut... Go to citation Crossref Google ...

  4. A review of project-based learning in higher education: Student

    Project-based learning (PjBL) ... that were measured and the instruments that were used to measure these outcomes based on commonly used clustering of learning outcomes and research methods (as used in Brinson, 2015 and Post, Guo, Saab, & Admiraal, 2019). We divided the outcomes into four categories, namely cognitive, affective, behavioral ...

  5. Research paper Core practices for project-based learning: Learning from

    Project-based learning. Project-based learning is a form of student-centered instructional practice that is increasingly being taken up in practice and examined in research (deGraff & Kolmos, 2005; Kokotsaki et al., 2016; Mehta & Fine, 2019). While definitions of project-based learning vary, most share a set of overlapping criteria for ...

  6. A study of the impact of project-based learning on student learning

    1. Introduction. Project-based learning (PBL) is a new model of inquiry-based learning that is centered on the concepts and principles of a subject, with the help of multiple resources and continuous inquiry-based learning activities in the real world, with the aim of producing a complete project work and solving multiple interrelated problems within a certain period of time (Jingfu and ...

  7. PROJECT-BASED LEARNING: A TEACHING APPROACH WHERE ...

    Project-based learning can be defined as "a teaching method in which students work on a project over an extended period of time (from a week up to a semester) that engages them in solving a real ...

  8. Project-based Learning in 21st Century: A Review of Dimensions for

    This paper addresses a combination of theoretical and practical concerns over the implementation of PBL in the university-level teaching and learning context. ... The research utilized a project ...

  9. Key lessons from research about project-based teaching and learning

    For many students, project-based learning (PBL) can be more engaging than more traditional instructional approaches. Over the past 15 years, Anna Saavedra and Amie Rapaport studied seven inquiry-based approaches. Their research shows that PBL has a positive effect on students' achievement and development of important soft skills.

  10. Project-based learning: an analysis of cooperation and evaluation as

    Project-based learning is an active method that develops the maximum involvement and participation of students in the learning process. It requires the teacher to energize the learning scenario by ...

  11. The key characteristics of project-based learning: how teachers

    The aim of this multiple-case study was to research the key characteristics of project-based learning (PBL) and how teachers implement them within the context of science education. K-12 science teachers and their students' videos, learning diaries and online questionnaire answers about their biology related PBL units, within the theme nature and environment, were analysed using deductive and ...

  12. PDF The Evidence is Clear: Rigorous Project-Based Learning is an Efective

    Four newly released peer-reviewed research studies show that using rigorous project-based learning in U.S. public schools has strong and positive effects on student outcomes across grades and subjects. Project-based learning (PBL) is an inquiry-based approach in which students explore real-world problems through individual and group projects.

  13. A case study of student development across project-based learning units

    Numerous theoretical and empirical studies have claimed that project-based learning (PBL) exerts a positive impact on student development. This study explores the development and changes of students across project-based learning units by qualitative research methods. We followed a student group (1 boy and 3 girls) from one class in grade 9 over 3 time points within 1 school year. Classroom ...

  14. A review of teaching and learning approach in implementing Project

    This study delves into the integration of Project-Based Learning (PBL) and Computational Thinking (CT) to enhance 21st century learning. Through a Narrative Literature Review (NLR), pivotal strategies for effective implementation are identified. ... Universiti Kebangsaan Malaysia. Her research interests are in predictive analytics and data ...

  15. A Review of Research on Project-based Learning

    A summary of research on PBL by Center for Excellence in Leadership for Learning at University of Indianapolis indicates that PBL: (a) has a positive effect on student content knowledge and the development of skills such as collaboration, critical thinking, and problem solving; (b) benefits students by increasing their motivation and engagement; and (c) is challenging for teachers to implement ...

  16. New Research Explores the Impact of PBL

    New Research Makes a Powerful Case for PBL. Two new gold-standard studies provide compelling evidence that project-based learning is an effective strategy for all students—including historically marginalized ones. When Gil Leal took AP Environmental Science in his junior year of high school, he was surprised by how different it was from his ...

  17. Project-based learning and its effectiveness: evidence from Slovakia

    In this article, we have examined the effectiveness of teaching economics through project-based learning. For this purpose, we carried out an experiment at secondary schools in the Slovak Republic. We divided 123 students into control and experimental groups. In both groups, teaching was carried out on the same topic by the same teacher in the ...

  18. Promoting deep learning through project-based learning: a design

    In this paper, we present a design solution that involves the bringing together of Project-based Learning (PBL) with the theory of usable knowledge (Pellegrino & Hilton, Developing transferable knowledge and skills in the 21st century, 2012). Usable knowledge is the ability to use ideas to solve problems and explain phenomena, an approach to science learning put forth by the Framework for K-12 ...

  19. PDF Rigorous Project- Based Learning An Inquiry- Based Educational Approach

    This paper describes a research-based professional-learning program designed to support teachers using . the Knowledge in Action (KIA) curriculum, a project- ... Project-based learning is an inquiry-based educational . approach that builds students' capacity to think critically . and problem solve, collaborate and communicate ...

  20. Key Principles for Project-Based Learning

    research findings support a set of project-based learning design principles that ensure PBL is rigorous and will benefit students. This report, an update on a 2015 paper, outlines those design principles and lays out the latest and most robust research underpinning them. Project-based learning (PBL) is an inquiry-based

  21. Project-Based Learning Research Papers

    Project-based learning puts learners in the center of learning process by highlighting the principles, such as critical and creative thinking, problem-solving, teamwork, interpersonal communication, analytical thinking, an evaluation. This teaching approach emphasizes the link between academic and real life.

  22. Project-based learning as an effective method in education

    Project-based learning as a teaching method that involves students in longer-term tasks with shareable end English: English Learning Innovation, 4 (2), 150- 164 153 products (Hanif et al., 2019 ...

  23. Project-Based Learning and the Research Paper

    Students take responsibility for their learning and develop solutions for complex problems when their research paper becomes a PBL unit. In 11th grade, students in my county are expected to generate a research paper or product. In the past, I stuck to the traditional paper, mostly because doing so was comfortable for me as an English teacher.

  24. An Experiment- and Project-based Learning Approach to Increase Interest

    This innovative practice work-in-progress paper presents a combined approach of experiment-based and project-based learning. The motivation and potential benefits are described. Initial experiments are outlined and the positive feedback from the STEM students is shown. The outcome of this approach will be evaluated via student questionnaires before and after participation. A short overview of ...

  25. Value Network Analysis for Facilitator Development in Project-Based

    Abstract. The method enhances Value Network Analysis (VNA) in the context of Project-Based Learning (PjBL). Utilzing the appropriated VNA, facilitators can reflect and continuously improve their learning support in an institutional (learning) setting.

  26. (PDF) Project-based learning

    Project-based learning is a dynamic learning approach, where students actively explore real-world problems, provide challenges, and gain deeper knowledge [13]. In a different view it was stated ...

  27. NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning

    Vision-and-Language Navigation (VLN), as a crucial research problem of Embodied AI, requires an embodied agent to navigate through complex 3D environments following natural language instructions. Recent research has highlighted the promising capacity of large language models (LLMs) in VLN by improving navigational reasoning accuracy and interpretability. However, their predominant use in an ...

  28. Using community-based participatory research to support the development

    The research involved an early learning ... This paper presents the findings of a ten-week research project exploring the intricacies of a co-located intergenerational program in Southeast Queensland. ... Applying Community-Based Participatory Research partnership principles to public health practice-based research networks. SAGE Open, 6(4), 1 ...

  29. Unlocking Astronomical Discoveries: Harnessing Zooniverse ...

    Processing our ever-expanding datasets in astronomy presents a significant challenge to our community. This is particularly true when trying to identify rare or unknown classes of events in these very large data sets. Participatory research, or citizen science, particularly when coupled with machine learning, has emerged as a valuable tool for researchers. However, the availability of free ...