RESEARCH AND TEACHING
A Systematic Review of Underlying Reasons
Journal of College Science Teaching—July/August 2020 (Volume 49, Issue 6)
By Prateek Shekhar, Maura Borrego, Matt DeMonbrun, Cynthia Finelli, Caroline Crockett, and Kevin Nguyen
An important goal for higher education, particularly for science, technology, engineering, and mathematics (STEM) fields, is ensuring that graduates develop the skills to succeed in the workplace (AAAS, 2010; Freeman et al., 2014; NAE, 2004). One common approach to skill development is to improve student learning in undergraduate STEM courses by using student-centered teaching practices (Jamieson & Lohmann, 2012; Kuh, 2008; NASEM, 2016; Seymour & Hewitt, 1997). While a variety of student-centered teaching practices are noted in the literature such as think-pair-share, group discussions, and project-based learning (Prince, 2004), we use the term “active learning” (AL) to include instruction where students participate in class activities rather than watching the instructor lecture. Recent research has demonstrated that many student-centered teaching practices lead to better learning outcomes and increased student retention in STEM programs (Barnett, 2014; Braxton et al., 2008; Freeman et al., 2014; Haak et al., 2011; Prince, 2004). As a result, there have been calls for the increased use of AL in STEM classrooms across several national platforms (e.g., ASEE, 2012; NSF, 2013; PCAST, 2012; Singer et al., 2012).
Despite evidence on the effectiveness of AL and its benefits for student learning and retention, the adoption of AL among STEM instructors has been slow (Friedrich et al., 2007; Handelsman et al., 2004; Hora et al., 2012; PCAST, 2012; Singer et al., 2012). A number of factors may influence an instructor’s adoption and continued use of AL in the classroom. Some factors serve as positive motivators, such as introducing instructors to positive research on AL, a flexible curriculum that allows for innovation in the classroom, and a community of colleagues with whom to engage during the adoption process (Eddy et al., 2015; Finelli et al., 2014; Froyd et al., 2013; Shekhar & Borrego, 2016b). Other factors can serve as barriers, including familiarity with how to implement AL in the classroom, the limited time available to develop AL practices, and negative student response to AL (Finelli et al., 2014; Froyd et al., 2013; Kiemer et al., 2015).
Although some studies have offered best practices to help improve students’ response to AL (Arum & Roksa, 2011; Borrego et al., 2013; Felder, 2011; Johnson et al., 1991; Lake, 2001; Michael, 2007), we have found little research that systematically examines how negative student response can impact the implementation of AL in the STEM classroom. We address this gap in the literature by reviewing the research on students’ negative response to AL in the STEM classroom. The purposes of our paper are: (1) to identify the types of negative responses to AL that have been published in the literature; (2) to understand the reasons for the negative student response, and; (3) to apply a theoretical lens to explain the mechanisms of negative student response. We identified three relevant theories from the literature on learning, motivation, and instructional change that help explain students negative respond to AL: Expectancy Value Theory, Zone of Proximal Development, and Expectancy Violation Theory. Expectancy Value Theory posits that a student’s choice to participate in an activity is informed by value and competence beliefs (Wigfield & Eccles, 2000). In the context of student response to AL, value beliefs include whether students perceive there to be a benefit in the activities, and competence beliefs include whether students perceive they have the ability to complete the activities. Furthermore, value beliefs include aspects such as students’ perceived usefulness of the activity (utility value) and cost associated with participation in the activity such as loss of time and effort requirements (cost value). Along similar lines, the concepts of Vygotsky’s (1987) Zone of Proximal Development, particularly the idea of scaffolding, offer theoretical insight to the reasons reported for negative student responses to AL (Vygotsky, 1987). In the context of AL, scaffolding can be described as a process of providing support to assist student learning during activities, for example through a process that breaks an activity into smaller steps. This theory implies that, for students to learn effectively through AL, instructors should provide some guidance through the activities to avoid overwhelming them cognitively. Lastly, Expectancy-Violation Theory is the final theory that provides insight into negative student response to AL (Gaffney et al., 2010). This theory argues that students may respond negatively because they expect to be taught using passive, lecture-based teaching methods.
We use 57 published studies identified through a systematic literature review (SLR) to explore how and why students negatively respond to AL and examine our findings in the context of the three theories. Through this analysis, we hope to provide explanations as to why students respond negatively to AL and assist instructors in mitigating students’ negative response to AL. We note that many of the primary studies we cite had an original intention of reporting the learning impacts of AL, but we believe these studies can build knowledge about student response to AL by examining additional empirical evidence presented in the studies, which addresses our aims about student negative response.
The 57 studies analyzed in this paper are a subset of 431 full papers we identified in a SLR about students’ noncognitive response to AL (Borrego et al., 2018; Crockett et al., 2018). The inclusion criteria for our initial search were that a study must: (1) describe an in-class AL intervention, (2) include some systematic data collection on students’ noncognitive response to the intervention, (3) be in an undergraduate STEM classroom, and (4) be published in English between 1990–2015. A librarian helped to define search terms for each inclusion criterion (see ) and to conduct searches on six different databases, including Academic Search Complete, Education Source, ERIC, Compendex, Inspec, and Web of Science. We also solicited studies via relevant STEM education email lists.
Our initial search returned 2,364 studies, which we reduced to 431 qualifying papers based on multiple rounds of screening of both the abstracts and full texts of the papers based on the inclusion criteria. We developed a coding system, which we applied to each of the 431 full papers to document information about basic characteristics of each study (e.g., STEM discipline studied, course level, and the type of AL) and whether the study reported student response to be positive or negative as a result of the AL intervention. Of the 431 papers, 57 studies described negative student responses. Thus, as this paper is focused on understanding students’ negative response, this subset of 57 studies forms the final sample for our analysis.
Finally, we used first and second cycle coding methods to examine the 57 studies for the type of negative student response and reasons behind it (Saldaña, 2010). In the first cycle, four researchers assigned descriptive codes to capture type of negative student response and underlying reasons as reported in the studies. Descriptive codes involve assigning basic labels to summarize the content in the data (Saldaña, 2010). In the second cycle, the first cycle codes were grouped to form overarching categories by two researchers. Specifically, for type of negative student response, students’ noncognitive responses were categorized into three constructs, as described in the literature (Burroughs et al., 1989; Fredricks et al., 2004; Kearney et al., 1991; Seidel & Tanner, 2013; Weimer, 2013): affect, engagement, and evaluation. Affect includes students’ satisfaction toward the course and the type of instruction, the value students perceive in the activities, and students’ overall attitude towards the AL. Engagement includes the extent to which students participate in the activities and their receptiveness to the instruction. Evaluation includes students’ end-of-term course and instructor evaluations gathered through formal or informal methods. For reasons behind negative student response, because the literature does not offer specific constructs, a focused coding approach was used in which the first cycle codes emerging from the studies were categorized based on conceptual similarity to form overarching categories through several iterations and discussions between two researchers (Saldaña, 2010).
The studies presented in this analysis (N = 57) include a range of STEM disciplines, class level, type of AL, and study methodology. The courses ranged from a variety of STEM disciplines—mostly engineering and computer science (N = 29), biology and health sciences (N = 14), mathematics and statistics (N = 7), and physics (N = 7); and from different undergraduate academic levels, including first year (N = 19), second year (N = 11), third year (N = 10), and fourth year (N = 9). The studies represented a breadth of AL types such as working in groups or pairs (N = 43), in-class problem-solving (N = 30), working individually on exercises (N = 19), project or problem-based learning (N = 17), answering questions posed by instructor (N = 14), and discussions (N = 14). In regard to methodology, the studies used quantitative (N = 39), qualitative (N = 4), and mixed methods (N = 14) approaches.
Using the three main categories of student’s noncognitive response—affect, engagement, and evaluation—the most frequently described type of negative student response was affective (N = 43), which was commonly reported as student preferences for different types of instruction, lack of enjoyment, and disinterest in activities. For example, researchers reported that working with other students in a cooperative learning environment diminishes the value of active learning instruction for students (Machemer & Crawford, 2007). The second most common negative student response was engagement (N = 11), and this was reported through nonparticipation in the activities, decreased receptiveness, and lack of student interaction during relevant activities. For instance, in an inquiry-based learning classroom, researchers reported that instructors struggled with “getting students to present their solutions at the board” (Cooper et al., 2012, p. 396). Finally, some studies (N = 8) indicated negative student response on end-of-term student evaluations and other less formal feedback surveys. For example, in the institution’s end-of-course faculty evaluation, 41% students reported that they least liked the AL-based workshops that were included in an organic chemistry course (Rein & Brookes, 2015). The reasons behind these negative responses and the underlying learning and motivation theories are discussed in the section that follows.
We grouped the negative student responses found in our 57 studies into six broad categories (Table 1). The most common category discussed regarding negative response was students’ perception of activities being of limited value to their learning or success in the course. This included student concerns about whether or how AL would help them achieve course learning outcomes, cover important course content, succeed on exams, or achieve a good course grade. The second most-common category included student concerns that activities were time-consuming and inappropriately difficult, and thus increased their workload. The third most-common category was the lack of guidance for AL exercises, including involvement, scaffolding, and facilitation during activities. The fourth most-common category noted logistical issues associated with the use of AL, including technology, classroom layout, class size, and group work issues. Finally, the least common categories (categories five and six) captured students’ unfamiliarity with AL due to prior experience with traditional, lecture-based instruction and students’ feeling unprepared to complete AL exercises due to lack of background knowledge. A full list of studies is provided online.
Reasons behind negative responses. | |||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
In general, the studies we reviewed did not cite theories to explain the reasons students responded negatively to AL; however, we believe that using theory to explain the underlying mechanisms of negative student responses could be an important step in identifying strategies to overcome those negative responses. The associations between the three theories (Expectancy Value Theory, Zone of Proximal Development, and Expectancy Violation Theory) and the six categories established in our systematic literature review are provided in Table 2.
Theories explaining student negative response. | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Expectancy Value Theory (Wigfield & Eccles, 2000) argues that a student’s participation is influenced by how they perceive the usefulness of AL (utility value), time and effort incurred in participation (cost value), and their ability to perform the tasks involved in the AL exercise (competence beliefs). The data from the 57 studies that we coded resonate with these arguments (Table 2). “Perception of limited value” corresponds to utility value, concerns regarding “lack of time, difficulty and increased workload” correspond to cost value, and “lack of guidance” and “lack of student preparation and confidence” address competence beliefs. Framed this way, Expectancy Value Theory explains that students are more likely to respond negatively to AL when they question the value or their ability to complete the activities, and the theory serves as a good framework to both understand the reasons for negative student responses and develop strategies to address those negative responses. This highlights that instructors should be cognizant of aspects of instruction that are valuable to students, namely how active learning is contributing to their learning goals. Future research should focus on identifying factors that instructors should incorporate when developing active learning instruction that add value to participation in active learning exercises for students.
The concept of scaffolding, as described in Vygotsky’s (1987) Zone of Proximal Development, argues that lack of guidance or scaffolding may impede effective student learning in an AL environment (Vygotsky, 1987). Much of the data from the studies that reported negative student resistance can be explained through these ideas (Table 2). Specifically, “lack of guidance” and “unfamiliarity with AL” have connections with the Zone of Proximal Development. For instance, because AL often promotes students taking responsibility for their learning, it is likely that students may negatively respond to AL if appropriate scaffolding is not provided to guide them during the self-directed learning process. Vygotsky’s theory offers a framework for reducing negative student responses by scaffolding AL activities to increase student engagement and learning. This finding also calls for more theoretical and empirical research toward devising heuristics for scaffolding AL to mitigate negative student response.
Expectancy-Violation Theory explains student negative response to AL from an instructional change perspective and argues that negative response is received when AL violates their expectation of receiving a passive lecture (Gaffney et al., 2010). Thus, students may respond negatively because they have an “unfamiliarity with AL” (Table 2). This theory suggests that instructors should take time to align student expectations with the types of activities they should anticipate in class. Of the five studies coded for lack of familiarity, two were studies of SCALE-UP introductory physics courses conducted by the authors of this theory. While this theory may apply in some instructional situations, other studies have concluded that undergraduate students often come with high expectancy of AL instruction (Nguyen et al., 2017). These diverging findings call for more research examining which situations violate students’ expectancies for AL, and when this theory is an appropriate one to apply. Researchers may consider conducting a more granular analysis for different AL techniques (e.g., think-pair-share, self-directed learning, and problem-based learning) and identify the extent by which they violate student instructional expectations in STEM classrooms.
The themes that emerged from the negative types of student response reported in these 57 papers suggest a key opportunity for future work. Negative affect, such as students not believing they can complete an activity or that it is worth their time, represents a common negative response to AL, and delving deeper into the root causes of these responses is an important area for future work. There is some support for this line of study in our previous work on student resistance to AL (Finelli et al, 2018; Tharayil et al, 2018). We considered value (whether time spent on the activities was worthwhile) and positivity (how students felt about the activities and the instructor) as measures of student affect toward AL, and we found that value was a statistically significant positive predictor of participation, distraction, and overall course evaluation, while positivity predicted overall course evaluation (Finelli et al., 2018). This suggests that affective responses such as value and positivity may prove to be mediators between characteristics of the AL instruction and student responses to AL. Thus, learning more about students’ negative affective response to AL, particularly in regard with satisfaction, value, and interest will allow the development of theory-based approaches to directly address affective response. Theories about student learning and motivation may serve as a starting point in future studies that focus on understanding the mechanisms that might trigger negative student responses to AL.
In our own recent research, we identified specific strategies that an instructor can use to improve students’ response to AL (Finelli et al., 2018; Tharayil et al., 2018). We identified two main categories of instructor strategies (explanation and facilitation), and we have evidence that both correlate with lower levels of negative student responses to AL (Finelli et al., 2018). Explanation strategies include describing to students how the activity relates to their learning, as well as making sure students understand how to complete the activity. These align with the theoretical underpinnings of Expectancy Value Theory, which posits increasing students’ perceived value of active learning as one plausible way for mitigating negative response. In the studies reviewed in this paper, the most common reason for negative student responses for AL was students’ perception of limited value, particularly with regard to their learning and success in the course (utility value). Thus, explaining how the activities relate to learning, as well as carefully planning activities that align with graded assignments would help to alleviate this concern (Shekhar & Borrego, 2016a). In addition, the explanation strategy involving communication of overall course expectations for student participation at the beginning of the semester is one way for mitigating negative response due to mismatch in student expectations (Expectancy-Violation Theory) that instructors could use to encourage participation among students who might not have prior experiences with AL.
Facilitation strategies include monitoring students during an activity, carefully planning activities, aligning assessment with activities, and seeking feedback from students about the activities. These strategies fit well with the theories of Zone of Proximal Development and Expectancy Value Theory (cost value), offering remedies for reducing negative response. For example, the second most-common reason for negative student response was that activities were difficult or time-consuming. This could be addressed through the facilitation strategies of carefully planning and scaffolding activities that guide students in their learning. Similarly, the third most-common reason for negative student response was lack of guidance, which can be eliminated through facilitation strategies such as explaining the activity, walking around the room while students are working to answer their questions, and planning activities that scaffold learning by breaking a task into manageable steps (Tharayil et al., 2018).
This study gathered and synthesized empirical data from 57 published studies to support specific theories of negative student response to AL. Although instructors’ perceptions that students will respond negatively to AL is a common barrier to adoption of AL, our systematic literature review found little support for these perceptions; just 57 of 412 studies reported negative responses to AL, and only a few of these negative responses manifested in poor end-of-term course evaluations (reported in 8 of 57 studies, and the smallest category overall). A much more frequently described type of negative student response (43 studies) was affective, including student preferences for different types of instruction, lack of enjoyment, and disinterest in activities. Eleven studies described lack of engagement, such as nonparticipation, decreased receptiveness, and lack of interaction. Because these studies were not conducted to specifically examine students’ negative response, we do not claim that there is a lack of negative response from students. Nonetheless, we reiterate the lack of work examining negative student response to AL in STEM classrooms and call for targeted research in the area.
Within the 57 published studies, we identified six categories of reported reasons for these responses, many of which can be directly addressed by instructors. Several learning and motivation theories help to interpret the results and suggest implications for teaching. Eccles’ Expectancy Value Theory of Motivation suggests that students must perceive value in the activity (i.e., it contributes to learning or earning a good grade) and feel confident they can complete the activity (Wigfield & Eccles, 2000). Vygotsky’s Zone of Proximal Development suggests that AL activities should be scaffolded to challenge students through activities that are somewhat different from what they have seen before, but not entirely unfamiliar (Vygotsky, 1987). Gaffney’s Expectancy Violation Theory suggests that instructors should take time at the beginning of a course to norm student expectations (Gaffney et al., 2010).
Overall, this study replicates and expands the generalizability of prior student resistance studies by finding for example that explanation and facilitation instructor strategies can reduce student resistance to AL, and that students less frequently penalize instructors trying new AL in their end-of-term evaluations less often than feared by instructors (Finelli et al., 2018; Nguyen et al., 2017). Taken together, these results suggest that instructors can, over time, refine their use of AL to provide appropriate supports, explanations, and alignment with assessment and grading to reduce negative student reactions to AL.
Acknowledgment
This project is funded by the U.S National Science Foundation through grant number 1744407. The opinions are those of the authors and do not necessarily represent the National Science Foundation. We thank our collaborators Cynthia Waters, Robyn Rosenberg, Michael Prince, and Charles Henderson for their contributions to this project.
Prateek Shekhar (pshekhar@njit.edu) is an assistant professor of engineering education in the School of Applied Engineering and Technology at the New Jersey Institute of Technology in Newark, New Jersey. Maura Borrego is a professor in the Department of Mechanical Engineering and STEM Education at University of Texas in Austin, Texas. Matt DeMonbrun is a senior statistician and associate director of the Enrollment Management Research Group at Southern Methodist University in Dallas, Texas. Cynthia Finelli is professor of both electrical engineering and computer science and education and director of engineering education research at University of Michigan in Ann Arbor, Michigan. Caroline Crockett is a PhD student in the Department of Electrical Engineering and Computer Science at University of Michigan in Ann Arbor, Michigan. Kevin Nguyen is an assistant professor in the Hutchins School of Liberal Studies at the Sonoma State University in Rohnert Park, California.
Teacher Preparation Postsecondary