Publications
Gaming the system, characterized by attempting to progress through a learning activity without engaging in essential learning behaviors, remains a persistent problem in computer-based learning platforms. This paper examines a simple intervention to mitigate the harmful effects of gaming the system by evaluating the impact of immediate feedback on students prone to gaming the system. Using a randomized controlled trial comparing two conditions - one with immediate hints and feedback and another with delayed access to such resources - this study employs a Fully Latent Principal Stratification model to determine whether students inclined to game the system would benefit more from the delayed hints and feedback. The results suggest differential effects on learning, indicating that students prone to gaming the system may benefit from restricted or delayed access to on-demand support. However, removing immediate hints and feedback did not fully alleviate the learning disadvantage associated with gaming the system. Additionally, this paper highlights the utility of combining detection methods and causal models to comprehend and effectively respond to students ' behaviors. Overall, these findings contribute to our understanding of effective intervention design that addresses gaming the system behaviors, consequently enhancing learning outcomes in computerbased learning platforms.
Reforming instruction is challenging. In this comparative case study of 12 school districts, we investigated the dilemmas that emerged for system leaders as they engaged in system building for elementary science and the approaches leaders took in managing them. We found that system leaders' efforts to manage their environments contributed to the preferential treatment of literacy and mathematics relative to science. Leaders managed this dilemma using three strategies: (a) integration of science with other subjects, (b) specialization of teachers, and (c) adopting curriculum materials. This study contributes to literature on dilemma management by showing that dilemmas in education system building are school-subject sensitive, emerge in relation to system building for other subjects, and are embedded in school and education systems' structural/organizational arrangements.
Numerous studies aim to enhance learning in digital environments through emotionally-sensitive interventions. The D'Mello and Graesser (2012) model of affect dynamics hypothesizes that when a learner encounters confusion, the degree to which it is prolonged (and transitions into frustration) or resolved, significantly affects their learning outcomes in digital environments. However, studies yield inconclusive results regarding relations between confusion, frustration, and learning. More research is needed to explore how confusion and frustration manifest during learning and its relation to outcomes. We go beyond past work looking at the rate, duration, and transitions of confusion and frustration by treating these affective states as non-linear dynamical systems consisting of expressive and behavioral components. We examined the frequency and recurrence of facial expressions associated with basic emotions (as automatically labeled by AffDex, a standard tool for analyzing emotions with video data) during confused and frustrated states (as automatically labeled with BROMP-based detectors applied to students' interaction data). We compare these co-occurring patterns to learning outcomes (pre-tests, post-tests, and learning gains) within a digital learning environment, Betty ' s Brain. Results showed that the frequency and recurrence rate of basic emotions expressed during confusion and frustration are complex and remain incompletely understood. Specifically, we show that confusion and frustration have different relationships with learning outcomes, depending on which basic emotion expressions they co-occur with. Implications of this study open avenues for better understanding these emotions as complex and non-linear dynamical systems, in the long-term enabling personalized feedback and emotional support within digital learning environments that enhance learning outcomes.
Several widely used high school biology texts depart from established science
Students with strong metacognitive skills are positioned to learn and achieve more than peers who are still developing their metacognition. Yet, many students come to college without well-developed metacognitive skills. As part of a longitudinal study on metacognitive development, we asked when, why, and how first-year life science majors use metacognitive skills of planning, monitoring, and evaluating. Guided by the metacognition framework, we collected data from 52 undergraduates at three institutions using semi-structured interviews. We found that first-year students seek study recommendations from instructors, peers, and online resources when they plan their study strategies. First-year students struggle to accurately monitor their understanding and benefit when instructors help them confront what they do not yet know. First-year students evaluate the effectiveness of their study plans at two specific points: immediately after taking an exam and/or after receiving their grade on an exam. While first-year students may be particularly open to suggestions on how to learn, they may need help debunking myths about learning. First-year students acknowledge they are still learning to monitor and welcome formative assessments that help them improve the accuracy of their monitoring. First-year students may be primed to receive guidance on their metacognition at the points when they are most likely to evaluate the effectiveness of their study strategies and plans. Based on our results, we offer suggestions for instructors who want to support first-year students to further develop their metacognition.
Gesture has been shown to play an important role in how learners conceptualize phenomena in physics. However, we know little about how gesture is used to conceptualize instantaneity. Drawing on multimodal microanalysis of interaction, we examine how undergraduate physics students use representational gesture to make sense of instants while modeling energy dynamics. Our analysis describes four different forms of representational gesture used to capture instantaneity: These include (1) Replay loop of scenario, (2) Subinterval on timeline, (3) Freeze frame of scenario, and (4) Indexical location on timeline.
Gesture’s role as a powerful and versatile tool for instruction, especially in STEM domains, is well-established. However, many specific teaching moves accomplished through gesture remain understudied. Using interaction analysis, we examine how an introductory. university physics instructor uses gesture during whole-class discussion of graphical representations of energy conservation to synthesize multiple student groups’ solutions. This embodied, whole-class discussion orchestration move distills and summarizes the key points of the lesson while highlighting student contributions and addressing misunderstandings.
Successful problem-based learning (PBL) often requires students to collectively regulate their learning processes as a group and engage in socially shared regulation of learning (SSRL). This paper focuses on how facilitators supported SSRL in the context of middle-school game-based PBL. Using conversation analysis, this study analyzed text-based chat messages of facilitators and students collected during gameplay. The analysis revealed direct modeling strategies such as performing regulative processes, promoting group awareness, and dealing with contingency as well as indirect strategies including prompting questions and acknowledgment of regulation, and the patterns of how facilitation faded to yield responsibilities to students to regulate their own learning. The findings will inform researchers and practitioners to design prompts and develop technological tools such as adaptive scaffolding to support SSRL in PBL or other collaborative inquiry processes.
Young learners today are constantly influenced by AI recommendations, from media choices to social connections. The resulting "filter bubble" can limit their exposure to diverse perspectives, which is especially problematic when they are not aware this manipulation is happening or why. To address the need to support youth AI literacy, we developed "BeeTrap", a mobile Augmented Reality (AR) learning game designed to enlighten young learners about the mechanisms and the ethical issue of recommendation systems. Transformative Experience model was integrated into learning activities design, focusing on making AI concepts relevant to students’ daily experiences, facilitating a new understanding of their digital world, and modeling real-life applications. Our pilot study with middle schoolers in a community-based program primarily investigated how transformative structured AI learning activities affected students’ understanding of recommendation systems and their overall conceptual, emotional, and behavioral changes toward AI.


