Publications
In this chapter, we address the problem of why blockages occur during mathematization by introducing a method for studying mathematizing based in quantitative reasoning. We report on interview data with six tertiary STEM majors as they developed models of the population dynamics of cats and birds in a backyard habitat. Our analysis focused on real-world relationships participants tried to express when using a given arithmetic operation in a predator–prey modeling task. Our results reveal the conceptions of × participants used to justify their models when constructing an expression for the decrease in the bird population. We conclude by discussing the method’s utility for studying mathematization and with conjectures on how instructors might leverage participants’ justifications to scaffold their emergent models toward a conventionally correct model. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
Self-regulated learning (SRL), or the ability for a learner to monitor and change their cognitive, affective, metacognitive, and motivational processes, is a critical skill to enact, especially while learning about difficult topics within an intelligent tutoring system (ITS). Learners' enactment of SRL behaviors during learning with ITSs has been extensively studied within the human-computer interaction field but few studies have examined the extent to which learners' SRL behaviors quantitatively demonstrate a functional system (i.e., equilibrium of repetitive and novel behaviors). However, current analytical approaches do not evaluate how the functionality of learners' SRL behaviors unfolds as time on task progresses. This paper reviews two analytical approaches, both based within categorical auto-recurrence quantification analysis (aRQA), for examining how learners' SRL complex behaviors emerge during learning with an ITS. The first approach, binned categorical aRQA, segments learners' SRL behaviors into bins and performs categorical aRQA on the SRL behaviors enacted within those bins to produce metrics of complexity that demonstrate how learners' functionality of their SRL systems change over time. The second approach, cumulative categorical aRQA, continuously calculates complexity metrics as learners enact SRL behaviors to identify the evolution of learners' functional SRL. These two approaches allow researchers to identify how the functionality of SRL behaviors change over time in relationship to the occurrences within the ITS environment. From this discussion, we provide actionable implications for contributing to how learners' SRL functionality can be visualized and scaffolded during learning with an ITS.
A key aim for science education is the improvement of scientific reasoning through inquiry-based learning which asks students to think and act like scientists. This requires the regulation of specific skills and abilities such as identifying problems, generating hypotheses and evidence, and drawing conclusions. Goal setting and planning can help learners regulate their learning as they engage with scientific inquiry, especially within investigative exploration. Contemporary work on scaffolds for science inquiry-learning requires we (1) understand how students set goals and plans, (2) measure the quality of goals and plans, and (3) develop adaptive intelligent goal and planning scaffolds. This paper presents the development of a new planning scaffold used by 101 middle school students during interactions with CRYSTAL ISLAND, a game-based learning environment designed to teach students about microbiology and through scientific inquiry. We map student goals and plans from the scaffold to a series of epistemic scientific reasoning activities to use in conjunction with online trace data of student behaviors to analyze student goal setting and planning constructed throughout the game. This study describes the development of an analytical mapping approach between (sub)goals and (sub)activities to measure student plan quality build using a planning scaffold. We report on the use of the scaffold as well as implications for future development of an adaptive and intelligent version of the tool. This work highlights that online-trace data should be contextualized to (sub)goals, and the design of intelligent and adaptive goal and planning tools should be dynamic to account for open-ended exploration that differs across learners.
This work investigates how tutoring discourse interacts with students' proximal knowledge to explain and predict students' learning outcomes. Our work is conducted in the context of high-dosage human tutoring where 9th-grade students (N = 1080) attended small group tutorials and individually practiced problems on an Intelligent Tutoring System (ITS). We analyzed whether tutors' talk moves and students' performance on the ITS predicted scores on math learning assessments. We trained Random Forest Classifiers (RFCs) to distinguish high and low assessment scores based on tutor talk moves, student's ITS performance metrics, and their combination. A decision tree was extracted from each RFC to yield an interpretable model. We found AUCs of 0.63 for talk moves, 0.66 for ITS, and 0.77 for their combination, suggesting interactivity among the two feature sources. Specifically, the best decision tree emerged from combining the tutor talk moves that encouraged rigorous thinking and students' ITS mastery. In essence, tutor talk that encouraged mathematical reasoning predicted achievement for students who demonstrated high mastery on the ITS, whereas tutors' revoicing of students' mathematical ideas and contributions was predictive for students with low ITS mastery. Implications for practice are discussed.
We conducted a 2 x 2 study comparing the digital learning game Decimal Point to a comparable non-game tutor with or without self-explanation prompting. We expected to replicate previous studies showing the game improved learning compared to the non-game tutor, and that self-explanation prompting would enhance learning across platforms. Additionally, prior research with Decimal Point suggested that self-explanation was driving gender differences in which girls learned more than boys. To better understand these effects, we manipulated the presence of self-explanation prompts and incorporated a multidimensional gender measure. We hypothesized that girls and students with stronger feminine-typed characteristics would learn more than boys and students with stronger masculine-typed characteristics in the game with self-explanation condition, but not in the game without self-explanation or in the non-game conditions. Results showed no advantage for the game over the non-game or for including self-explanation, but an analysis of hint usage indicated that students in the game conditions used (and abused) hints more than in the non-game conditions, which in turn was associated with worse learning outcomes. When we controlled for hint use, students in the game conditions learned more than students in the non-game tutor. We replicated a gender effect favoring boys and students with masculine-typed characteristics on the pretest, but there were no gender differences on the posttests. Finally, results indicated that the multidimensional framework explained variance in pretest performance better than a binary gender measure, adding further evidence that this framework may be a more effective, inclusive approach to understanding gender effects in game-based learning.
Since GPT-4's release it has shown novel abilities in a variety of domains. This paper explores the use of LLM-generated explanations as on-demand assistance for problems within the ASSISTments platform. In particular, we are studying whether GPT-generated explanations are better than nothing on problems that have no supports and whether GPT-generated explanations are as good as or better than teacher-authored explanations. This study contributes to existing literature since as of yet, there are no studies on the scale of ASSISTments evaluating the effectiveness of GPT support in education. Should GPT explanations prove effective then we plan to continue developing and evaluating explanations, hints, and other supports with GPT within ASSISTments.
Despite clear links to improving college outcomes, descriptive details about the kinds of student-faculty interactions that are most helpful for STEM students are less well understood. In this qualitative interview study, we investigate what micro-interactions are most helpful – and consequential – for STEM students' persistence and success, especially transfer students. We found that students who experienced positive, caring interactions with at least one faculty member in their major tended to feel more connected to their discipline, had greater confidence in their abilities in STEM, and often put forth more effort in their studies. Transfer students were especially impacted by the quality of care they received from faculty; those who had negative experiences with faculty were often left feeling less capable and discouraged to continue in their STEM discipline. STEM faculty should show interest in students' learning and long-term academic and career goals and provide sufficient availability for one-on-one help.
Impacts of rational number interventions among U.S. students in Grades 3 through 9 with mathematics difficulties are examined using a systematic review and meta-analysis. The primary goal of the meta-analysis was to identify instructional practices that are key drivers of student impacts. From approximately 1,200 published and unpublished study records, we identified 28 studies that met our inclusion criteria and coded the interventions for their instructional practices, intervention characteristics, and study design features. The random-effects mean effect size across all 28 studies (90 effect sizes) was 0.68 (SE = 0.08, p < .001, 95% confidence interval [CI]: [0.51, 0.85]). The 95% prediction interval was -0.36 to 1.8. Using meta-regression techniques, we found the teaching of mathematical language (beta = 0.50) and the use of the number line (beta = 0.47) during intervention to be significantly associated with positive impacts when adjusted for controls. We discuss implications for intervention practice and study limitations along with the challenges of examining complex, multifaceted interventions.
An emergent challenge in geriatric care is improving the quality of care, which requires insight from stakeholders. Qualitative methods offer detailed insights, but they can be biased and have limited generalizability, while quantitative methods may miss nuances. To address these limitations, network-based approaches such as Epistemic Network Analysis (ENA) can bridge the methodological gap. By leveraging the strengths of both methods, ENA provides profound insights into healthcare expert interviews. In this paper, to better understand geriatric care attitudes, we interviewed ten nursing assistants, used ENA to analyze the data, and compared their real-life daily activities with training experiences. A two-sample t-test with a large effect size (Cohen’s d = 1.63) indicated a significant difference between real-life and training activities. The findings suggested incorporating more empathetic training scenarios into the future design of our geriatric care simulation. The results have implications for human-computer interaction and effective nursing training. This is illustrated by presenting an example of using quantitative ethnography to analyze expert interviews with nursing assistants as caregivers and inform subsequent simulation and design processes. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
Students with Learning Disabilities (LDs) can experience classroom challenges that may negatively impact their social and emotional development, and these struggles can put them at risk for mental health issues and lower quality of life. Programs designed to support students with LDs need to consider not only academic skills and accommodations, but also the broader well-being of these students. Among interventions that address holistic student development are mentoring programs that utilize peer mentors (older students who also have LDs). The purpose of this article was to review key literature on the potential benefits of peer mentoring for students with LDs. According to reviewed articles, peer mentoring programs have been implemented in both school and university settings. In addition to conferring academic benefits to mentees, participation in these programs is associated with increased emotional well-being, higher self-esteem, and better communication skills among mentees. These programs may also benefit mentors, but these benefits have been understudied. More research is needed to determine the positive benefits of mentoring for mentors and mentees with similar learning characteristics, above and beyond positive benefits of mentorship in general.


