Publications
Chemistry assessments shape not only what students know, but how they interpret what kinds of reasoning are valued. For multilingual learners (MLs), linguistic complexity in assessment items can constrain access to epistemological resources, masking conceptual understanding. This study examines how undergraduates' epistemological framing and resource activation are influenced by linguistic features of stoichiometry items, with attention to language background. We introduce translinguistic framing, an epistemological frame describing how MLs orient to disciplinary tasks by coordinating linguistic and semiotic resources. We conducted semi-structured think-aloud interviews with 40 undergraduates (23 English monolingual, 17 multilingual) in an introductory chemistry course at a research-intensive U.S. university. Participants examined stoichiometry item pairs combining original and linguistically revised versions. Using Hammer and Elby's (2003) epistemological resources framework, we analyzed how students framed each task and what knowledge they drew upon. Findings reveal three interrelated frames—answer-making, sensemaking, and translinguistic framing—flexibly activated depending on item design, time constraints, and linguistic load. MLs faced barriers when chemistry terminology differed from classroom language, often shifting to symbolic or procedural representations. Emotional and strategic stances, including anxiety and time-aware strategizing, further mediated resource activation, limiting conceptual engagement. Translinguistic framing, in contrast, enabled MLs to sustain disciplinary reasoning by integrating first-language terms, English keywords, and symbolic notation. This study expands models of epistemological framing by highlighting an epistemic dimension of science assessment. Implications for equitable assessment design include minimizing unnecessary linguistic complexity, offering multimodal scaffolds, and recognizing translinguistic framing as a legitimate epistemological stance supporting opportunities to demonstrate conceptual understanding.
Abstract The ability to generalize and apply knowledge to new situations is the hallmark of effective learning. There are multiple ways to improve learning towards generalization. Retrieval practice and worked examples have both been shown to improve learning, retention, and generalization. The literature on category learning also suggests that exposure to more varied examples, rather than the same example repeatedly, improves generalization. However, while retrieval practice is usually investigated with repeated items, worked examples are usually investigated using varied content. Across two experiments, we investigated how combining content variability with worked examples or retrieval practice promoted generalization when learners received initial instruction before practice (Experiment 1) and when they did not (Experiment 2). We found that when learners received initial instruction, retrieval practice led to better generalization than worked examples, regardless of whether the stimuli were repeated or varied. When initial instruction was not provided, worked examples resulted in better generalization than retrieval practice when items were repeated. However, retrieval practice produced comparable generalization to worked examples when items were varied. These findings suggest that variability supports generalization, particularly when learners must induce underlying rules, and that retrieval practice, traditionally associated with memory retention, can also facilitate inductive learning when applied to varied items. This study emphasizes the importance of adapting learning strategies to align with the instructional context and task demands.
Intelligent tutoring systems are known for providing customized learning opportunities for thousands of users. One feature of many systems is differentiating the amount of practice users receive. To do this, some systems rely on a threshold of consecutive correct responses. For instance, Khan Academy used to use ten correct in a row and now uses five correct in a row as the mastery threshold. The present research uses a series of randomized control trials, conducted in an online learning platform (eg., ASSISTments.org), to explore the effects of different thresholds of consecutive correct responses on learning. Results indicate that despite spending significantly more time practicing there is no significant difference on learning between two, three, four, or five consecutive correct responses. This suggests that systems, and MOOCS, can employ the simple rule of two or three consecutive correct responses when determining the amount of practice provided to users.
Social-emotional competencies are important for school-readiness and can be supported through social-emotional learning (SEL) interventions in the preschool years. However, past research has demonstrated mixed efficacy of early SEL interventions across varied samples, highlighting a need to unpack the black box of which early interventions work, under what conditions, and for whom. In the present article we discuss the critical implementation component of active child engagement in an intervention as a potential point of disconnect between the intervention as designed and as implemented. Children who are physically present but unengaged during an intervention may lead to decreased average impacts of an intervention. Furthermore, measuring young children's active engagement with an intervention may help to guide iterative intervention development. We propose a four-step protocol for capturing the multi-dimensional and varied construct of active child engagement in a SEL intervention. To illustrate the utility of the protocol, we apply it to data from a pilot study of a researcher-implemented, semi-structured block play intervention focused on supporting the development of SEL and math skills in preschoolers. We then present future directions for the integration of active participant engagement into the measurement of implementation of SEL interventions for young children.
Abstract This research investigates interrelated dimensions, dynamics, and context influences of group disciplinary engagement (GDE). Quality ratings were assigned for five GDE dimensions to 2.5-minute segments, from video drawn from three different middle school science and mathematics curriculum contexts. Dynamic structural equation modeling was employed to analyze the interrelationships and changes in group engagement quality and the role of contextual moderators. Results indicated positive interrelations among all engagement dimensions, save socioemotional engagement, suggesting a mutually supportive relationship. Temporally, disciplinary engagement (DE) had a key role as a positive predictor of collaborative, disciplinary, and behavioral engagement. Open tasks were associated with higher DE, while simulations fostered metacognitive engagement. This study has implications for understanding the complexity of GDE patterns as contextually situated.
Elementary students with learning disabilities (LDs) often have limited opportunities to learn science, and little is known about how special educators engage in science instruction. This study drew on a nationally representative survey of elementary special education teachers to describe their roles, preparedness, time allocation, and perceived barriers. Most teachers reported minimal discipline-specific preparation and felt less prepared to teach science than other subjects. Many noted that students with LDs often missed science classes because of pull-out instruction. Common barriers to students receiving science instruction included remediation priorities and accountability pressures in tested subjects. These findings provide a national snapshot of science instruction for elementary students with LDs and point to the need for greater teacher preparation and policy support to ensure access to high-quality science learning for students with LDs.
Cognitive diagnostic models (CDMs) have become essential tools for providing fine-grained information about individuals' mastery of cognitive skills. While prior reviews have emphasized statistical foundations and deep learning-based developments, this article focuses on recent methodological innovations designed to address persistent challenges in applying CDMs across various contexts. We highlight six areas of advancement: (1) extending models to accommodate polytomous attributes, thereby capturing multiple levels of proficiency; (2) discovering attribute relationships to reveal learning trajectories and support instructional design; (3) accelerating estimation through computational strategies that enable scalability to high-dimensional attributes; (4) improving estimation in small-sample contexts, particularly relevant for classroom applications; (5) refining and estimating Q-matrices through both statistical and machine learning approaches; and (6) evaluating model and item fit. Together, these methodological developments enhance the interpretability, efficiency, and applicability of CDMs, broadening their utility in various types of assessment, larger or smaller scales. The review complements existing surveys by emphasizing innovations that directly address application barriers, and it points to promising future directions including integration with deep learning and large language models.
Using rich data on Chinese schoolchildren, we study the relationships of IQ and personality traits with children's risk preferences and how they affect the precision with which those preferences are measured.Our structural model separates preferences from deliberation noise and guessing, and relates guessing to deliberation noise.Psychological measures have weak direct influences on preferences but strongly affect deliberation noise and guessing behavior.Shocks to choice have persistent individual-specific components and are not independent.Socioeconomic background has little direct influence on preferences or deliberation noise once traits are accounted for.Background variables affect psychological traits, however.Risk preferences differ across and within genders.For small gambles, girls are less risk averse than boys, but the opposite holds for larger gambles.
This paper introduces an approach to measurement that positions context and situativity as an intrinsic part of the measurement model in a manner compatible with the learning sciences' view of learning as a transactive process within a broader sociocultural ecosystem.This approach relies on a mixed methods approach to measurement in which qualitative data are integrated into a moderated nonlinear factor analytic (MNLFA) framework.Using data from a longitudinal student of Ph.D. students in the biological sciences, we demonstrate that sensemaking context elicited through interview data could be incorporated directly into the model to enhance the comparability of scale scores collected across multiple timepoints.On multiple items that demonstrated item parameter drift (IPD) without moderation, the inclusion of a relevant idiographic contextual variable permitted the fitting of a moderated model that eliminated IPD.
Abstract The “leaky pipeline” is the oft-used metaphor to characterize the loss of STEM students in the progression from high school through college and into the labor force. This view of STEM education—which posits a unidirectional flow out of STEM fields—is both pervasive and influential in K-12, higher education, and workforce development policy. But there has been limited empirical support for this claim that “leaving STEM” is unidirectional and reduces the size of the STEM cohort. This study analyzes two cohorts in nationally representative, longitudinal surveys of four-year college students to examine freshman-to-bachelor's degree pathways. We find that although a third of STEM-intending freshmen leave STEM fields and graduate in non-STEM majors, the size of the STEM graduating class is larger than the freshmen STEM class in the two cohorts of bachelor's degree graduates. STEM graduates in both cohorts are comprised of large shares of students who did not initially declare a STEM major: just under 20% of graduates first began as non-STEM majors and were “late entrants” in STEM. Thus, rather than a leaky pipeline, STEM disciplines appear to be a two-way street, with many students attracted into STEM fields during college. The findings suggest that the dominant focus on STEM retention should be broadened to consider STEM “attraction” during college, since a large share of STEM graduates begin college as non-STEM and undeclared majors.


