Publications
Identifying the best model using fit indices is a crucial step in cognitive diagnosis (CD) data analysis. Previous research has examined the performance of popular relative and absolute model fit indices in the context of cognitive diagnosis models (CDMs). However, the effectiveness of these indices under uncommon conditions, such as small sample sizes, remains unclear. Therefore, the primary goal of this study is to investigate the impact of sample size on commonly used model fit indices in CD. Four relative model fit indices, including AIC, BIC, CAIC, and SABIC, and three absolute model fit indices, SRMSR, RMSEA 2, and M 2, were considered. The study also investigates the performance of two general approaches in CD, the generalized DINA (G-DINA) model and the general nonparametric classification (GNPC) method, in contrast to the studied model fit indices. The goal of this part of the study is to explore whether these two general approaches can serve as effective alternatives when the model fit indices do not perform well. Practical guidelines that would be useful for researchers and practitioners were provided based on the simulation results under various conditions. Additionally, a real data analysis was conducted to demonstrate the practical utility of the study.
Apprenticeship learning (AL) aims to induce decision-making policies by observing and imitating expert demonstrations.Existing AL approaches typically rely on online interactions and assume that the demonstrations follow a single reward function.Nevertheless, in real-world human-centric applications, policies are usually learned in an offline setting, with the demonstrations driven by multiple reward functions that evolve over time.To address these challenges, we introduce a novel AL framework: Time-aware Hierarchical EM Energy-based Sub-trajectory (THEMES) clustering.We evaluate the effectiveness of THEMES in two challenging human-centric domains -healthcare and education.Our experimental results across multiple datasets demonstrate that THEMES can accurately induce policies, outperforming competitive baselines and ablations, demonstrating its potential for tackling a broad range of complex, real-world human-centric tasks.
Abstract This article features a theoretical example—a seemingly simple example that possesses, nonetheless, the potential to advance theory. Since the example radiates with the glow of silence and movement, it resists conventional analysis. Using words and images to trouble the grammar of an orderly world with hierarchal relations and depersonalized language commonly found in conventional analyses, the article aligns with a grammar of animacy to follow the agentive, sensorial, and relational encounter between an elementary student and the secret life of fractions and geometry concepts. The article offers two-way implications for research and practice, namely: (a) “what's in it that could have an effect on my research” and (b) “how am I implicated in the effect of my own research.”
Creativity is a fundamental ability of humans, vital to most domains of work and art. With the rising popularity of generative AI, research is needed to determine its costs and benefits for human creativity. We conducted a naturalistic study with university students (N = 263) who wrote short-stories with and without the help of ChatGPT. Stories written with AI assistance were significantly more original, but also more semantically similar to each other (i.e., less diverse). Critically, using a novel analysis of participant-AI interactions, we found that benefits in story originality were specifically predicted by engagement in idea generation with ChatGPT (prompting the AI to provide new story concepts, plot elements, or character ideas), but not idea elaboration (asking the AI to refine, reframe, or evaluate previously generated ideas). Additionally, we found that incorporating AI-generated content into the stories directly correlated with increased originality. Our findings suggest that AI-driven benefits depend on active engagement specifically focused on idea generation, although AI collaboration can limit idea diversity.
Computational modeling of scientific systems is a powerful approach for fostering science and computational thinking (CT) proficiencies.However, the role of programming activities for this synergistic learning remains unclear.This paper examines alternative ways to engage with computational models (CM) beyond programming.Students participated in an integrated Science, Engineering, and Computational Modeling unit through one of three distinct instructional versions: Construct a CM, Interpret-and-Evaluate a CM, and Explore-and-Evaluate a simulation.Analyzing 188 student responses to a science+CT embedded assessment task, we investigate how science proficiency and instructional versions related to pseudocode interpretation and debugging performances.We found that students in the Explore-and-Evaluate a simulation outperformed students in the programming-based versions on the CT assessment items.Additionally, science proficiency strongly predicted students' CT performance, unlike prior programming experience.These results highlight the promise of diverse approaches for fostering CT practices with implications for STEM+C instruction and assessment design.
Abstract Mathematical modeling is challenging for learners across all grade bands. Given its crucial role in STEM education, it is essential for the field to design learning environments that foster the optimal learning of modeling. One promising strategy is to support the learning of modeling as conceiving a situation consisting of quantities and quantitative relationships. However, before promoting the learning of modeling in this way, the field first needs accounts of how quantitative reasoning is present in students' mathematical modeling activities. Drawing data from individual teaching experiments with three undergraduate STEM majors, we analyzed the ways in which reasoning with quantities manifest as they mathematically modeled dynamic situations. Through our analysis, we illustrate eight types of manifestations, making explicit connections between the modeling activities and participants' reasonings with quantities during each manifestation. Our findings indicate that learners' modeling activities are afforded through their reasonings with quantities and suggest that students' quantitative reasoning can be leveraged to support the learning of mathematical modeling.
Abstract The unequal mathematics education system in the U.S. highlights the need to examine racial and ethnic differences in mathematics subjective task values as precursors to participation in mathematics-related careers. We investigated whether and to what extent mathematics subjective task values (i.e., interest, utility, and attainment) vary across the four largest U.S. racial/ethnic groups (i.e., Asian, Black, Latine, and White) among boys and girls, separately. We also tested whether these patterns replicated across high school years and across datasets. Using two U.S. large-scale longitudinal datasets (i.e., CAMP and HSLS), results showed that adolescents of color reported higher mathematics subjective task values than White adolescents, with differences favoring Asian over White adolescents and Black over Latine adolescents. These patterns were consistent across gender, though slightly more pronounced among boys, and replicated across both datasets. The findings demonstrate racial and ethnic variability in mathematics values within gender groups, highlighting the need for intersectional approaches to understanding adolescents' motivational experiences and identifying the barriers that prevent Black and Latine adolescents from fully leveraging their motivational strengths in mathematics learning.
Spatial skills are critical for learning in STEM areas and are affected by spatial anxiety and working memory. Prior work also showed that there are interaction effects between spatial anxiety and verbal working memory (WM) on spatial skills, such that the negative relation between spatial anxiety and spatial skills is stronger among higher- than lower-verbal WM children. To date, this interaction effect has not been found for visuospatial WM. However, a recent meta-analysis showed that both verbal WM and visuospatial WM are impaired by anxiety to a similar extent. The current study hypothesized that visuospatial WM interacts with spatial anxiety on spatial skills and that this interaction effect gets stronger as age increases. We investigated spatial anxiety, visuospatial WM, and two spatial skills (mental transformation and mental rotation) in 402 U.S. children in first to fourth grades. We found a significant three-way interaction of spatial anxiety, visuospatial WM, and grade level on mental transformation skill: only fourth-graders with high visuospatial WM showed a significant relation between spatial anxiety and lower mental transformation skills, whereas low-visuospatial WM fourth-graders and children in Grades 1 to 3 did not show this relation. However, this effect was not significant for children's mental rotation skills. We discuss the results in terms of age-related differences in visuospatial WM and strategy use, as well as differences between the mental transformation and mental rotation tasks. Our findings indicate that the interaction effect between spatial anxiety and working memory on spatial skills extends beyond verbal WM to visuospatial WM and becomes more pronounced as children's age increases.
Decades of research show that tests, beyond assessing student knowledge, are powerful tools for promoting learning. However, high-stakes tests can also cause stress and disengagement. To utilize tests to encourage and motivate students, we implemented a mastery-based testing system in a large-enrollment general chemistry course (N = 234). This system allowed students to take three versions of each unit test, studying digital course resources in between to increase their mastery of the content. Students chose to take advantage of the mastery testing system when they struggled with unit tests, averaging six total repeated attempts. This level of repeated testing was associated with a 60% increase in students' use of online study resources over the duration of the course, and a five-point overall increase in final exam scores (11 points for first-generation college students). Critically, student engagement with digital learning materials mediated these performance gains, suggesting that the benefits of mastery-based testing systems were not only due to students responding to the tests themselves. Instead, the findings suggest that mastery-based testing systems can enhance performance in introductory STEM courses by providing motivation and structure to support students' self-regulated learning, helping them invest more time in effective, distributed study strategies. • With mastery-based testing, students chose to repeat exams when they struggled • Repeating tests was linked to an increase in use of online study resources • Repeating tests was linked to higher final exam grades, especially for first-gen students • Mastery-based testing may support self-regulated learning in STEM courses
Although crucial for mathematical problem solving and long-term STEM achievement, visuospatial skills remain a significant challenge for many students in the United States. Therefore, it is critical to explore how spatial skill interventions can be integrated into mathematics curriculum. This research examines the effects of Project VisMO, a hands-on, origami-based curriculum and after-school program, on elementary school children's visuospatial skills, mathematical competencies, and mathematics anxiety and attitudes. An initial randomized control trial (RCT) of the online VisMO program, conducted during the COVID-19 pandemic with 179 elementary students, demonstrated promising results in enhancing spatial vocabulary and reducing mathematics anxiety. Two follow up studies of the VisMO program were conducted, featuring a 5-week and a 12-week intervention. Both studies confirmed improvements in spatial vocabulary, a reduction in math anxiety, and potential geometry gains. We discuss the need for further research on the in-person program and the importance of designing structured professional development for educators to enhance their self-efficacy and knowledge of incorporating visuospatial interventions into their teaching.


