Publications
Beetrap-Mc: A Minecraft-Based AI Literacy Tool for Teaching Filter Bubbles to Middle School Students
Recommendation systems shape much of what people, including youth, encounter online, influencing their exposure to information and ideas. Understanding their workings and potential downsides, such as filter bubbles, is increasingly important. At the same time, Minecraft remains one of the most popular and accessible game platforms among students worldwide, making it a promising medium for AI literacy outreach. Building on a previous in-person augmented reality application called BeeTrap, in which players, acting as bees, pollinate flowers and see how similar choices narrow their environment, we created BeeTrap-MC, a Minecraft-based version aimed at broader reach and accessibility. Unlike the original facilitator-led group workshop, BeeTrap-MC is designed for students individual playthrough. We conducted a study with nine middle school participants, using pre-/post-assessments and qualitative interviews to evaluate its effectiveness. Results showed significant learning gains in key AI concepts, such as understanding filter bubbles and their consequences. We also discuss key differences in design, usability and outcomes between BeeTrap-MC and the original, reflecting on trade-offs in adapting a group-based embodied experience into a shorter, self-guided digital format.
Abstract Background Creativity is essential for engineering design, yet its assessment remains challenging due to the resource‐intensive nature of traditional evaluation methods. Purpose/Hypothesis(es) This study investigates the potential of automatic item generation (AIG) using large language models (LLMs) to create psychometrically sound items for the design problem task (DPT), which measures creative thinking in engineering. Design/Method We developed and validated engineering design problems across three domains: ability difference and limitations (e.g., assisting people with learning impairments), transportation and mobility (e.g., reducing traffic congestion in mega cities), and social environments and systems (e.g., improving access to clean water in remote areas). The study comprised three phases with samples matched on race and ethnicity: (1) content validation with a diverse sample of 40 engineers evaluating item clarity and validity; (2) item administration to 462 engineering students; and (3) response evaluation by 65 expert raters assessing originality and effectiveness. Results Results demonstrated that LLM‐generated items achieved comparable or higher content validity rates than expert‐written items (43% vs. 20% success). Bayesian confirmatory factor analysis supported a unidimensional model for fluency, originality, and effectiveness scores, with excellent reliability estimates (.92–.95). While fluency showed minimal correlation with originality ( r = −.11) and effectiveness ( r = −.04), originality and effectiveness were strongly positively correlated ( r = .73). Conclusions The present research advances our understanding of automated assessment generation in engineering education, provides empirical evidence for the psychometric properties of AI‐generated engineering creativity tasks, and offers a scalable approach for measuring creative thinking in engineering classrooms.
This article proposes the Competence Amplification Framework as a theory-informed framework that structures how instructors notice and highlight student competence across phases of teaching: design, surface , and amplify . This framework builds on the teaching strategy assigning competence from Complex Instruction, offering an in-depth structure for attending to competence throughout the teaching and learning process. This article introduces the framework, grounds practices in examples from STEM classrooms, and offers practical guidance for instructors to produce more equitable classrooms by intentionally elevating student status through their instruction.
Abstract The unequal mathematics education system in the U.S. highlights the need to examine racial and ethnic differences in mathematics subjective task values as precursors to participation in mathematics-related careers. We investigated whether and to what extent mathematics subjective task values (i.e., interest, utility, and attainment) vary across the four largest U.S. racial/ethnic groups (i.e., Asian, Black, Latine, and White) among boys and girls, separately. We also tested whether these patterns replicated across high school years and across datasets. Using two U.S. large-scale longitudinal datasets (i.e., CAMP and HSLS), results showed that adolescents of color reported higher mathematics subjective task values than White adolescents, with differences favoring Asian over White adolescents and Black over Latine adolescents. These patterns were consistent across gender, though slightly more pronounced among boys, and replicated across both datasets. The findings demonstrate racial and ethnic variability in mathematics values within gender groups, highlighting the need for intersectional approaches to understanding adolescents' motivational experiences and identifying the barriers that prevent Black and Latine adolescents from fully leveraging their motivational strengths in mathematics learning.
Math anxiety represents a substantial barrier to many students' math learning. In this paper, we apply interdisciplinary perspectives to data on over 13,200 ninth graders and their math teachers from the High School Longitudinal Study. Results suggest that being perceived as dis/abled relates to heightened math anxiety regardless of adolescents' gender, or race and ethnicity. Our intersectional approach reveals that adolescents' expressions of math anxiety do not always correspond with gender, racial, and ethnic stereotypes, with Black girls, Black boys, and Latine boys expressing relatively low levels of math anxiety. Finally, consistent with the principles of inclusion and universal design, placing students into groups of mixed ability is the only teacher approach to grouping that does not relate to high levels of math anxiety for any subgroup of students. With intersectionality and interdisciplinariness the pillars of Disability Studies in Education, this study contributes to critical research approaches and policy considerations.
A framework to move the promotion and tenure process forward, emphasizing more equitable approaches and outcomes.
Does psychological well-being (e.g. life satisfaction, happiness, meaning in life) predict the length of a person's life, or are measures of well-being simply assessing the absence of ill-being (depression, loneliness, sadness) and are therefore redundant with ill-being measures? Individual studies have examined this question by measuring and controlling for both well-being and ill-being, but inconsistent findings have been reported. METHODS: A systematic review and random-effects meta-analysis was conducted on the literature of prospective longitudinal studies linking all-cause mortality to well-being. Studies that controlled for ill-being were compared to studies that did not control for ill-being to identify the unique predictive ability of well-being. Separate effects were estimated for different well-being constructs (e.g., optimism) and study characteristics (e.g., patient population). Publication bias was assessed via sensitivity analyses such as removing outliers, trim-and-fill, and RoBMA. RESULTS: A total of 99 prospective longitudinal studies predicted future all-cause mortality from current measures of well-being and controlled for concurrent measures of ill-being. Overall, well-being predicted significantly lower mortality rates when controlling for ill-being (Hazard Ratio [HR] = 0.86 [0.84-0.88]). This finding was apparent when well-being was operationalized with very different constructs and assessments, ranging from optimism to life satisfaction to perceived social support. The magnitude of this association was highly heterogeneous across studies (I2~0.75) with the 95% Prediction Interval for the Hazard Ratio ranging from 0.72 to 1.04. Findings were robust to methods that adjusted effect sizes for the influence of outlying observations, publication bias, or substantial heterogeneity. Surprisingly, the average effect of well-being on mortality was not any stronger when studies failed to control for ill-being (HR = 0.90 [0.88-0.92]), which suggested that well-being predicted mortality independently of the association with an absence of ill-being. CONCLUSION: These results justify research seeking to evaluate the causal role of a broad range of well-being constructs on longevity because they imply that well-being is not simply a lack of ill-being, but more research is needed to identify the causal impacts and mechanisms of these associations.
This article proposes a genetic algorithm, the array histogram-based sampling algorithm (AHBSA), to assemble linear multidimensional forced-choice questionnaires (MFCQs), which are increasingly popular for measuring personality, with forced-choice items including any number of statements (block size). The algorithm also works for traditional multidimensional Likert and cognitive test forms, where items can be seen as having a block size of one. Real and simulated statement pools are used to evaluate AHBSA's performance in terms of test reliability and running speed in assembling Likert forms and MFCQs with two (pair) and three (triplet) statements. Compared to mixed integer programming (MIP) and random assembly, AHBSA achieves as high or higher reliabilities under all conditions: in Likert forms, AHBSA reaches optimal solutions as MIP does, and in the MFCQs, AHBSA gains notable increases in reliabilities over MIP when the forms have no constraint on item direction (i.e., positively versus negatively keyed statements). AHBSA takes more time to converge than MIP. The findings and limitations are discussed, and suggestions for future work are provided.
Education researchers increasingly analyze heterogeneous, multimodal data with computational tools. Yet, reporting rarely makes explicit who (human or computer) leads meaning-making at different points in the analysis. We introduce a framework for analytic agency that distinguishes three stages, exploration, interpretation, and confirmation, and classifies each as primarily human- or computer-led, as considering stage-level leadership can clarify assumptions in analysis. We demonstrate the framework in a multimodal case study of teacher-student group interactions in high school mathematics classrooms. Using 15 classroom videos from three teachers, we selected 21 student groups and developed a pose-based detector that flags interactions. The pipeline aligned group-level audio and word-level transcripts to each detected window and computed acoustic/prosodic features and large-language-model indicators for question-asking, confusion, help-seeking, and math talk. Across the corpus, the detector surfaced 317 interaction events (M = 15.10 per group, SD = 12.42; mean duration = 32.73s). We compared before, during, and after segments using paired tests and mixed-effects models. Naturally, results for mixed-effects models showed significant shifts in keypoints before-to-during and before-to-after for those emphasized in the detection approach, while audio features showed no significant changes. One transcript indicator, confusion, decreased after interactions (beta = -0.061, p = .049). The pipeline showed preferences for spatial co-presence rather than interaction discourse change, which illustrates how leadership in exploration shaped what became detectable and, consequently, how interpretation proceeded. In the paper's conclusion, we outline hybrid, iterative variants and discuss limitations. Making stage-level agency explicit can help researchers align methodological choices with theoretical aims and produce more transparent, auditable analyses of complex classroom data.
Negative, unwelcoming experiences among queer students in engineering education contribute to the loss of talent in the innovation workforce. Yet, research on such experiences often relies on broad notions of “climate,” limiting its usefulness for identifying institutional levers for change. Based on organizational science, this study employs the integrative climate framework, which identifies domain-specific climates—diversity, authenticity, psychosocial safety, psychological safety, mastery, and performance climate—that shape student outcomes, promote in/equality, and may be especially relevant to students from diverse historically-excluded groups. Purpose: Centering the voices of queer students in engineering doctoral programs and applying the integrative climate framework, we explored how students interpreted signals of domain-specific climates associated with retention, commitment, and satisfaction students perceived in their departments. Approach: We conducted unstructured qualitative interviews with 11 queer students enrolled in engineering doctoral programs at universities throughout the U.S. Interviews elicited informants' descriptions of what they noticed happening or was permitted in their departments. We analyzed transcripts using a framework-guided, deductive thematic approach focused on psychological (i.e., individual-level) climate. Results: Informants' accounts revealed meaning-level themes across six domain-specific climates, in which departmental signals were interpreted as prioritizing productivity and competition over learning and wellbeing, normalizing distress, and rendering voice and vulnerability risky. For queer doctoral students, these interpretations often carried heightened consequences, shaping identity management, uncertainty about available support, and decisions around concealment or disclosure. Conclusions: By foregrounding students' psychological climate perceptions, this study demonstrates how a domain-specific climate approach illuminates institutional dynamics that may be obscured in broader climate framings. Centering queer students as informants highlights how students from historically-excluded groups can offer distinctive insight into how departmental signals around safety, authenticity, performance, and support are interpreted and navigated. Findings suggest that domain-specific climates provide actionable insight for improving equity, inclusion, and student persistence in engineering doctoral programs.


