Publications
This Brief Report presents an example of assessment validation using an argument -based approach. The instrument we developed is a Brief Assessment of Students' Mature Number Sense, which measures a central goal in mathematics education. We chose to develop this assessment to provide an efficient way to measure the effect of instructional practices designed to improve students' number sense. Using an argument -based framework, we first identify our proposed interpretations and uses of student scores. We then outline our argument with three claims that provide evidence connecting students' responses on the assessment with its intended uses. Finally, we highlight why using argument -based validation benefits measure developers as well as the broader mathematics education community.
We ask if participants in a choice experiment with repeated presentation of the same menus and no feedback provision: (i) exhibit overall behaviour that is consistent with ordinal and expected utility theory under *weak* preferences; (ii) become more consistent with the predictions of these theories under *strict* preferences.To answer these questions we designed and implemented a free-choice lab experiment with 15 distinct menus. Each menu contained two, three and four lotteries with three monetary outcomes, and was shown five times. Subjects could avoid/defer making active choices at a positive expected cost. Among our 308 subjects from the UK and Germany, significantly more were compatible with ordinal and expected utility maximization in their last 15 than in their first 15 identical decision problems. Around a quarter and a fifth of all subjects, moreover, were compatible with those modes *throughout* the experiment, with nearly half of these under weak preferences. Choice consistency is positively correlated with cognitive ability, and subjects who converged to utility-maximizing behaviour were more cognitively able than those who did not. We discuss potential implications of our study's novel set of findings.
Generalizing is a critical aspect of mathematics learning, with researchers and policy documents highlighting generalizing as a core mathematical practice. It can also be challenging to foster in class settings, and teachers need access to better resources to teach generalizing, including an understanding of effective forms of instruction. This article proposes Classroom Supports for Generalizing (CSGs), investigating how multiple elements—such as tasks, teacher moves, student interactions, and representations—interact to meaningfully foster student generalizing. Drawing on class video data from a middle school teacher and two high school teachers, we present the CSG Framework, which identifies three categories of supports: Interactions for Generalizing, Structures for Generalizing, and Routines for Generalizing. © 2023 by The National Council of Teachers of Mathematics, Inc.
Educational games enhance learning experiences by integrating touchscreens, making interactions more engaging and intuitive for learners. However, the cognitive impacts of educational gameplay input modalities, such as the hand and stylus technique, are unclear. We compared the experience of using hands vs. a stylus for touchscreens while playing an educational game by analyzing oxygenated hemoglobin collected by functional Near-Infrared Spectroscopy and self-reported measures. In addition, we measured the hand vs. the stylus modalities of the task and calculated the relative neural efficiency and relative neural involvement using the mental demand and the quiz score. Our findings show that the hand condition had a significantly lower neural involvement, yet higher neural efficiency than the stylus condition. This result suggests the requirement of less cognitive effort while using the hand. Additionally, the self-reported measures show significant differences, and the results suggest that hand-based input is more intuitive, less cognitively demanding, and less frustrating. Conversely, the use of a stylus required higher cognitive effort due to the cognitive balance of controlling the pen and answering questions. These findings highlight the importance of designing educational games that allow learners to engage with the system while minimizing cognitive effort.
Women and girls are underrepresented in many, though not all, STEM (science, technology, engineering and mathematics) fields around the world. In this Review, we describe four key factors that help explain the continued underrepresentation of women in STEM. In many parts of the world, women lack access to education and job opportunities, preventing them from pursuing STEM. In places where women do have educational and professional opportunities, masculine cultures - shaped by both masculine defaults and differential treatment - can hinder entry and retention of women in STEM fields. Addressing masculine cultures is important to increase the representation of women, and research has identified multiple promising avenues for intervention. When masculine cultures remain, gender disparities can be reduced by increasing the positive experiences of women and girls in STEM. Finally, choices made by men to enter some STEM fields also contribute to the underrepresentation of women in these fields. We conclude by reviewing promising future directions for research on gender disparities in STEM, including examining the intersections of these factors, sociopolitical and economic contexts, and the experiences of trans and non-binary individuals and people with multiple marginalized identities in STEM. Women remain underrepresented in some STEM fields throughout much of the world. In this Review, Cheryan and colleagues discuss four factors that might explain this underrepresentation - access to education and employment, masculine cultures, insufficient positive experiences, and men's choices - and interventions that might help reduce these disparities.
The visual modality is central to both reception and expression of human creativity. Creativity assessment paradigms, such as structured drawing tasks Barbot (2018), seek to characterize this key modality of creative ideation. However, visual creativity assessment paradigms often rely on cohorts of expert or naive raters to gauge the level of creativity of the outputs. This comes at the cost of substantial human investment in both time and labor. To address these issues, recent work has leveraged the power of machine learning techniques to automatically extract creativity scores in the verbal domain (e.g., SemDis; Beaty & Johnson 53, 757-780, 2021). Yet, a comparably well-vetted solution for the assessment of visual creativity is missing. Here, we introduce AuDrA - an Automated Drawing Assessment platform to extract visual creativity scores from simple drawing productions. Using a collection of line drawings and human creativity ratings, we trained AuDrA and tested its generalizability to untrained drawing sets, raters, and tasks. Across four datasets, nearly 60 raters, and over 13,000 drawings, we found AuDrA scores to be highly correlated with human creativity ratings for new drawings on the same drawing task (r = .65 to .81; mean = .76). Importantly, correlations between AuDrA scores and human raters surpassed those between drawings' elaboration (i.e., ink on the page) and human creativity raters, suggesting that AuDrA is sensitive to features of drawings beyond simple degree of complexity. We discuss future directions, limitations, and link the trained AuDrA model and a tutorial (https://osf.io/kqn9v/) to enable researchers to efficiently assess new drawings.
While research has shown that students benefit from student-centered pedagogies, few studies have considered the benefits of this pedagogical approach for educators as they learn through teaching. In response to this need, we analyzed interviews, lesson plans, and video observations from five teachers in elementary schools across the United States who varyingly engaged student-centered and teacher-centered pedagogies. Our analyses revealed that the participating teachers developed a wide breadth of teacher knowledge regardless of their pedagogical approach. However, the teachers who employed student-centered teaching reported more pedagogical content knowledge gains for themselves than the teachers who used direct teaching.
This paper presents a novel spatiotemporal transformer network that introduces several original components to detect actions in untrimmed videos. First, the multi-feature selective semantic attention model calculates the correlations between spatial and motion features to model spatiotemporal interactions between different action semantics properly. Second, the motion-aware network encodes the locations of action semantics in video frames utilizing the motion-aware 2D positional encoding algorithm. Such a motion-aware mechanism memorizes the dynamic spatiotemporal variations in action frames that current methods cannot exploit. Third, the sequence-based temporal attention model captures the heterogeneous temporal dependencies in action frames. In contrast to standard temporal attention used in natural language processing, primarily aimed at finding similarities between linguistic words, the proposed sequence-based temporal attention is designed to determine both the differences and similarities between video frames that jointly define the meaning of actions. The proposed approach outperforms the state-of-the-art solutions on four spatiotemporal action datasets: AVA 2.2, AVA 2.1, UCF101-24, and EPIC-Kitchens.
The pandemic of coronavirus disease 2019 (COVID-19) has severely affected the higher education system since Spring 2020. During the periods of school closures and limited in-person activities, engineering students and faculty experienced challenges in remote learning and mentoring activities. Funded by the National Science Foundation (NSF), this study surveyed 668 faculty and 3,385 undergraduate/graduate students in engineering from 94 institutions in 36 states across the country. Our findings indicated that several faculty and student subgroups were disproportionately negatively affected by the ongoing COVID-19 pandemic. Specifically, women engineering faculty and students encountered more challenges in transitioning to remote teaching and learning. Students with disabilities and those whose households experienced a loss of income during the COVID-19 pandemic faced more remote learning challenges, perceived less instrumental mentoring support, and were more likely to delay their graduate dates. Our structural equation modeling results showed that mentoring support could mitigate remote learning challenges and academic disruption for engineering students. The study underscores the importance of mentoring support during the crisis of a pandemic.
Thinking about knowledge and knowing (i.e., epistemic cognition) is an important part of student learning and has implications for how they apply their knowledge in future courses, careers, and other aspects of their lives. Three classes of models have emerged from research on epistemic cognition: developmental models, dimensional models, and resources models. These models can be distinguished by how value is assigned to particular epistemic ideas (hierarchy), how consistent epistemic ideas are across time and/or context (stability), and the degree to which people are consciously aware of their own epistemic ideas (explicitness). To determine the extent to which these models inform research on epistemic cognition in chemistry education specifically, we reviewed 54 articles on undergraduate chemistry students' epistemologies. First, we sought to describe the articles in terms of the courses and unit of study sampled, the methods and study designs implemented, and the means of data collection utilized. We found that most studies focused on the epistemic cognition of individual students enrolled in introductory chemistry courses. The majority were qualitative and employed exploratory or quasi-experimental designs, but a variety of data collection methods were represented. We then coded each article for how it treated epistemic cognition in terms of hierarchy, stability, and explicitness. The overwhelming majority of articles performed a hierarchical analysis of students' epistemic ideas. An equal number of articles treated epistemic cognition as stable versus unstable across time and/or context. Likewise, about half of the studies asked students directly about their epistemic cognition while approximately half of the studies inferred it from students' responses, course observations, or written artifacts. These codes were then used to infer the models of epistemic cognition underlying these studies. Eighteen studies were mostly consistent with a developmental or dimensional model, ten were mostly aligned with a resources model, and twenty-six did not provide enough information to reasonably infer a model. We advocate for considering how models of epistemic cognition-and their assumptions about hierarchy, stability, and explicitness-influence the design of studies on students' epistemic cognition and the conclusions that can be reasonably drawn from them.


