Publications
The notion of being smart is a concept that underpins the culture of engineering classrooms. That said, it is a topic that is not discussed or addressed by educators directly. Through this special session, we aim to give light to the concept of smartness and the problematic and oppressive practices that result from it given the extent literature on the topic including our own research into the domain. With participants, we aim to generate practical approaches to addressing smartness that work in a variety of contexts to broaden participation in engineering via more inclusive classrooms.
The new capabilities of generative artificial intelligence tools Generative AI, such as ChatGPT, allow users to interact with the system in intuitive ways, such as simple conversations, and receive (mostly) good-quality answers. These systems can support students' learning objectives by providing accessible explanations and examples even with vague queries. At the same time, they can encourage undesired help-seeking behaviors by providing solutions to the students' homework. Therefore, it is important to better understand how students approach such tools and the potential issues such approaches might present for the learners. In this paper, we present a case study for understanding student-AI collaboration to solve programming tasks in the CS1 introductory programming course. To this end, we recruited a gender-balanced majority non-white set of 15 CS1 students at a large public university in the US. We observed them solving programming tasks. We used a mixed-method approach to study their interactions as they tackled Python programming tasks, focusing on when and why they used ChatGPT for problem-solving. We analyze and classify the questions submitted by the 15 participants to ChatGPT. Additionally, we analyzed user interaction patterns, their reactions to ChatGPT's responses, and the potential impacts of Generative AI on their perception of self-efficacy. Our results suggest that in about a third of the cases, the student attempted to complete the task by submitting the full description of the tasks to ChatGPT without making any effort on their own. We also observed that few students verified their solutions. We discuss the results and their potential implications.
On average, women faculty take on more childcare responsibilities, posing barriers to career success. Work-family policies represent one solution for advancing gender equity in academia as they support parents after childbirth with benefits for children, employees, and organizations. We contribute to understanding how the availability and use of dependent care policies (paid parental leave and childcare benefits) relate to long-term research productivity trends. Based on the work-home resources model, we theorize that policy availability provides contextual resources and policy use provides personal resources, leading to improvements in an individual's research productivity after they have a child. We also examine potential gender differences in the effect of dependent care policies on research productivity trends. We leverage n = 6945 yearly top publications and h-index observations for 386 business professors from 108 universities. Consistent with our hypotheses, the availability and use of paid parental leave and childcare benefits were associated with increased research productivity trends, though the effects depend on birth order, policy, and gender to some extent. Our findings have considerable theoretical and practical implications for organizations and society.
How teachers attend to and interpret positive relational interactions shapes how they enact instructional practices for equity. We draw on frameworks from equitable mathematics instruction, relational interactions, and teacher noticing to conceptualize mathematics teachers' relational noticing. Using noticing interview and classroom observation data from a research collaborative between secondary mathematics teachers and university-based teacher educators, we document the range and diversity of ten teachers' relational noticing. We use this analysis to examine how teachers' relational noticing supports enacting equitable instructional practices. Our findings indicate five themes of teachers' relational noticing that are informed by their personal histories, understanding of dominant narratives of mathematics education, and their local sociopolitical school context. Additionally, teachers enacted a range of practices for creating positive relational interactions, with attending to student thinking being the most enacted practice. Our findings suggest that mathematics teachers' relational noticing can support the three axes of equitable instruction.
• Introduces two automated transformer models for assessing cognitive question complexity: high-performing LLaMA 2 and efficient, robust RoBERTa. • These fine-tuned transformer language models greatly outperform surface-based and semantic-distance baselines. • Both models predict open-ended question complexity and align strongly with human ratings. • Introduces PrediQT , a free web app for automated question-complexity scoring. • Bridges creativity, cognition, and AI for educational assessment innovation. Question-asking, an essential yet understudied activity, holds significant implications for learning, creativity, and cognitive development. Research shows that asking complex, open-ended questions is better for learning than closed ones. Previous research has explored open-ended question complexity through Bloom's taxonomy, but the measurement of complexity remains challenging. Recent advancements in natural language processing have enabled automated scoring of psychological tasks aligned to human-ratings. However, automatic assessment of open-ended questions remains understudied. We address this gap by fine-tuning transformer language models to predict human ratings of open-ended question complexity and comparing them to existing baseline measures (i.e., word count and semantic distance). Using previously collected human-rated responses and Bloom ratings from a creative question-asking task, we trained an encoder model (RoBERTa) and a Large Language Model (Llama-2-7B). Our results reveal that RoBERTa correlated strongly with human ratings of complexity (r = .73), exceeding baseline measures and offering an efficient, lightweight solution suitable for broad adoption. Our fine-tuned LLaMA 2 model achieved stronger performance (r = .84), establishing a new benchmark for predictive accuracy. Thus, we demonstrate how language models can be utilized to automatically score the complexity of open-ended questions. Importantly, LLaMA 2 demonstrates higher accuracy, while RoBERTa provides a replicable, accessible, and cost-effective option for everyday educational and psychological applications. Our work paves the way for automatic assessment of open-ended questions, which are critical across a wide range of cognitive domains.
Introduction Models are a primary mode of science communication and preparing university students to evaluate models will allow students to better construct models and predict phenomena. Model evaluation relies on students' subject-specific knowledge, perception of model characteristics, and confidence in their knowledge structures.Methods Fifty first-year college biology students evaluated models of concepts from varying biology subject areas with and without intentionally introduced errors. Students responded with 'error' or 'no error' and 'confident' or 'not confident' in their response.Results Overall, students accurately evaluated 65% of models and were confident in 67% of their responses. Students were more likely to respond accurately when models were drawn or schematic (as opposed to a box-and-arrow format), when models had no intentional errors, and when they expressed confidence. Subject area did not affect the accuracy of responses.Discussion Variation in response patterns to specific models reflects variation in model evaluation abilities and suggests ways that pedagogy can support student metacognitive monitoring during model-based reasoning. Error detection is a necessary step towards modeling competence that will facilitate student evaluation of scientific models and support their transition from novice to expert scientists.
The nurturing of learners’ ways of knowing is vital for supporting their intellectual growth and their participation in democratic knowledge societies. This paper traces the development of two interrelated theoretical frameworks that describe the nature of learners’ epistemic thinking and performance and how education can support epistemic growth: the AIR and Apt-AIR frameworks. After briefly reviewing these frameworks, we discuss seven reflections on educational theory development that stem from our experiences working on the frameworks. First, we describe how our frameworks were motivated by the goal of addressing meaningful educational challenges. Subsequently, we explain why and how we infused philosophical insights into our frameworks, and we also discuss the steps we took to increase the coherence of the frameworks with ideas from other educational psychology theories. Next, we reflect on the important role of the design of instruction and learning environments in testing and elaborating the frameworks. Equally important, we describe how our frameworks have been supported by empirical evidence and have provided an organizing structure for understanding epistemic performance exhibited in studies across diverse contexts. Finally, we discuss how the development of the frameworks has been spurred by dialogue within the research community and by the need to address emerging and pressing real-world challenges. To conclude, we highlight several important directions for future research. A common thread running through our work is the commitment to creating robust and dynamic theoretical frameworks that support the growth of learners’ epistemic performance in diverse educational contexts. © The Author(s) 2024.
Simulation can be employed as an interactive computer game to enable game-based learning. Educational simulations can also be combined with immersive technologies such as virtual reality (VR) to enhance student engagement and learning. While recent years have seen significant growth in the use of immersive technologies in education, the role and contribution of the additional immersion offered by VR still needs to be explored. This paper aims to address this gap by comparing low- and high-immersion modes for a simulation game to familiarize students with the fundamental concepts of mathematical optimization. The game resembles performing a heuristic search on the solution space for an optimization problem and involves finding the highest peak in an arctic landscape. Our research experiments include three groups of students who play the game either in VR, desktop mode, or PowerPoint slides. Our statistical comparisons show that VR enhanced students' sense of presence and learning.
Introduction Although the demand for graduates with Science, Technology, Engineering, and Mathematics (STEM) credentials continues to climb, women remain underrepresented as both students and faculty in STEM higher education. Compounding social forces can hinder organizational change for gender equity in STEM, constraining institutions and individuals within them. This study advances macrostructural theory to examine the impact of gender composition (including group size and heterogeneity) of women faculty on structural change, as measured by gender desegregation of STEM degree earners. We advance this theory by incorporating faculty rank, rather than treating group composition as a static category.Method This study draws on a federal repository of data to assess institutional change in the share of STEM women faculty in the U.S. We employ quasi-experimental methods to explore the following research questions: (1) does hiring more women onto an institution's faculty roster shrink the gender gap among STEM degree earners? and (2) does segregation of faculty by gender within institutions shape the gender gap among STEM degree earners?Findings While institutional efforts herald their efforts of hiring more women faculty, our findings indicate that gender desegregation of STEM degree earners partially depends on the promotion of women faculty to tenure.Discussion Implications for theory, policy, and practice are discussed, with a focus on institutional-level change.


