Publications
AI recommendations influence our daily decisions. The convenience of navigating personalized content goes hand-in-hand with the notorious filter bubble effect, which may decrease people's exposure to diverse options and opinions. Children are especially vulnerable to this due to their limited AI literacy and critical thinking skills. In this study, we propose a novel Augmented Reality (AR) application BeeTrap. It aims to not only raise children's awareness of filter bubbles but also empower them to mitigate this ethical issue through sense-making of AI recommendation systems' inner workings. By having children experience and break filter bubbles in a flower recommendation system, BeeTrap utilizes embodied metaphors (e.g., NEAR-FAR, ITERATION) and analogies (bee pollination) to bridge abstract AI concepts with sensory-motor experiences in familiar STEM contexts. To evaluate our design's effectiveness and accessibility for a broad range of children, we introduced BeeTrap in a four-day summer camp for middle-school students from underrepresented backgrounds in STEM. Results from pre- and post-tests and interviews show that BeeTrap developed students' technical understanding of AI recommendations, empowered them to break filter bubbles, and helped them foster new personal and societal perspectives around AI technologies.
With the passage of the Chips and Science Act, semiconductor workforce development has become front and center for US universities. Among the many skills needed for undergraduates to enter the semiconductor industry, debugging is an important skill that is rarely taught. As the transistor count and complexity of today’s chips grow, thanks to Moore’s Law, fewer new chips can work perfectly for the first time. Hence, much engineering effort is put into debugging, a process that identifies and fixes any discrepancies between the expected and measured chip behavior. This paper first investigates the need and the economic incentives of debugging in the semiconductor industry. It was estimated that a typical semiconductor project spent 35 to 50 percent of its time in debugging. The need for silicon debugging has led to a new profession called validation engineers. Debugging has also gained the nickname of the Schedule Killer, highlighting its impact on the project schedule and the company’s bottom line. Next, the paper summarizes existing cognitive models of troubleshooting. Early models often failed to capture the role of experience, which was essential for circuit and hardware debugging. Jonassen et al. proposed a troubleshooting learning architecture that includes the contribution of past experiences. This cognitive framework has been successfully applied in computer science and physics education, leading to some of the latest pedagogy innovations, such as collaborative pair debugging. This paper also investigates multiple emotions associated with debugging, such as frustration, fear, and anxiety. These emotions may lead to disengagement and avoidance of the subjects. Debugging may also be related to other non-cognitive factors, such as mindsets. The positive effect of teaching self-theory and a growth mindset has been observed in different age groups. However, studies also found that domain-specific aptitudes were more helpful in changing student’s performance in the subject matter. The takeaway message from this paper is that a genuinely effective debugging education intervention must be holistic and domain-specific. Holistic means that the intervention should address both cognitive and affective components. Domain specificity means that any growth mindset message should be contextually situated within the subject matter materials. How to design such an intervention will be the next million-dollar question, as it not only fills the gap of collegiate debug education in microelectronics but also serves as a critical missing piece toward developing a globally competent semiconductor workforce for generations to come.
The construction industry has been a predominantly White/Caucasian Men community with a very low representation of women and people from traditionally marginalized backgrounds. Even though companies have been implementing Diversity, Equity, and Inclusion (DEI) statements for many years, we still believe it is neither a diverse nor equitable field. To better understand how DEI statements declared by companies have been understood and recognized by employees, a survey was deployed nationwide to understand how professionals in the construction industry perceive their organization's DEI statements or policies. A complete data set was built from 249 participants. 75% identified themselves as men and 25% as women, and nobody identified with other gender identities. More than 80% of participants were White/Caucasian, 4% Black or African American, 4% Hispanic or Latinx, and 6% Asian. Participants are currently working in small (24%), medium (30%), and large (46%) construction and design companies located across The United States. Regarding the number of employees, companies are small, less than 99 employees; medium, between 100 and 499 employees; and large, more than 500 employees. Also, companies were grouped into four main types, building construction companies (67%), transportation construction companies (6%), special trade contractor companies (17%), and design companies (10%). For more than 65% of professionals in the construction industry who participated in this study, DEI was mainly related to proper representation of women and minoritized populations in the workforce; Merit-based transparent recruitment and promotion; equality, social justice, and nondiscrimination policy statement; and equitable payment and compensation. Other factors such as proper representation of women and minoritized populations at the top management level and payment structure transparency did not emerge from the results. We also found that 70% of professionals identified DEI statements in their companies and 30% of professionals did not identify or did not know about DEI statements. Looking at the company size, 85% of professionals in large companies identified DEI statements in their companies, but 71% and 42% of professionals in medium and small companies identified DEI statements in their companies, respectively. According to the company type, more than 80% of professionals working in design companies recognized DEI statements in their companies, but around 60% in construction and special trade companies. We can highlight that large companies have established policies and practices that result in better socialization and recognition of their DEI statements than medium and small companies. Also, construction and special trade companies need to strengthen their DEI statements and increase the representation of women and people from traditionally marginalized backgrounds. Results from this research give an idea about the current state of DEI in the construction industry and would contribute to the current effort to increase the diversity of the nation's construction workforce.
This work investigates relationships between consistent attendance -attendance rates in a group that maintains the same tutor and students across the school year- and learning in small group tutoring sessions. We analyzed data from two large urban districts consisting of 206 9th-grade student groups (3 - 6 students per group) for a total of 803 students and 75 tutors. The students attended small group tutorials approximately every other day during the school year and completed a pre and post-assessment of math skills at the start and end of the year, respectively. First, we found that the attendance rates of the group predicted individual assessment scores better than the individual attendance rates of students comprising that group. Second, we found that groups with high consistent attendance had more frequent and diverse tutor and student talk centering around rich mathematical discussions. Whereas we emphasize that changing tutors or groups might be necessary, our findings suggest that consistently attending tutorial sessions as a group with the same tutor might lead the group to implicitly learn as a team despite not being one.
Game-based learning environments (GBLEs) supplement classroom instruction so students can demonstrate their scientific reasoning abilities and increase knowledge, providing a platform that promotes interest and engagement in science. The goal of this study was to examine the effectiveness of game mechanics for science learning. This study identifies how two types of game mechanics-learning and assessment mechanics-are used by high school participants (N = 137) as they learn about microbiology with Crystal Island, a game-based learning environment for science education. Participants' learning outcomes were evaluated in two ways: learning gains, which assessed participants' domain knowledge acquisition, and game completion, which assessed participants' ability to successfully demonstrate scientific reasoning abilities. Results from this study showed that game completion is not related to learning gains. However, as participants engaged with increasingly more assessment mechanics, learning gains decreased. Further, profiles of learners were extracted to better understand the learning process that best supports greater learning outcomes. Results showed that learners who engaged in less recurrent transitions across assessment mechanics were more likely to successfully demonstrate scientific reasoning abilities. Implications for the design of games which provide scaffolding based on process data of learners' game mechanic use are provided.
Stronger metacognitive regulation skills and higher self-efficacy are linked to increased academic achievement. Metacognition and self-efficacy have primarily been studied using retrospective methods, but these methods limit access to students' in-the-moment metacognition and self-efficacy. We investigated first-year life science students' metacognition and self-efficacy while they solved challenging problems, and asked: 1) What metacognitive regulation skills are evident when first-year life science students solve problems on their own? and 2) What aspects of learning self-efficacy do first-year life science students reveal when they solve problems on their own? Think-aloud interviews were conducted with 52 first-year life science students across three institutions and analyzed using content analysis. Our results reveal that while first-year life science students plan, monitor, and evaluate when solving challenging problems, they monitor in a myriad of ways. One aspect of self-efficacy, which we call self-coaching, helped students move past the discomfort of monitoring a lack of understanding so they could take action. These verbalizations suggest ways we can encourage students to couple their metacognitive skills and self-efficacy to persist when faced with challenging problems. Based on our findings, we offer recommendations for helping first-year life science students develop and strengthen their metacognition to achieve improved problem-solving performance.
Course -based undergraduate research experiences (CUREs) have been proposed as a mechanism to democratize access to the benefits of apprentice -style scientific research to a broader diversity of students, promoting inclusivity and increasing student success and retention. As we evaluate CUREs, it is essential to explore their effectiveness within the environments of regional comprehensive universities and community colleges, because they are important access points for a wide variety of students. It is also important to address the potential influence of volunteer bias, where students can opt to enroll in either the CURE or a traditional lab, on the outcomes of CUREs. We evaluated a CURE at a regional comprehensive university under conditions both with and without volunteer bias. We find that nonvolunteer students report a lower sense of discovery and relevance of the CURE compared with students who volunteered for the course. Importantly, we also find that our replacement of the traditional lab class with a CURE resulted in lower scores on exams in the associated lecture course among students who are both BIPOC and Pell eligible. We call for additional research on the effects of CUREs at nonresearch-intensive institutions and without volunteer bias, to better understand the impact of these classes.


