Publications
As online learning platforms become more ubiquitous throughout various curricula, there is a growing need to evaluate the effectiveness of these platforms and the different methods used to structure online education and tutoring. Towards this endeavor, some platforms have performed randomized controlled experiments to compare different user experiences, curriculum structures, and tutoring strategies in order to ensure the effectiveness of their platform and personalize the education of the students using it. These experiments are typically analyzed on an individual basis in order to reveal insights on a specific aspect of students’ online educational experience. In this work, the data from 50,752 instances of 30,408 students participating in 50 different experiments conducted at scale within the online learning platform ASSISTments were aggregated and analyzed for consistent trends across experiments. By combining common experimental conditions and normalizing the dependent measures between experiments, this work has identified multiple statistically significant insights on the impact of various skill mastery requirements, strategies for personalization, and methods for tutoring in an online setting. This work can help direct further experimentation and inform the design and improvement of new and existing online learning platforms. The anonymized data compiled for this work are hosted by the Open Science Foundation and can be found at https://osf.io/59shv/. © 2022 Copyright is held by the author(s).
Studies have shown that on-demand assistance, additional instruction given on a problem per student request, improves student learning in online learning environments. Students may have opinions on whether an assistance was effective at improving student learning. As students are the driving force behind the effectiveness of assistance, there could exist a correlation between students’ perceptions of effectiveness and the computed effectiveness of the assistance. This work conducts a survey asking secondary education students on whether a given assistance is effective in solving a problem in an online learning platform. It then provides a cursory glance at the data to view whether a correlation exists between student perception and the measured effectiveness of an assistance. Over a three year period, approximately twenty-two thousand responses were collected across nearly four thousand, four hundred students. Initial analyses of the survey suggest no significance in the relationship between student perception and computed effectiveness of an assistance, regardless of if the student participated in the survey. All data and analysis conducted can be found on the Open Science Foundation website1 © 2022 Copyright is held by the author(s).
As computer-based learning platforms have become ubiquitous, there is a growing need to better support teachers. Particularly in mathematics, teachers often rely on open-ended questions to assess students’ understanding. While prior works focusing on the development of automated open-ended work assessments have demonstrated their potential, many of those methods require large amounts of student data to make reliable estimates. We explore whether a problem specific automated scoring model could benefit from auxiliary data collected from similar problems to address this “cold start” problem. We examine factors such as sample size and the magnitude of similarity of utilized problem data. We find the use of data from similar problems not only provides benefits to improve predictive performance by increasing sample size, but also leads to greater overall model performance than using data solely from the original problem when sample size is held constant. © 2022 Copyright is held by the author(s).
This Research Commentary addresses the need for an instrument abstract???termed an Interpretation and Use Statement (IUS)???to be included when mathematics educators present instruments for use by others in journal articles and other communication venues (e.g., websites and administration manuals). We begin with presenting the need for IUSs, including the importance of a focus on interpretation and use. We then propose a set of elements???identified by a group of mathematics education researchers, instrument developers, and psychometricians???to be included in the IUS. We describe the development process, the recommended elements for inclusion, and two example IUSs. Last, we present why IUSs have the potential to benefit end users and the field of mathematics education.
This article investigates the implementation of inquiry-oriented instruction in 20 undergraduate mathematics classrooms. In contrast to conventional wisdom that active learning is good for all students, we found gendered performance differences between women and men in the inquiry classes that were not present in a noninquiry comparison sample. Through a secondary analysis of classroom videos, we linked these performance inequities to differences in women's participation rates across classes. Thus, we provide empirical evidence that simply implementing active learning is insufficient, and that the nature of inquiry-oriented classrooms is highly consequential for improving gender equity in mathematics.
Over the past three decades, billions have been invested in community policing to foster positive interactions between officers and community members. Yet, public trust in police continues to decline. Our qualitative analysis of over 500 hours of naturalistic observations suggests a potential reason: the questioning styles of officers in community policing may make community members feel threatened. Observations also point to a solution: transparent communication of benevolent intent. Building on this, a pre-registered field experiment (N = 232) finds that community members feel less threatened and report greater trust when officers use a brief transparency statement (e.g., "I'm walking around trying to get to know the community"). These findings are supported by exploratory natural language processing and sympathetic nervous system measures. Six online experiments (total N = 3210) further show that transparency statements are effective across diverse groups and isolate the conditions where they work best. This multi-method investigation underscores the importance of transparency in fostering positive community-police relations.
¿Cómo reacciona la ciudadanía en un sistema político polarizado ante una emergencia como la pandemia de la COVID-19?, ¿cómo procesa la ciudadanía las narrativas polarizadas que están en conflicto?, y ¿qué imagen se forman de la gestión política de la amenaza de la pandemia? En EE. UU, hay que retrotraerse a la epidemia de la polio de hace 70 años para encontrar una emergencia sanitaria como la pandemia de la COVID-19. No obstante, hay importantes diferencias; en la década de 1950, el clima político de los EE.UU. era mucho más uniforme y consensuado que el actual, profundamente dividido y polarizado. Este trabajo utiliza datos de un estudio longitudinal realizado durante 35 años en personas jóvenes de la Generación X (ahora ya en la cuarentena) y datos provenientes de encuestas realizadas en Estados Unidos durante tres décadas, con el propósito de examinar los patrones de adquisición de la información en la comprensión de una nueva amenaza. Nuestro análisis de los últimos 35 años de la Generación X muestra que, en las elecciones de 2020, el factor predictivo del voto individual que tuvo más fuerza fue una ideología política polarizada, pero, aquellas personas que contaban con una mejor comprensión del coronavirus fueron más críticas con la gestión de la pandemia de la COVID-19 que realizó la administración de Donald Trump y estuvieron más predispuestas a votar por Joe Biden que a votar por Trump. Un análisis paralelo de una muestra probabilística representativa de personas adultas estadounidenses en 2020 reveló el mismo patrón de influencia del partidismo ideológico, la comprensión del coronavirus y la evaluación de la administración de Trump. Los resultados muestran que el conocimiento y la comprensión pueden proporcionar un efecto moderador crítico en un sistema político polarizado y dividido.
Virtual cross-border medical tourism allows many residents in the United States to purchase brand name medicines from companies in Mexico without travelling there. Monthly economic reports indicate that the online brand name pharmaceutical product prices in Mexico are noticeably lower than the corresponding internet prices in the United States. There have been very few econometric studies on how these prices are linked and the dynamic nature of those relationships. Results in this study indicate that online medicine prices in Mexico respond very rapidly to online prices changes in the high-price market.


