Publications
The Conscientiousness x Interest Compensation (CONIC) model (Trautwein et al., 2019) assumes that the two constructs conscientiousness and interest can (partly) compensate for each other in predicting academic effort and achievement. We extend previous work by testing the CONIC model in two independent U.S. samples from different age groups (high school sample: N = 1,246, Mage = 14.86 years; college sample: N = 581, Mage = 19.83 years). We also assessed whether the compensatory relations occur when grit is substituted for conscientiousness and students' overall task value or utility value for interest. We preregistered the study and tested the various models for both science and math effort as well as achievement, using latent variable regression analyses. Overall, we found some support for the CONIC model in the U.S. samples. There was also some support for the extensions of the model to the other constructs; however, the predictive links were not as strong.
Researchers developing questionnaire measures of personality, motivation, and self-regulation constructs related to students' achievement and persistence in STEM or other fields rarely have examined whether the items on the measures used are functioning differently across groups, which is necessary for accurate group comparison. The present study assessed differential item functioning (DIF) in two frequently-used measures of such constructs, the Grit-S, the Motivated Strategies for Learning Questionnaire (MSLQ), and a new measure of long-term grit, using a sample of 1,146 ninth and tenth-grade students in the U.S.A. We also assessed gender and racial differences in the patterns of the relationships among the latent constructs, something rarely reported in the literature. Differences in such patterns indicate that the concurrent validity of the construct scores could vary across different groups. Results indicated that numerous items exhibited gender DIF on the Grit-S but not on the MSLQ or long-term grit measure. There were fewer DIF items across racial groups. Patterns of relations among the variables, in general, were weaker for females than males. There were fewer racial groups differences in the patterns of correlations. We discuss the implications of the DIF findings for future research on group comparisons.
Measuring change in an educational or psychological construct over time is often achieved by repeatedly administering the same items to the same examinees over time and fitting a second-order latent growth curve model. However, latent growth modeling with full information maximum likelihood (FIML) estimation becomes computationally challenging when the observed response data are categorical. This study first discusses some possible options that researchers can take regarding model specification and estimation (e.g., limited-information and various FIML estimators) to circumvent the challenge. To explore the utility of a stochastic Newton-Raphson type of algorithm (i.e., Metropolis Hastings-Robbins Monro; MH-RM) implemented primarily for multidimensional item response model, a re-parameterized latent growth model is also introduced. The viability of each option is examined via Monte-Carlo simulations. Insights on the pros and cons of these options and the conditions under which they are applicable are provided for researchers.
Grit is defined as passion and perseverance for achieving long-term goals and consists of two proposed subcomponents: consistency of interests and perseverance of effort. It has become a much-discussed construct even though research on its underlying factor structure has produced inconclusive results. Furthermore, grit as measured by its most frequently used measure, the Grit-S, does not clearly define long term or include the word passion. In addition, only a few studies have looked at factor structure variation and predictive validity of grit in different age and cultural groups. We examined, using state of the art multidimensional item response models and structural equation models, the factor structure of both the Grit-S and a newly developed scale (LT-Grit scale) that specifies what is meant by long term. Participants included 1,250 U.S. high school students, 600 U.S. college students, and 500 Korean college students. We found varying factor structures for the Grit-S and a stable one-factor structure for LT-Grit, across age and culture. Perseverance of effort as measured by the Grit-S was the strongest predictor of grades in the three samples. LT-Grit predicted grades only in the U.S. high school and Korean college samples. Thus, there is no evidence that a consistent grit factor or factors exist across age and culture.
When grit was first introduced, it gained popularity before basic psychometric questions were fully explored. One critical issue is how distinct grit is from the Big Five personality trait conscientiousness. Most studies have examined correlations between grit and conscientiousness, rather than conducting item-level factor analysis. This study examined the extent to which grit and conscientiousness are empirically distinct, and which predict students' grades. A diverse sample of adolescents completed measures of grit and conscientiousness. MIRT-based confirmatory factor analyses showed that grit and conscientiousness' factor structures strongly overlap. Structural equation modeling showed that conscientiousness and the perseverance of effort component of grit predicted students' grades more strongly than consistency of interest. These findings indicate that grit and conscientiousness are not unique constructs. (C) 2020 Elsevier Inc. All rights reserved.
In item response theory (IRT), it is often necessary to perform restricted recalibration (RR) of the model: A set of (focal) parameters is estimated holding a set of (nuisance) parameters fixed. Typical applications of RR include expanding an existing item bank, linking multiple test forms, and associating constructs measured by separately calibrated tests. In the current work, we provide full statistical theory for RR of IRT models under the framework of pseudo-maximum likelihood estimation. We describe the standard error calculation for the focal parameters, the assessment of overall goodness-of-fit (GOF) of the model, and the identification of misfitting items. We report a simulation study to evaluate the performance of these methods in the scenario of adding a new item to an existing test. Parameter recovery for the focal parameters as well as Type I error and power of the proposed tests are examined. An empirical example is also included, in which we validate the pediatric fatigue short-form scale in the Patient-Reported Outcome Measurement Information System (PROMIS), compute global and local GOF statistics, and update parameters for the misfitting items. © 2019 The Psychometric Society.
In the present study, we examined the extent to which grit’s 2 components, consistency of interests and perseverance of effort, overlap with future-oriented motivation, relate to other motivational variables including self-efficacy, task values, and goal orientations, and predict achievement in high school students (N = 190) controlling for motivational variables. Exploratory factor analyses revealed that grit was empirically distinct from, and relatively weakly related to, the future-oriented motivation variables future time perspective and instrumentality. The perseverance of effort component of grit was more strongly correlated with self-efficacy, task values, and goal orientations than was consistency of interests. When controlling for motivational variables, perseverance of effort emerged as a significant predictor of end-of-semester grades, but consistency of interests did not. However, self-efficacy was a stronger predictor of grades than either of the grit components. Together, these results suggest that grit is distinct from future oriented motivation, and that perseverance of effort is more strongly associated with motivation and achievement than is consistency of interests for high school students. (PsycInfo Database Record (c) 2022 APA, all rights reserved)
The purpose of this article is to introduce and review the capability and performance of the Stata item response theory (irt) package that is available from Stata V.14, 2015. Using a simulated data set and a publicly available item response data set extracted from Programme of International Student Assessment, we review the irt package from applied and methodological researchers' perspectives. After discussing the supported item response models and estimation methods implemented in the package, we demonstrate the accuracy of estimation compared to results from other typically used software packages. Other application features for differential item function analysis, scoring, and the package generating graphs are also reviewed.
Duckworth, Peterson, Matthews, and Kelly (2007) defined grit as one's passion and perseverance toward long-term goals. They proposed that it consists of 2 components: consistency of interests and perseverance of effort. In a high school and college student sample, we used a multidimensional item response theory approach to examine (a) the factor structure of grit, and (b) grit's relations to and overlap with conceptually and operationally similar constructs in the personality, self-regulation, and engagement literatures, including self-control, conscientiousness, cognitive self-regulation, effort regulation, behavioral engagement, and behavioral disaffection. A series of multiple regression analyses with factor scores was used to examine (c) grit's prediction of end-of-semester course grades. Findings indicated that grit's factor structure differed to some degree across high school and college students. Students' grit overlapped empirically with their concurrently reported self-control, self-regulation, and engagement. Students' perseverance of effort (but not their consistency of interests) predicted their later grades, although other self-regulation and engagement variables were stronger predictors of students' grades than was grit.


