Skip to main content

2x2 Achievement Goal Questionnaire (Santos Et Al., 2022)

    OVERVIEW
    Overview
    Listed below is general information about the instrument.
    Summary
    Original author(s)
    • Santos, D. L., Barbera, J., & Mooring, S. R.

    Original publication
    • Santos, D. L., Barbera, J., & Mooring, S. R. (2022). Development of the Chemistry Mindset Instrument (CheMI) for use with introductory undergraduate chemistry students. Chemistry Education Research and Practice, 23(3), 742–757. https://doi.org/10.1039/D2RP00102K

    Year original instrument was published 2022
    Inventory
    Number of items 12
    Number of versions/translations 1
    Cited implementations 1
    Language
    • English
    Country United States
    Format
    • Response Scale
    Intended population(s)
    • Students
    • Undergraduate
    Domain
    • Affective
    Topic
    • General (Affective)
    Evidence
    The CHIRAL team carefully combs through every reference that cites this instrument and pulls all evidence that relates to the instruments’ validity and reliability. These data are presented in the following table that simply notes the presence or absence of evidence related to that concept, but does not indicate the quality of that evidence. Similarly, if evidence is lacking, that does not necessarily mean the instrument is “less valid,” just that it wasn’t presented in literature. Learn more about this process by viewing the CHIRAL Process and consult the instrument’s Review (next tab), if available, for better insights into the usability of this instrument.

    Information in the table is given in four different categories:
    1. General - information about how each article used the instrument:
      • Original development paper - indicates whether in which paper(s) the instrument was developed initially
      • Uses the instrument in data collection - indicates whether an article administered the instrument and collected responses
      • Modified version of existing instrument - indicates whether an article has modified a prior version of this instrument
      • Evaluation of existing instrument - indicates whether an article explicitly provides evidence that attempt to evaluate the performance of the instrument; lack of a checkmark here implies an article that administered the instrument but did not evaluate the instrument itself
    2. Reliability - information about the evidence presented to establish reliability of data generated by the instrument; please see the Glossary for term definitions
    3. Validity - information about the evidence presented to establish reliability of data generated by the instrument; please see the Glossary for term definitions
    4. Other Information - information that may or may not directly relate to the evidence for validity and reliability, but are commonly reported when evaluating instruments; please see the Glossary for term definitions
    Publications: 1

    General

    Original development paper
    Uses the instrument in data collection
    Modified version of existing instrument
    Evaluation of existing instrument

    Reliability

    Test-retest reliability
    Internal consistency
    Coefficient (Cronbach's) alpha
    McDonald's Omega
    Inter-rater reliability
    Person separation
    Generalizability coefficients
    Other reliability evidence

    Validity

    Expert judgment
    Response process
    Factor analysis, IRT, Rasch analysis
    Differential item function
    Evidence based on relationships to other variables
    Evidence based on consequences of testing
    Other validity evidence

    Other information

    Difficulty
    Discrimination
    Evidence based on fairness
    Other general evidence
    Review
    DISCLAIMER: The evidence supporting the validity and reliability of the data summarized below is for use of this assessment instrument within the reported settings and populations. The continued collection and evaluation of validity and reliability evidence, in both similar and dissimilar contexts, is encouraged and will support the chemistry education community’s ongoing understanding of this instrument and its limitations.
    This review was generated by a CHIRAL review panel. Each CHIRAL review panel consists of multiple experts who first individually review the citations of the assessment instrument listed on this page for evidence in support of the validity and reliability of the data generated by the instrument. Panels then meet to discuss the evidence and summarize their opinions in the review posted in this tab. These reviews summarize only the evidence that was discussed during the panel which may not represent all evidence available in the published literature or that which appears on the Evidence tab.
    If you feel that evidence is missing from this review, or that something was documented in error, please use the CHIRAL Feedback page.

    Panel Review: 2x2 Achievement Goal Questionnaire (2x2 AGQ)

    (Post last updated 20 December 2024)

    Review panel summary   
    The 2x2 Achievement Goal Questionnaire (2x2 AGQ) is a 12-item, 7 choice Likert type instrument that was developed to investigate a four-factor achievement goal framework [1]. Nine of the items were taken from previous work and three new items were developed. The framework has two dimensions, competency (mastery vs performance) crossed with emotional reaction components (approach vs avoidance). Several aspects of validity and reliability have been assessed in studies involving undergraduate psychology students in the United States [1,2]. Single administration reliability was estimated using coefficient alpha for each of the four proposed subscales [1-3]. Evidence in support of the internal structure of the four-factor subscales has been established through exploratory factor analysis [1] and confirmatory factor analysis [1,2]. The correlation of the four subscales with measures of achievement, fear of failure, study strategies, SAT scores, and subsequent achievement [1-4] offers evidence based on relation to other variables.

    Recommendations for use   
    There is some evidence that the 2x2 AGQ can be used to measure undergraduate student’s achievement goals in the United States and Australia [1-3]. The subscales have been shown to correlate with achievement variables, as both predictors and outcome measures [1-3]. All data regarding subscale performance are from use with the correlated model. Therefore, it is not recommended that individual subscales be used as stand-alone measures without further psychometric investigation of their individual performance.

    One study in chemistry used a modified version where the word class was changed to chemistry [4]. While the mastery subscales were found to correlate to mindset and no significant correlation was found between mindset and the performance goal orientations, no investigation of the internal structure of the 2x2 AGQ with the modified has been done [4]. Therefore, evidence to support the validity and reliability of the data generated with chemistry student populations is limited and should be investigated further. Currently no evidence based on response process has been published.

    Details from panel review   
    The theoretical basis for the instrument is sound. The items were not developed specifically for this instrument, rather they were pulled from other existing instruments. Evidence in support of the internal structure was established through an initial exploratory factor analysis, which supported the proposed structure with items loading on the proposed factors [1]. Multiple confirmatory factor analyses have supported the four-factor structure of the instrument [1,2]. The factors structure was supported in a structural equation model that included the four subscales as well as two temperament (approach and avoidance) subscale [2]. Scores from the four subscales have been found to have predictive power for study strategies, test anxiety, and subsequent achievement and have been predicted by measures of need for achievement, fear of failure, work mastery, and SAT [3].

    References

    [1] Elliot, A.J., & McGregor, H. A. (2001). A 2x2 Achievement Goal Framework. J. of Pers. and Soc. Psych., 80(3), 501-519.

    [2] Elliot, A.J., & Thrash, T.M. (2010). Approach and avoidance temperament as basic dimensions of personality. J. of Personality, 78(3), 865-906.

    [3] De Castella, K., & Byrne, D. (2015). My intelligence may be more malleable than yours: the revised implicit theories of intelligence (self-theory) scale is a better predictor of achievement, motivation, and student disengagement. Eur. J. of Psych. of Educ., 30(3), 245-267.

    [4] Santos, D.L., Barbera, J., & Mooring, S.R. (2022). Development of the chemistry mindset instrument (CheMI) for use with introductory undergraduate chemistry students. Chem. Educ. Res. and Pract., 23, 742-757.

    Versions
    This instrument has not been modified nor was it created based on an existing instrument.
    Citations
    Listed below are all literature that develop, implement, modify, or reference the instrument.
    1. Santos, D. L., Barbera, J., & Mooring, S. R. (2022). Development of the Chemistry Mindset Instrument (CheMI) for use with introductory undergraduate chemistry students. Chemistry Education Research and Practice, 23(3), 742–757. doi.org/10.1039/D2RP00102K