(Post last updated June 16, 2022)
Review panel summary
The Test of Science-Related Attitudes (TOSRA) is a 24-item, 5-point Likert-scale instrument designed to measure students’ science-related attitudes. The instrument is adapted from a 1978 instrument published by Fraser for use with Australian middle and high school students [1]. The original instrument contained 7 scales [1]. The present version, which has been shortened to only 3 scales (i.e., (1) normality of a scientist’s life, (2) the role of inquiry in scientific discovery, and (3) student interest in a scientific career), has been evaluated in a population of first-term general chemistry students [1]. Evidence for internal structure validity is provided in the form of a 3-factor confirmatory factor analysis (CFA) solution (Normality, Inquiry, and Career as noted above) [1]. An analysis of the modification indices from the CFA along with the evaluation of the wording/redundancy of some of the items resulted in the elimination of 6 items to generate the final 24-item (8 items per factor/scale) instrument [1]. Measurement invariance was analyzed, revealing support for TOSRA score comparisons by gender (male, female) across all 3 scales and by race/ethnicity (White, Black, Hispanic/Latino, Asian) across 2 scales. Invariance was not supported in the Normality scale for individuals identified as Black, therefore, no score comparisons by race/ethnicity were conducted. Structural equation modeling was performed to identify the relation between achievement and Inquiry as well as achievement and Career scales. The evidence for relations to other variables shows a negative correlation between achievement and Inquiry and a positive correlation between achievement and Career. In terms of reliability, Cronbach’s alpha has been used to estimate single administration reliability for both the 30-item and 24-item instruments, and the values were found to be acceptable.
Recommendations for use
The TOSRA was developed to analyze students’ science-related attitudes across three categories (Normality, Inquiry, and Career) [1]. According to the validity and reliability evidence presented, the instrument can be used to compare all three science-related attitudes across genders (male, female) of first-term general chemistry students. However, measurement invariance testing revealed a lack of support for the Normality scale for individuals identified as Black. Therefore, further evaluations are necessary prior to the use of all three categories of the TOSRA when making comparisons between diverse racial and ethnic groups.
Details from panel review
No additional details were discussed by the panel.
References
[1] Villafañe, S.M., & Lewis, J.E. (2016). Exploring a measure of science attitude for different groups of students enrolled in introductory college chemistry. Chemistry Education Research and Practice, 17(4), 731-742. https://doi.org/10.1039/C5RP00185D