Systems Thinking Assessment For Organic Chemistry

OVERVIEW

Overview

Listed below is general information about the instrument.

Summary
Original author(s)	Vachliotis, T., Salta, K., & Tzougraki, C.
Original publication	Vachliotis, T., Salta, K., & Tzougraki, C. (2014). Meaningful Understanding and Systems Thinking in Organic Chemistry: Validating Measurement and Exploring Relationships. Research in Science Education, 44(2), 239-266.
Year original instrument was published	2013
Inventory
Number of items	22
Number of versions/translations	1
Cited implementations	1
Language	Unknown
Country	Greece
Format	Multiple Choice True/False Other
Intended population(s)	Students High School
Domain	Cognitive
Topic	Organic Chemistry

EVIDENCE

Evidence

The CHIRAL team carefully combs through every reference that cites this instrument and pulls all evidence that relates to the instruments’ validity and reliability. These data are presented in the following table that simply notes the presence or absence of evidence related to that concept, but does not indicate the quality of that evidence. Similarly, if evidence is lacking, that does not necessarily mean the instrument is “less valid,” just that it wasn’t presented in literature. Learn more about this process by viewing the CHIRAL Process and consult the instrument’s Review (next tab), if available, for better insights into the usability of this instrument.

Information in the table is given in four different categories:

General - information about how each article used the instrument:
- Original development paper - indicates whether in which paper(s) the instrument was developed initially
- Uses the instrument in data collection - indicates whether an article administered the instrument and collected responses
- Modified version of existing instrument - indicates whether an article has modified a prior version of this instrument
- Evaluation of existing instrument - indicates whether an article explicitly provides evidence that attempt to evaluate the performance of the instrument; lack of a checkmark here implies an article that administered the instrument but did not evaluate the instrument itself
Reliability - information about the evidence presented to establish reliability of data generated by the instrument; please see the Glossary for term definitions
Validity - information about the evidence presented to establish reliability of data generated by the instrument; please see the Glossary for term definitions
Other Information - information that may or may not directly relate to the evidence for validity and reliability, but are commonly reported when evaluating instruments; please see the Glossary for term definitions

Publications:	1
General
Original development paper	✔
Uses the instrument in data collection	✔
Modified version of existing instrument
Evaluation of existing instrument	✔
Reliability
Test-retest reliability
Internal consistency
Coefficient (Cronbach's) alpha	✔
McDonald's Omega
Inter-rater reliability	✔
Person separation
Generalizability coefficients
Other reliability evidence
Validity
Expert judgment	✔
Response process	✔
Factor analysis, IRT, Rasch analysis	✔
Differential item function
Evidence based on relationships to other variables	✔
Evidence based on consequences of testing
Other validity evidence
Other information
Difficulty	✔
Discrimination	✔
Evidence based on fairness
Other general evidence

Systems Thinking Assessment For Organic Chemistry

General

Reliability

Validity

Other information

CHIRAL

ChemEd X

NSF